[ 0.000000] Linux version 4.18.0rh8.10-debug (green@maintenance) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-26) (GCC)) #2 SMP Mon Jul 14 01:24:22 EDT 2025 [ 0.000000] Command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffcdfff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffce000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x0000000146dfffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.8 present. [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 [ 0.000000] Hypervisor detected: KVM [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 425190048 cycles [ 0.000000] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns [ 0.000000] tsc: Detected 2400.000 MHz processor [ 0.000000] last_pfn = 0x146e00 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0xbffce max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000f54b0-0x000f54bf] [ 0.000000] RAMDISK: [mem 0xbcc54000-0xbffbffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F52D0 000014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 0x00000000BFFE247C 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 0x00000000BFFE2318 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 0x00000000BFFE0040 0022D8 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 0x00000000BFFE0000 000040 [ 0.000000] ACPI: APIC 0x00000000BFFE238C 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: HPET 0x00000000BFFE241C 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: WAET 0x00000000BFFE2454 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0xbffe2318-0xbffe238b] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe2317] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0xbffe238c-0xbffe241b] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0xbffe241c-0xbffe2453] [ 0.000000] ACPI: Reserving WAET table memory at [mem 0xbffe2454-0xbffe247b] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x0000000146dfffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x1465a3000-0x1465cdfff] [ 0.000000] Reserving 256MB of memory at 2752MB for crashkernel (System RAM: 4205MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009efff] [ 0.000000] node 0: [mem 0x0000000000100000-0x00000000bffcdfff] [ 0.000000] node 0: [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Zeroed struct page in unavailable ranges: 4756 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x0000000146dfffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] TSC deadline timer available [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] kvm-guest: KVM setup pv remote TLB flush [ 0.000000] kvm-guest: setup PV sched yield [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbffce000-0xbfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.000000] [mem 0xc0000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u524288 [ 0.000000] kvm-guest: PV spinlocks enabled [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1059606 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] audit: disabled (until reboot) [ 0.000000] software IO TLB: area num 4. [ 0.000000] Memory: 2829652K/4306352K available (18435K kernel code, 11221K rwdata, 7248K rodata, 2908K init, 18040K bss, 524580K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] ftrace: allocating 41240 entries in 162 pages [ 0.000000] ftrace: allocated 162 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU event tracing is enabled. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=4. [ 0.000000] rcu: RCU callback double-/use-after-free debug enabled. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 [ 0.000000] NR_IRQS: 524544, nr_irqs: 456, preallocated irqs: 16 [ 0.000000] random: get_random_bytes called from start_kernel+0x622/0x9a8 with crng_init=0 [ 0.001000] Console: colour *CGA 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns [ 0.001012] APIC: Switch to symmetric I/O mode setup [ 0.002383] x2apic enabled [ 0.003004] Switched APIC routing to physical x2apic. [ 0.004009] kvm-guest: setup PV IPIs [ 0.007313] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.008000] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x22983777dd9, max_idle_ns: 440795300422 ns [ 0.008017] Calibrating delay loop (skipped) preset value.. 4800.00 BogoMIPS (lpj=2400000) [ 0.009008] pid_max: default: 32768 minimum: 301 [ 0.010123] LSM: Security Framework initializing [ 0.011000] Yama: becoming mindful. [ 0.011000] SELinux: Initializing. [ 0.011049] *** VALIDATE selinux *** [ 0.019211] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, vmalloc) [ 0.023670] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc) [ 0.024117] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.025076] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.026089] *** VALIDATE tmpfs *** [ 0.027435] *** VALIDATE proc *** [ 0.029040] *** VALIDATE cgroup *** [ 0.030005] *** VALIDATE cgroup2 *** [ 0.031213] x86/cpu: User Mode Instruction Prevention (UMIP) activated [ 0.032117] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.033003] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 [ 0.034019] Spectre V2 : User space: Vulnerable [ 0.035004] Speculative Store Bypass: Vulnerable [ 0.038480] debug: unmapping init [mem 0xffffffffa1259000-0xffffffffa1260fff] [ 0.040148] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (family: 0x6, model: 0x3e, stepping: 0x4) [ 0.041574] Performance Events: IvyBridge events, full-width counters, Intel PMU driver. [ 0.042014] ... version: 2 [ 0.043006] ... bit width: 48 [ 0.044007] ... generic registers: 4 [ 0.045006] ... value mask: 0000ffffffffffff [ 0.046006] ... max period: 00007fffffffffff [ 0.047007] ... fixed-purpose events: 3 [ 0.048006] ... event mask: 000000070000000f [ 0.049271] rcu: Hierarchical SRCU implementation. [ 0.051259] smp: Bringing up secondary CPUs ... [ 0.052459] x86: Booting SMP configuration: [ 0.053019] .... node #0, CPUs: #1 #2 #3 [ 0.056008] smp: Brought up 1 node, 4 CPUs [ 0.058009] smpboot: Max logical packages: 1 [ 0.059011] smpboot: Total of 4 processors activated (19200.00 BogoMIPS) [ 0.134401] node 0 deferred pages initialised in 74ms [ 0.137269] devtmpfs: initialized [ 0.138187] x86/mm: Memory block size: 128MB [ 0.140592] gcov: version magic: 0x41383552 [ 0.141595] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.144061] futex hash table entries: 1024 (order: 4, 65536 bytes, vmalloc) [ 0.146242] pinctrl core: initialized pinctrl subsystem [ 0.148115] [ 0.148515] ************************************************************* [ 0.151008] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.153007] ** ** [ 0.155008] ** IOMMU DebugFS SUPPORT HAS BEEN ENABLED IN THIS KERNEL ** [ 0.156007] ** ** [ 0.159007] ** This means that this kernel is built to expose internal ** [ 0.161008] ** IOMMU data structures, which may compromise security on ** [ 0.162007] ** your system. ** [ 0.164006] ** ** [ 0.165006] ** If you see this message and you are not debugging the ** [ 0.167007] ** kernel, report this immediately to your vendor! ** [ 0.169006] ** ** [ 0.171006] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.173008] ************************************************************* [ 0.174614] NET: Registered protocol family 16 [ 0.176363] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations [ 0.178049] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.180027] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.182391] cpuidle: using governor menu [ 0.183627] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.185407] PCI: Using configuration type 1 for base access [ 0.186091] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.195120] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.199017] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.204034] cryptd: max_cpu_qlen set to 1000 [ 0.206177] ACPI: Added _OSI(Module Device) [ 0.207008] ACPI: Added _OSI(Processor Device) [ 0.208010] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.210007] ACPI: Added _OSI(Processor Aggregator Device) [ 0.212971] ACPI: 1 ACPI AML tables successfully acquired and loaded [ 0.218436] ACPI: Interpreter enabled [ 0.220054] ACPI: PM: (supports S0 S3 S4 S5) [ 0.221009] ACPI: Using IOAPIC for interrupt routing [ 0.222101] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.225516] ACPI: Enabled 2 GPEs in block 00 to 0F [ 0.234330] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.239071] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3] [ 0.242087] acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI] [ 0.244097] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.248306] acpiphp: Slot [2] registered [ 0.249099] acpiphp: Slot [5] registered [ 0.251142] acpiphp: Slot [6] registered [ 0.252137] acpiphp: Slot [7] registered [ 0.253000] acpiphp: Slot [8] registered [ 0.253000] acpiphp: Slot [9] registered [ 0.254085] acpiphp: Slot [10] registered [ 0.255098] acpiphp: Slot [3] registered [ 0.256070] acpiphp: Slot [4] registered [ 0.258085] acpiphp: Slot [11] registered [ 0.259142] acpiphp: Slot [12] registered [ 0.260065] acpiphp: Slot [13] registered [ 0.262067] acpiphp: Slot [14] registered [ 0.263065] acpiphp: Slot [15] registered [ 0.264085] acpiphp: Slot [16] registered [ 0.266077] acpiphp: Slot [17] registered [ 0.267087] acpiphp: Slot [18] registered [ 0.268044] acpiphp: Slot [19] registered [ 0.269056] acpiphp: Slot [20] registered [ 0.271071] acpiphp: Slot [21] registered [ 0.272135] acpiphp: Slot [22] registered [ 0.273053] acpiphp: Slot [23] registered [ 0.275069] acpiphp: Slot [24] registered [ 0.276000] acpiphp: Slot [25] registered [ 0.276000] acpiphp: Slot [26] registered [ 0.278164] acpiphp: Slot [27] registered [ 0.279069] acpiphp: Slot [28] registered [ 0.280062] acpiphp: Slot [29] registered [ 0.281023] acpiphp: Slot [30] registered [ 0.282029] acpiphp: Slot [31] registered [ 0.283000] PCI host bridge to bus 0000:00 [ 0.283000] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.289075] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.292034] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.293026] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 0.295021] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] [ 0.297051] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.298240] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.300150] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.302636] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 0.308000] pci 0000:00:01.1: reg 0x20: [io 0xc320-0xc32f] [ 0.311674] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.314015] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.315009] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.317010] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.319609] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 0.321643] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 0.325045] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 0.329095] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 [ 0.335020] pci 0000:00:02.0: reg 0x10: [io 0xc300-0xc31f] [ 0.347017] pci 0000:00:02.0: reg 0x20: [mem 0xe0000000000-0xe0000003fff 64bit pref] [ 0.352879] pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 0.357000] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 [ 0.369021] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] [ 0.380022] pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] [ 0.403014] pci 0000:00:05.0: reg 0x20: [mem 0xe0000004000-0xe0000007fff 64bit pref] [ 0.421479] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 [ 0.429029] pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] [ 0.446029] pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 0.463014] pci 0000:00:06.0: reg 0x20: [mem 0xe0000008000-0xe000000bfff 64bit pref] [ 0.479368] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 [ 0.488014] pci 0000:00:07.0: reg 0x10: [io 0xc100-0xc17f] [ 0.495013] pci 0000:00:07.0: reg 0x14: [mem 0xfebc2000-0xfebc2fff] [ 0.511020] pci 0000:00:07.0: reg 0x20: [mem 0xe000000c000-0xe000000ffff 64bit pref] [ 0.522169] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 [ 0.534017] pci 0000:00:08.0: reg 0x10: [io 0xc180-0xc1ff] [ 0.543020] pci 0000:00:08.0: reg 0x14: [mem 0xfebc3000-0xfebc3fff] [ 0.559089] pci 0000:00:08.0: reg 0x20: [mem 0xe0000010000-0xe0000013fff 64bit pref] [ 0.572000] pci 0000:00:09.0: [1af4:1001] type 00 class 0x010000 [ 0.581018] pci 0000:00:09.0: reg 0x10: [io 0xc200-0xc27f] [ 0.589016] pci 0000:00:09.0: reg 0x14: [mem 0xfebc4000-0xfebc4fff] [ 0.602020] pci 0000:00:09.0: reg 0x20: [mem 0xe0000014000-0xe0000017fff 64bit pref] [ 0.612099] pci 0000:00:0a.0: [1af4:1001] type 00 class 0x010000 [ 0.618016] pci 0000:00:0a.0: reg 0x10: [io 0xc280-0xc2ff] [ 0.623016] pci 0000:00:0a.0: reg 0x14: [mem 0xfebc5000-0xfebc5fff] [ 0.639026] pci 0000:00:0a.0: reg 0x20: [mem 0xe0000018000-0xe000001bfff 64bit pref] [ 0.653186] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 [ 0.655283] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 0.656288] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 [ 0.659286] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 0.660190] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 [ 0.665134] iommu: Default domain type: Passthrough [ 0.666572] SCSI subsystem initialized [ 0.668149] ACPI: bus type USB registered [ 0.669106] usbcore: registered new interface driver usbfs [ 0.672067] usbcore: registered new interface driver hub [ 0.674075] usbcore: registered new device driver usb [ 0.676165] pps_core: LinuxPPS API ver. 1 registered [ 0.678018] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 0.681190] PTP clock support registered [ 0.684201] EDAC MC: Ver: 3.0.0 [ 0.688107] PCI: Using ACPI for IRQ routing [ 0.691103] NetLabel: Initializing [ 0.692007] NetLabel: domain hash size = 128 [ 0.694010] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 0.696093] NetLabel: unlabeled traffic allowed by default [ 0.699278] vgaarb: loaded [ 0.701278] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 0.703010] hpet0: 3 comparators, 64-bit 100.000000 MHz counter [ 0.709528] clocksource: Switched to clocksource kvm-clock [ 0.828937] VFS: Disk quotas dquot_6.6.0 [ 0.830423] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 0.832787] *** VALIDATE ramfs *** [ 0.833860] *** VALIDATE hugetlbfs *** [ 0.835236] pnp: PnP ACPI init [ 0.837421] pnp: PnP ACPI: found 6 devices [ 0.853543] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 0.856700] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 0.858470] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 0.860432] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 0.862687] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 0.864855] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] [ 0.867527] NET: Registered protocol family 2 [ 0.869808] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, vmalloc) [ 0.874692] tcp_listen_portaddr_hash hash table entries: 4096 (order: 5, 163840 bytes, vmalloc) [ 0.877707] TCP established hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.882741] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc) [ 0.887811] TCP: Hash tables configured (established 65536 bind 65536) [ 0.890862] MPTCP token hash table entries: 8192 (order: 6, 393216 bytes, vmalloc) [ 0.912577] UDP hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.921945] UDP-Lite hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.926496] NET: Registered protocol family 1 [ 0.932677] RPC: Registered named UNIX socket transport module. [ 0.934562] RPC: Registered udp transport module. [ 0.936145] RPC: Registered tcp transport module. [ 0.937771] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 0.940886] NET: Registered protocol family 44 [ 0.942842] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 0.946597] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 0.948561] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 0.950822] PCI: CLS 0 bytes, default 64 [ 0.952342] Unpacking initramfs... [ 2.488939] debug: unmapping init [mem 0xffffa08e7cc54000-0xffffa08e7ffbffff] [ 2.496861] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 2.501864] software IO TLB: mapped [mem 0x00000000a8000000-0x00000000ac000000] (64MB) [ 2.510031] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x22983777dd9, max_idle_ns: 440795300422 ns [ 3.284173] Initialise system trusted keyrings [ 3.285222] Key type blacklist registered [ 3.287702] workingset: timestamp_bits=36 max_order=20 bucket_order=0 [ 3.315346] zbud: loaded [ 3.320362] *** VALIDATE nfs *** [ 3.324343] *** VALIDATE nfs4 *** [ 3.327877] pstore: using deflate compression [ 3.337455] Platform Keyring initialized [ 3.550805] NET: Registered protocol family 38 [ 3.555539] Key type asymmetric registered [ 3.557935] Asymmetric key parser 'x509' registered [ 3.561156] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 3.568256] io scheduler mq-deadline registered [ 3.570470] io scheduler kyber registered [ 3.574615] io scheduler bfq registered [ 3.579113] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 3.595634] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.602942] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 3.608989] ACPI: Power Button [PWRF] [ 3.618428] ACPI: \_SB_.LNKB: Enabled at IRQ 10 [ 3.632189] ACPI: \_SB_.LNKA: Enabled at IRQ 11 [ 3.666893] ACPI: \_SB_.LNKC: Enabled at IRQ 11 [ 3.684289] ACPI: \_SB_.LNKD: Enabled at IRQ 10 [ 3.730080] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 3.766395] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.798148] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.807898] Non-volatile memory driver v1.3 [ 3.809539] Linux agpgart interface v0.103 [ 3.852659] virtio_blk virtio1: [vda] 144832 512-byte logical blocks (74.2 MB/70.7 MiB) [ 3.858825] vda: detected capacity change from 0 to 74153984 [ 3.897786] virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) [ 3.901155] vdb: detected capacity change from 0 to 1073741824 [ 3.933472] virtio_blk virtio3: [vdc] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 3.944371] vdc: detected capacity change from 0 to 2621440000 [ 3.968997] virtio_blk virtio4: [vdd] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 3.972313] vdd: detected capacity change from 0 to 2621440000 [ 3.992735] virtio_blk virtio5: [vde] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 3.996165] vde: detected capacity change from 0 to 4294967296 [ 4.020626] virtio_blk virtio6: [vdf] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 4.026811] vdf: detected capacity change from 0 to 4294967296 [ 4.046773] libphy: Fixed MDIO Bus: probed [ 4.059414] usbcore: registered new interface driver usbserial_generic [ 4.063067] usbserial: USB Serial support registered for generic [ 4.066690] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 4.071634] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 4.073035] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 4.075538] mousedev: PS/2 mouse device common for all mice [ 4.078796] rtc_cmos 00:05: RTC can wake from S4 [ 4.081753] rtc_cmos 00:05: registered as rtc0 [ 4.083096] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 4.085515] intel_pstate: CPU model not supported [ 4.088716] hid: raw HID events driver (C) Jiri Kosina [ 4.090394] usbcore: registered new interface driver usbhid [ 4.092816] usbhid: USB HID core driver [ 4.094485] drop_monitor: Initializing network drop monitor service [ 4.097062] Initializing XFRM netlink socket [ 4.099412] NET: Registered protocol family 10 [ 4.101312] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 4.107218] Segment Routing with IPv6 [ 4.108919] NET: Registered protocol family 17 [ 4.111858] mpls_gso: MPLS GSO support [ 4.119121] RAS: Correctable Errors collector initialized. [ 4.122689] AVX version of gcm_enc/dec engaged. [ 4.124973] AES CTR mode by8 optimization enabled [ 4.126035] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 [ 4.155471] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 [ 4.251509] sched_clock: Marking stable (4251479947, 0)->(4999954407, -748474460) [ 4.255838] registered taskstats version 1 [ 4.258250] Loading compiled-in X.509 certificates [ 4.259804] zswap: loaded using pool lzo/zbud [ 4.290964] Key type big_key registered [ 4.310325] Key type encrypted registered [ 4.313347] ima: No TPM chip found, activating TPM-bypass! [ 4.317136] ima: Allocated hash algorithm: sha1 [ 4.319895] ima: No architecture policies found [ 4.324413] evm: Initialising EVM extended attributes: [ 4.326560] evm: security.selinux [ 4.327763] evm: security.ima [ 4.328891] evm: security.capability [ 4.329922] evm: HMAC attrs: 0x1 [ 4.334825] rtc_cmos 00:05: setting system clock to 2026-06-26 13:26:15 UTC (1782480375) [ 4.349909] debug: unmapping init [mem 0xffffffffa2203000-0xffffffffa23fffff] [ 4.353930] debug: unmapping init [mem 0xffffffffa0f82000-0xffffffffa1258fff] [ 4.362204] Write protecting the kernel read-only data: 28672k [ 4.366886] debug: unmapping init [mem 0xffffffff9f603000-0xffffffff9f7fffff] [ 4.372991] debug: unmapping init [mem 0xffffffff9ff14000-0xffffffff9fffffff] [ 4.425654] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 4.436287] systemd[1]: Detected virtualization kvm. [ 4.438322] systemd[1]: Detected architecture x86-64. [ 4.440226] systemd[1]: Running in initial RAM disk. Welcome to Rocky Linux 8.10 (Green Obsidian) dracut-049-233.git20240115.el8 (Initramfs)! [ 4.484115] systemd[1]: No hostname configured. [ 4.485901] systemd[1]: Set hostname to . [ 4.489102] random: systemd: uninitialized urandom read (16 bytes read) [ 4.492222] systemd[1]: Initializing machine ID from random generator. [ 4.724454] random: systemd: uninitialized urandom read (16 bytes read) [ 4.738934] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 4.751758] random: systemd: uninitialized urandom read (16 bytes read) [ 4.754949] systemd[1]: Reached target Swap. [ OK ] Reached target Swap. [ 4.767982] systemd[1]: Reached target Local File Systems. [ OK ] Reached target Local File Systems. [ OK ] Listening on Journal Socket (/dev/log). [ OK ] Reached target Slices. [ OK ] Listening on udev Control Socket. [ OK ] Listening on Journal Socket. [ OK ] Started Memstrack Anylazing Service. Starting Journal Service... Starting Create list of required st…ce nodes for the current kernel... [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Timers. [ OK ] Reached target Sockets. Starting Create Volatile Files and Directories... Starting Setup Virtual Console... [ OK ] Reached target Initrd Root Device. Starting Apply Kernel Variables... [ OK ] Reached target Paths. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Create Volatile Files and Directories. [ OK ] Started Setup Virtual Console. [ OK ] Started Apply Kernel Variables. Starting dracut cmdline hook... Starting Create Static Device Nodes in /dev... [ OK ] Started Journal Service. [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ 5.925827] device-mapper: uevent: version 1.0.3 [ 5.928639] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting dracut pre-trigger hook... [ OK ] Started dracut pre-trigger hook. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. [ OK ] Reached target System Initialization. [ OK ] Reached target Basic System. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. Starting dracut initqueue hook... [ 7.865436] random: fast init done [ 7.971470] virtio_net virtio0 ens2: renamed from eth0 [ 8.039581] scsi host0: ata_piix [ 8.067233] scsi host1: ata_piix [ 8.068611] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc320 irq 14 [ 8.074113] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc328 irq 15 [ 12.897504] random: crng init done [ 12.901063] random: 7 urandom warning(s) missed due to ratelimiting [ 15.089922] dracut-initqueue[584]: RTNETLINK answers: File exists Starting nbd nbd0... [ OK ] Started nbd nbd0. [ OK ] Started dracut initqueue hook. Mounting /sysroot... [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. [ 17.049101] EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Timers. Stopping Hardware RNG Entropy Gatherer Daemon... [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped Hardware RNG Entropy Gatherer Daemon. [ OK ] Stopped target Basic System. [ OK ] Stopped target Sockets. [ OK ] Stopped target Paths. [ OK ] Stopped target Slices. [ OK ] Stopped target System Initialization. [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped dracut pre-trigger hook. Stopping udev Kernel Device Manager... [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Local Encrypted Volumes. [ OK ] Stopped Dispatch Password Requests to Console Directory Watch. [ OK ] Stopped target Swap. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Reached target Switch Root. Starting Switch Root... [ 18.927568] printk: systemd: 25 output lines suppressed due to ratelimiting [ 19.491969] SELinux: Disabled at runtime. [ 19.599161] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 19.608172] systemd[1]: Detected virtualization kvm. [ 19.609921] systemd[1]: Detected architecture x86-64. Welcome to Rocky Linux 8.10 (Green Obsidian)! [ 20.370370] hrtimer: interrupt took 374978407 ns [ 21.290395] systemd[1]: initrd-switch-root.service: Succeeded. [ 21.294581] systemd[1]: Stopped Switch Root. [ OK ] Stopped Switch Root. [ 21.304279] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. [ 21.312286] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 21.316770] systemd[1]: Stopped Journal Service. [ OK ] Stopped Journal Service. [ 21.328271] systemd[1]: Starting Journal Service... Starting Journal Service... [ 21.336472] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ OK ] Started Forward Password Requests to Wall Directory Watch. Mounting Kernel Debug File System... [ OK ] Listening on Process Core Dump Socket. [ OK ] Reached target rpc_pipefs.target. [ OK ] Stopped target Switch Root. [ OK ] Created slice system-sshd\x2dkeygen.slice. [ OK ] Created slice User and Session Slice. [ OK ] Listening on udev Kernel Socket. [ OK ] Created slice system-getty.slice. [ OK ] Listening on initctl Compatibility Named Pipe. Activating swap /dev/disk/by-label/SWAP... Starting Remount Root and Kernel File Systems... [ OK ] Created slice system-serial\x2dgetty.slice. [ OK [0[ 21.670425] Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS m] Stopped target Initrd Root File System. [ OK ] Listening on udev Control Socket. Starting Apply Kernel Variables... [FAILED] Failed to set up automount Arbitrar…rmats File System Automount Point. See 'systemctl status proc-sys-fs-binfmt_misc.automount' for details. Starting Create list of required st…ce nodes for the current kernel... Mounting Huge Pages File System... [ OK ] Stopped target Initrd File Systems. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Reached target Paths. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Slices. Mounting POSIX Message Queue File System... [ OK ] Reached target RPC Port Mapper. Starting udev Coldplug all Devices... [ OK ] Started Journal Service. [ OK ] Mounted Kernel Debug File System. [ OK ] Activated swap /dev/disk/by-label/SWAP. [FAILED] Failed to start Remount Root and Kernel File Systems. See 'systemctl status systemd-remount-fs.service' for details. [ OK ] Started Apply Kernel Variables. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. Starting Create Static Device Nodes in /dev... Starting Configure read-only root support... [ OK ] Reached target Swap. Starting Flush Journal to Persistent Storage... [ OK ] Started udev Coldplug all Devices. [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started Create Static Device Nodes in /dev. Starting udev Kernel Device Manager... [ OK ] Reached target Local File Systems (Pre). Mounting /mnt... Mounting /home/green/git/lustre-release... [ OK ] Mounted /mnt. [ 23.269799] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ OK ] Mounted /home/green/git/lustre-release. [ OK ] Started udev Kernel Device Manager. [ 24.014492] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 24.116288] input: PC Speaker as /devices/platform/pcspkr/input/input5 [ 25.488903] RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer [ 25.725108] EDAC sbridge: Ver: 1.1.2 [* ] A start job is running for Configur…-only root support (7s / no limit) [** ] A start job is running for Configur…-only root support (8s / no limit)[ 29.667635] Key type dns_resolver registered [*** ] A start job is running for Configur…-only root support (8s / no limit)[ 30.194358] NFS: Registering the id_resolver key type [ 30.199935] Key type id_resolver registered [ 30.204124] Key type id_legacy registered [ *** ] A start job is running for Configur…-only root support (9s / no limit) [ *** ] A start job is running for Configur…-only root support (9s / no limit) [ OK ] Started Configure read-only root support. [ OK ] Reached target Local File Systems. Starting Mark the need to relabel after reboot... Starting Rebuild Dynamic Linker Cache... Starting Create Volatile Files and Directories... Starting Load/Save Random Seed... [ OK ] Started Mark the need to relabel after reboot. [ OK ] Started Load/Save Random Seed. [ OK ] Started Create Volatile Files and Directories. Starting RPC Bind... Starting Update UTMP about System Boot/Shutdown... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Started RPC Bind. [ OK ] Started Rebuild Dynamic Linker Cache. Starting Update is Completed... [ OK ] Started Update is Completed. [ OK ] Reached target System Initialization. [ OK ] Started dnf makecache --timer. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. [ OK ] Started D-Bus System Message Bus. Starting Restore /run/initramfs on shutdown... [ OK ] Reached target sshd-keygen.target. Starting Network Manager... [ OK ] Started irqbalance daemon. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. Starting Login Service... [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Reached target Timers. [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting Dynamic System Tuning Daemon... Starting OpenSSH server daemon... Starting GSSAPI Proxy Daemon... Starting Network Manager Wait Online... Starting Hostname Service... [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Started Permit User Sessions. [ OK ] Started Getty on tty1. [ OK ] Started Serial Getty on ttyS1. [ OK ] Started Serial Getty on ttyS0. [ OK ] Reached target Login Prompts. [ OK ] Started Command Scheduler. [ OK ] Started Login Service. [ OK ] Started OpenSSH server daemon. [ OK ] Started Hostname Service. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting System Logging Service... Starting Notify NFS peers of a restart... Starting Crash recovery kernel arming... [ OK ] Started Notify NFS peers of a restart. [ OK ] Started System Logging Service. Rocky Linux 8.10 (Green Obsidian) Kernel 4.18.0rh8.10-debug on an x86_64 oleg425-server login: [ 123.421681] libcfs: loading out-of-tree module taints kernel. [ 123.617179] Key type ._llcrypt registered [ 123.619835] Key type .llcrypt registered [ 123.899432] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_hostid [ 151.581848] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 153.656835] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 153.675742] alg: No test for adler32 (adler32-zlib) [ 155.257134] Lustre: Lustre: Build Version: 2.17.54_95_ga6f956b [ 156.274615] LNet: Added LNI 192.168.204.125@tcp [8/256/0/180] [ 158.127320] Key type lgssc registered [ 160.076981] Lustre: Echo OBD driver; http://www.lustre.org/ [ 177.220500] ZFS: Loaded module v2.3.2-1, ZFS pool version 5000, ZFS filesystem version 5 [ 214.437467] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 227.691337] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 227.733374] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 228.971598] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 228.998550] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 229.098125] Lustre: lustre-MDT0000: new disk, initializing [ 229.166066] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 229.186150] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 233.834370] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 248.806833] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 248.996983] Lustre: 6520:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 249.061262] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 249.068573] Lustre: Skipped 1 previous similar message [ 249.223142] Lustre: lustre-MDT0001: new disk, initializing [ 249.325844] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 249.394853] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 249.440392] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 255.365445] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 260.301234] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 271.308308] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 271.571156] Lustre: lustre-OST0000: new disk, initializing [ 271.574522] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 271.580679] Lustre: 8460:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 271.625978] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 271.786249] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 271.797366] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 271.894301] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 276.968641] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 292.386193] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 292.559032] Lustre: lustre-OST0001: new disk, initializing [ 292.565737] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 292.575526] Lustre: 9534:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 292.649463] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 299.775841] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 301.602725] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 301.610788] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 301.668527] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 311.769412] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 322.872829] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 329.109661] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing check_logdir /tmp/testlogs/ [ 334.168819] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing yml_node [ 340.406841] Lustre: DEBUG MARKER: Client: 2.17.54.95 [ 344.110982] Lustre: DEBUG MARKER: MDS: 2.17.54.95 [ 346.921829] Lustre: DEBUG MARKER: OSS: 2.17.54.95 [ 348.876622] Lustre: DEBUG MARKER: -----============= acceptance-small: conf-sanity ============----- Fri Jun 26 09:31:58 EDT 2026 [ 368.552785] Lustre: DEBUG MARKER: excepting tests: 102 106 115 32newtarball [ 370.582592] Lustre: DEBUG MARKER: skipping tests SLOW=no: 45 69 106 111 114 [ 388.576329] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 388.581153] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 388.595716] Lustre: Skipped 3 previous similar messages [ 388.624399] Lustre: Skipped 3 previous similar messages [ 393.699314] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 393.712191] Lustre: Skipped 3 previous similar messages [ 394.243810] Lustre: server umount lustre-MDT0000 complete [ 398.593417] LustreError: 6513:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782480769 with bad export cookie 15248848993104556570 [ 398.613900] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 398.626481] LustreError: 6513:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 398.818490] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 398.821172] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 398.855044] Lustre: Skipped 1 previous similar message [ 398.895082] Lustre: Skipped 1 previous similar message [ 403.936607] LustreError: 11698:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 403.938611] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 403.976050] Lustre: Skipped 1 previous similar message [ 403.976270] LustreError: 11698:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 4 previous similar messages [ 405.050657] Lustre: server umount lustre-MDT0001 complete [ 409.510206] Lustre: server umount lustre-OST0000 complete [ 413.809847] Lustre: server umount lustre-OST0001 complete [ 419.756657] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_hostid [ 429.311563] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 467.670532] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 467.873849] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 467.902945] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 467.966697] Lustre: lustre-MDT0000: new disk, initializing [ 468.032946] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 468.054073] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 472.688218] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 483.525486] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 483.649549] Lustre: 15088:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 483.748941] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 483.757564] Lustre: Skipped 1 previous similar message [ 483.831719] Lustre: lustre-MDT0001: new disk, initializing [ 483.945537] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 483.979056] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 483.995710] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 488.691517] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 497.971127] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 503.722969] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 510.145226] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 510.402379] Lustre: lustre-OST0000: new disk, initializing [ 510.406328] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 510.416524] Lustre: 17056:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 510.496973] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 512.266335] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 512.279801] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 512.398236] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 516.534389] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 525.520704] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 530.784770] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 531.091347] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 535.704938] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 535.941932] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 538.082180] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 538.088428] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 538.099227] LustreError: Skipped 1 previous similar message [ 538.101863] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 538.116192] Lustre: Skipped 1 previous similar message [ 538.132130] Lustre: Skipped 1 previous similar message [ 543.908771] Lustre: server umount lustre-OST0000 complete [ 548.323459] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 548.346847] Lustre: Skipped 1 previous similar message [ 548.348316] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 548.368482] Lustre: Skipped 3 previous similar messages [ 554.260647] Lustre: server umount lustre-MDT0000 complete [ 558.043745] LustreError: 15079:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782480929 with bad export cookie 15248848993104558103 [ 558.049017] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 558.053098] LustreError: 15079:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 558.356911] Lustre: server umount lustre-MDT0001 complete [ 563.171668] Lustre: DEBUG MARKER: == conf-sanity test 76a: set permanent params with lctl across mounts ========================================================== 09:35:33 (1782480933) [ 569.899861] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 570.427221] LustreError: 19324:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 570.506270] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 574.731863] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 575.973731] LustreError: 19325:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 580.068432] LustreError: 19324:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 583.828503] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 589.399772] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 596.745323] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 602.324930] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 608.853832] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 615.395634] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 622.628645] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 626.030141] Lustre: Modifying parameter general.osc.*.max_dirty_mb=452 in log params [ 635.372384] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 635.385948] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 635.405722] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 635.412457] Lustre: Skipped 2 previous similar messages [ 637.636794] Lustre: server umount lustre-MDT0000 complete [ 640.993828] LustreError: 21509:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 641.015348] LustreError: 21509:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 641.545226] LustreError: 20059:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782481012 with bad export cookie 15248848993104558985 [ 641.565953] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 641.881457] Lustre: server umount lustre-MDT0001 complete [ 655.266443] Lustre: server umount lustre-OST0000 complete [ 675.716586] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 686.025682] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 686.387538] LustreError: 23706:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 686.463471] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 686.468021] Lustre: Skipped 2 previous similar messages [ 691.026885] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 700.143829] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 705.678550] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 708.732885] Lustre: Setting parameter general.debug_raw_pointers=Y in log params [ 715.697175] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 723.166846] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 732.382633] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 732.536550] Lustre: lustre-OST0001: new disk, initializing [ 732.545069] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 732.550834] Lustre: 26022:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 733.812233] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 733.822996] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 733.996195] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 739.635800] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 749.249762] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 752.794135] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 767.463657] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 767.474087] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 767.487925] Lustre: Skipped 2 previous similar messages [ 767.493917] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 767.498919] Lustre: Skipped 2 previous similar messages [ 772.325662] Lustre: server umount lustre-MDT0000 complete [ 775.146139] LustreError: 24437:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 775.169721] LustreError: 24437:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 5 previous similar messages [ 775.893345] LustreError: 23687:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782481147 with bad export cookie 15248848993104559832 [ 775.897522] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 775.901065] LustreError: 23687:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 8 previous similar messages [ 776.169692] Lustre: server umount lustre-MDT0001 complete [ 790.576496] Lustre: server umount lustre-OST0000 complete [ 804.633573] Lustre: server umount lustre-OST0001 complete [ 821.266849] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 831.735726] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 832.152021] LustreError: 29043:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 832.301898] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 832.306339] Lustre: Skipped 3 previous similar messages [ 837.633244] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 846.935264] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 852.355491] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 855.439339] Lustre: 30190:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 861.990823] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 869.563315] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 878.538732] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 885.227626] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 893.189541] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 897.426670] Lustre: 32065:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 903.665324] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 903.685697] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 903.702650] Lustre: Skipped 3 previous similar messages [ 903.707760] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 903.710585] Lustre: Skipped 4 previous similar messages [ 909.847187] LustreError: 29777:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 909.877956] LustreError: 29777:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 8 previous similar messages [ 909.935211] Lustre: server umount lustre-MDT0000 complete [ 913.766733] LustreError: 29025:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782481284 with bad export cookie 15248848993104561127 [ 913.800534] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 914.240452] Lustre: server umount lustre-MDT0001 complete [ 928.164540] Lustre: server umount lustre-OST0000 complete [ 931.296466] Lustre: 3656:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782481286/real 1782481286] req@ffffa08dc323dc00 x1869066301371520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782481302 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 932.401656] Lustre: server umount lustre-OST0001 complete [ 942.404164] Lustre: DEBUG MARKER: == conf-sanity test 76b: verify params log setup correctly ========================================================== 09:41:52 (1782481312) [ 974.559501] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 984.875204] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 989.807859] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 999.176277] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1004.627726] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1007.588878] Lustre: 36022:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 1013.942681] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1020.622412] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1028.572355] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1035.929890] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1043.595533] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1047.061089] Lustre: 37905:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 1055.718784] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1055.735264] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1055.746084] Lustre: Skipped 7 previous similar messages [ 1055.764568] Lustre: Skipped 7 previous similar messages [ 1058.123804] Lustre: server umount lustre-MDT0000 complete [ 1060.845182] LustreError: 34874:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1060.859451] LustreError: 34874:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 7 previous similar messages [ 1062.467465] LustreError: 34854:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782481433 with bad export cookie 15248848993104562233 [ 1062.475670] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1062.487774] LustreError: 34854:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 7 previous similar messages [ 1062.756369] Lustre: server umount lustre-MDT0001 complete [ 1076.861120] Lustre: server umount lustre-OST0000 complete [ 1090.787691] Lustre: server umount lustre-OST0001 complete [ 1099.134403] Lustre: DEBUG MARKER: == conf-sanity test 76c: verify changelog_mask is applied with lctl set_param -P ========================================================== 09:44:29 (1782481469) [ 1113.411734] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 1122.953138] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1123.521775] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1123.528304] Lustre: Skipped 7 previous similar messages [ 1127.845447] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1134.355138] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1138.176198] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1140.810247] Lustre: 41196:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 1146.748831] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1152.944586] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1161.221355] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1167.212458] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1174.046228] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1177.025868] Lustre: 43072:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 1177.817721] Lustre: Setting parameter general.mdd.*.changelog_mask=-CLOSE in log params [ 1177.823079] Lustre: Skipped 1 previous similar message [ 1180.647727] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1180.658039] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1186.535179] Lustre: server umount lustre-MDT0000 complete [ 1189.406586] LustreError: 40027:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782481560 with bad export cookie 15248848993104563339 [ 1189.413409] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1189.416545] LustreError: 40027:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 1195.844269] Lustre: server umount lustre-MDT0001 complete [ 1203.477311] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1219.144633] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1224.620775] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 1226.869677] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1231.748841] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1232.876680] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 1232.888343] Lustre: Skipped 1 previous similar message [ 1237.914670] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1239.459839] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 1244.110850] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1245.443302] Lustre: DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec [ 1252.832226] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1255.419734] Lustre: server umount lustre-MDT0000 complete [ 1258.365429] LustreError: 40029:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782481629 with bad export cookie 15248848993104564466 [ 1258.373484] LustreError: 40029:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 1258.374052] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1258.638228] Lustre: server umount lustre-MDT0001 complete [ 1268.094403] Lustre: server umount lustre-OST0000 complete [ 1271.381688] Lustre: server umount lustre-OST0001 complete [ 1278.391778] Lustre: DEBUG MARKER: == conf-sanity test 76d: verify llite.*.xattr_cache can be set by 'lctl set_param -P' correctly ========================================================== 09:47:28 (1782481648) [ 1291.282151] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 1300.056765] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1304.199630] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1310.704511] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1314.192531] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1316.350125] Lustre: 48827:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 1321.145317] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1321.445512] LustreError: 49181:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1321.470109] LustreError: 49181:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 33 previous similar messages [ 1325.826828] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1332.598446] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1338.098927] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1344.441529] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1348.204672] Lustre: Setting parameter general.llite.*.xattr_cache=0 in log params [ 1358.820981] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1358.824958] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1358.831063] Lustre: Skipped 14 previous similar messages [ 1358.837453] Lustre: Skipped 22 previous similar messages [ 1360.121583] Lustre: server umount lustre-MDT0000 complete [ 1362.876678] LustreError: 48829:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782481734 with bad export cookie 15248848993104565257 [ 1362.885167] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1362.885903] LustreError: 48829:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 1363.141518] Lustre: server umount lustre-MDT0001 complete [ 1375.103532] Lustre: server umount lustre-OST0000 complete [ 1387.190143] Lustre: server umount lustre-OST0001 complete [ 1394.550258] Lustre: DEBUG MARKER: == conf-sanity test 77: comma-separated MGS NIDs and failover node NIDs ========================================================== 09:49:24 (1782481764) [ 1396.354745] Lustre: DEBUG MARKER: SKIP: conf-sanity test_77 mixed loopback and real device not working [ 1397.647833] Lustre: DEBUG MARKER: == conf-sanity test 78: run resize2fs on MDT and OST filesystems ========================================================== 09:49:28 (1782481768) [ 1405.804644] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_hostid [ 1412.082786] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 1428.933968] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1429.143296] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1429.191974] Lustre: lustre-MDT0000: new disk, initializing [ 1429.265502] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1432.309604] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1439.486484] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1444.819142] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1445.048326] Lustre: lustre-OST0000: new disk, initializing [ 1445.051391] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1445.053941] Lustre: Skipped 1 previous similar message [ 1445.057422] Lustre: 54898:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1446.450155] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 1446.462690] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 1446.485265] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 1449.644992] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1456.375825] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1457.947701] Lustre: DEBUG MARKER: create test files [ 1482.212364] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1486.444412] Lustre: server umount lustre-OST0000 complete [ 1489.127557] Lustre: server umount lustre-MDT0000 complete [ 1497.000835] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing unload_modules_local [ 1499.618857] Key type lgssc unregistered [ 1499.871753] LNet: 56525:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1499.883109] LNetError: 56525:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1499.902191] LNet: Removed LNI 192.168.204.125@tcp [ 1500.844337] Key type .llcrypt unregistered [ 1500.847199] Key type ._llcrypt unregistered [ 1522.023282] Key type ._llcrypt registered [ 1522.027147] Key type .llcrypt registered [ 1522.110412] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 1522.984431] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1523.009676] alg: No test for adler32 (adler32-zlib) [ 1523.983639] Lustre: Lustre: Build Version: 2.17.54_95_ga6f956b [ 1524.177406] LNet: Added LNI 192.168.204.125@tcp [8/256/0/180] [ 1525.807194] Key type lgssc registered [ 1526.660733] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1532.397635] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1532.418146] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1533.781930] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1537.216272] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1542.276563] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1546.842258] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1547.087881] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1551.195796] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1556.035481] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1558.384375] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:99 to 0x240000400:129) [ 1558.451224] Lustre: 59902:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 510 < left 544, rollback = 9 [ 1558.456632] Lustre: 59902:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 32/128/5, destroy: 0/0/0 [ 1558.460679] Lustre: 59902:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 1558.463475] Lustre: 59902:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/18/1, punch: 0/0/0, quota 1/3/0 [ 1558.467185] Lustre: 59902:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 1558.471222] Lustre: 59902:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 1565.105265] Lustre: DEBUG MARKER: check files after expanding the MDT and OST filesystems [ 1568.846858] Lustre: DEBUG MARKER: create more files after expanding the MDT and OST filesystems [ 1573.857174] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1573.859573] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1573.874171] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1578.977485] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1579.411439] Lustre: server umount lustre-OST0000 complete [ 1581.808560] Lustre: server umount lustre-MDT0000 complete [ 1587.935364] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing unload_modules_local [ 1589.788640] Key type lgssc unregistered [ 1589.982681] LNet: 60848:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1589.987163] LNetError: 60848:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1589.999143] LNet: Removed LNI 192.168.204.125@tcp [ 1590.522737] Key type .llcrypt unregistered [ 1590.525233] Key type ._llcrypt unregistered [ 1610.071590] Key type ._llcrypt registered [ 1610.073708] Key type .llcrypt registered [ 1610.151414] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 1610.986763] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1611.003419] alg: No test for adler32 (adler32-zlib) [ 1611.986344] Lustre: Lustre: Build Version: 2.17.54_95_ga6f956b [ 1612.159439] LNet: Added LNI 192.168.204.125@tcp [8/256/0/180] [ 1613.783284] Key type lgssc registered [ 1614.558483] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1619.604592] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1619.619257] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1620.917747] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1623.651682] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1628.152916] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1632.378698] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1632.591389] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1636.157969] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1640.653389] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1645.864148] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:140 to 0x240000400:161) [ 1645.900444] Lustre: 63662:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 509 < left 544, rollback = 9 [ 1645.906799] Lustre: 63662:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 32/128/6, destroy: 0/0/0 [ 1645.910210] Lustre: 63662:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 1645.914290] Lustre: 63662:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/18/1, punch: 0/0/0, quota 1/3/0 [ 1645.917987] Lustre: 63662:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 1645.921858] Lustre: 63662:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 1649.867930] Lustre: DEBUG MARKER: check files after shrinking the MDT and OST filesystems [ 1687.015206] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1687.015522] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1687.028907] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1690.875407] Lustre: server umount lustre-OST0000 complete [ 1693.267553] Lustre: server umount lustre-MDT0000 complete [ 1699.403613] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing unload_modules_local [ 1701.172976] Key type lgssc unregistered [ 1701.361958] LNet: 65245:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1701.367189] LNetError: 65245:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1701.375828] LNet: Removed LNI 192.168.204.125@tcp [ 1701.884687] Key type .llcrypt unregistered [ 1701.887988] Key type ._llcrypt unregistered [ 1713.555152] Key type ._llcrypt registered [ 1713.557779] Key type .llcrypt registered [ 1713.643829] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_hostid [ 1723.900990] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 1724.541498] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1724.614309] alg: No test for adler32 (adler32-zlib) [ 1725.559436] Lustre: Lustre: Build Version: 2.17.54_95_ga6f956b [ 1725.737516] LNet: Added LNI 192.168.204.125@tcp [8/256/0/180] [ 1727.367191] Key type lgssc registered [ 1728.085773] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1750.222222] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1750.246666] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1751.371863] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1751.394922] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1751.441427] Lustre: lustre-MDT0000: new disk, initializing [ 1751.486890] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1751.497587] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1754.398753] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1761.532195] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1761.605123] Lustre: 68372:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1761.662405] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 1761.668755] Lustre: Skipped 1 previous similar message [ 1761.743194] Lustre: lustre-MDT0001: new disk, initializing [ 1761.811588] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1761.842477] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 1761.854704] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1764.604525] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1770.838921] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1774.632185] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1779.456208] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1779.705858] Lustre: lustre-OST0000: new disk, initializing [ 1779.710334] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1779.716472] Lustre: 70341:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1779.808720] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1784.159872] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1787.451189] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 1787.461164] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1787.549458] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1791.272169] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1794.375741] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1794.524297] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1796.989736] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1797.134757] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1803.234965] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1803.237665] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1803.244693] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1803.251913] LustreError: Skipped 1 previous similar message [ 1803.257107] Lustre: Skipped 1 previous similar message [ 1804.427844] Lustre: server umount lustre-OST0000 complete [ 1807.841651] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1807.845656] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1807.851545] Lustre: Skipped 1 previous similar message [ 1807.854120] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1813.289291] Lustre: server umount lustre-MDT0000 complete [ 1815.767157] LustreError: 68364:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782482186 with bad export cookie 17370059680731707634 [ 1815.772069] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1815.777408] LustreError: 68364:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 1816.059957] Lustre: server umount lustre-MDT0001 complete [ 1821.298714] Lustre: DEBUG MARKER: == conf-sanity test 79: format MDT/OST without mgs option (should return errors) ========================================================== 09:56:31 (1782482191) [ 1827.399454] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 1854.595455] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_hostid [ 1860.952697] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 1885.373685] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1885.585864] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1885.614798] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1885.686438] Lustre: lustre-MDT0000: new disk, initializing [ 1885.747276] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1885.763136] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1888.855482] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1895.762407] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1895.841465] Lustre: 76352:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1895.887266] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 1895.890728] Lustre: Skipped 1 previous similar message [ 1895.941988] Lustre: lustre-MDT0001: new disk, initializing [ 1896.007916] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1896.031983] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 1896.050714] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1899.455259] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1906.282781] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1909.758972] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1914.085556] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1914.278385] Lustre: lustre-OST0000: new disk, initializing [ 1914.281690] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1914.285941] Lustre: 78318:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1914.337808] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1918.496084] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1923.620318] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 1923.630262] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1923.698393] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1925.056421] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1928.510835] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1928.664592] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1931.998789] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1932.162331] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1933.793701] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1933.805547] Lustre: Skipped 1 previous similar message [ 1933.811912] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1933.822599] Lustre: Skipped 2 previous similar messages [ 1938.916636] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1938.923058] Lustre: Skipped 1 previous similar message [ 1939.675763] Lustre: server umount lustre-OST0000 complete [ 1944.035552] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1944.040479] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1944.042152] Lustre: Skipped 2 previous similar messages [ 1944.046536] Lustre: Skipped 1 previous similar message [ 1949.153383] LustreError: 76365:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1949.168987] LustreError: 76365:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 4 previous similar messages [ 1950.753363] Lustre: server umount lustre-MDT0000 complete [ 1953.570317] LustreError: 76345:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782482324 with bad export cookie 17370059680731708516 [ 1953.572954] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1953.579506] LustreError: 76345:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 1953.882269] Lustre: server umount lustre-MDT0001 complete [ 1960.196263] Lustre: DEBUG MARKER: == conf-sanity test 80: mgc import reconnect race ======== 09:58:50 (1782482330) [ 1964.602668] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1964.887305] LustreError: 80728:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1964.937946] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1967.986555] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1970.145793] LustreError: 80729:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1974.448928] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1978.448670] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 1984.200956] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1988.882960] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1993.535243] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1997.980722] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 2003.519878] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2006.193618] Lustre: 83398:0:(genops.c:1795:obd_export_evict_by_uuid()) MGS: evicting aaa729d2-b614-42d0-bcc9-a1ba676c66ae at adminstrative request [ 2009.064151] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2009.084081] Lustre: *** cfs_fail_loc=906, val=2147483648*** [ 2019.301456] Lustre: MGS: Client aaa729d2-b614-42d0-bcc9-a1ba676c66ae (at 0@lo) reconnecting [ 2019.314106] Lustre: Evicted from MGS (at 0@lo) after server handle changed from 0xf10ed93fc5593fd6 to 0xf10ed93fc559426f [ 2019.329620] Lustre: MGC192.168.204.125@tcp: Connection restored to 0@lo (at 0@lo) [ 2041.184223] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2041.325735] Lustre: lustre-OST0001: new disk, initializing [ 2041.329346] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 2041.334353] Lustre: 83794:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2041.396193] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 2041.405558] Lustre: Skipped 2 previous similar messages [ 2046.126583] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 2051.172048] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 2051.183865] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 2051.253959] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 2053.037309] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 2056.674897] Lustre: lustre-OST0001-osc-MDT0001: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2056.677956] LustreError: lustre-OST0001-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2056.679848] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 2056.679859] Lustre: Skipped 1 previous similar message [ 2056.686621] Lustre: Skipped 1 previous similar message [ 2056.691126] LustreError: Skipped 1 previous similar message [ 2061.156561] Lustre: server umount lustre-OST0001 complete [ 2061.797345] LustreError: 82551:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2061.814829] LustreError: 82551:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 2065.376122] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2065.386414] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2066.918615] LustreError: 82550:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2066.941820] LustreError: 82550:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 2077.160588] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2077.161144] LustreError: 82551:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2077.164707] Lustre: Skipped 7 previous similar messages [ 2077.176116] LustreError: 82551:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 2078.175715] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2078.281580] Lustre: server umount lustre-OST0000 complete [ 2082.275633] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2082.275716] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2082.280969] LustreError: Skipped 1 previous similar message [ 2082.290541] Lustre: Skipped 2 previous similar messages [ 2087.208709] Lustre: server umount lustre-MDT0000 complete [ 2089.757103] LustreError: 81463:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782482460 with bad export cookie 17370059680731710063 [ 2089.766225] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2089.770160] LustreError: 81463:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2090.022845] Lustre: server umount lustre-MDT0001 complete [ 2095.576086] Lustre: DEBUG MARKER: == conf-sanity test 81: sparse OST indexing ============== 10:01:06 (1782482466) [ 2096.658867] Lustre: DEBUG MARKER: SKIP: conf-sanity test_81 needs >= 3 OSTs [ 2097.757298] Lustre: DEBUG MARKER: == conf-sanity test 82a: specify OSTs for file (succeed) or directory (succeed) ========================================================== 10:01:08 (1782482468) [ 2098.856282] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82a needs >= 3 OSTs [ 2099.951829] Lustre: DEBUG MARKER: == conf-sanity test 82b: specify OSTs for file with --pool and --ost-list options ========================================================== 10:01:10 (1782482470) [ 2100.967292] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82b needs >= 4 OSTs [ 2102.189225] Lustre: DEBUG MARKER: == conf-sanity test 82c: specify sparse OSTs for setstripe (should not crash) ========================================================== 10:01:12 (1782482472) [ 2103.135596] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82c needs >= 4 OSTs [ 2104.184688] Lustre: DEBUG MARKER: == conf-sanity test 83: ENOSPACE on OST doesn't cause message VFS: Busy inodes after unmount ... ========================================================== 10:01:14 (1782482474) [ 2105.065786] Lustre: DEBUG MARKER: mount the OST /dev/mapper/ost1_flakey as a ldiskfs filesystem [ 2108.879480] loop: module loaded [ 2108.888134] loop0: detected capacity change from 0 to 4294967296 [ 2108.948943] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 2110.004423] Lustre: DEBUG MARKER: run llverfs in partial mode on the OST ldiskfs /mnt/lustre-ost1 [ 2112.062433] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing run_llverfs /mnt/lustre-ost1 -vpl no [ 2114.699571] Lustre: DEBUG MARKER: unmount the OST /dev/mapper/ost1_flakey [ 2132.149056] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2132.191952] LustreError: 87925:0:(obd_config.c:845:class_setup()) setup lustre-OST0000-osd failed (-28) [ 2132.200350] LustreError: 87925:0:(obd_mount.c:250:lustre_start_simple()) lustre-OST0000-osd setup error -28 [ 2132.212528] LustreError: 87925:0:(tgt_mount.c:2579:server_fill_super()) Unable to start osd on /dev/mapper/ost1_flakey: -28 [ 2132.215922] LustreError: 87925:0:(super25.c:184:lustre_fill_super()) llite: Unable to mount : rc = -28 [ 2144.979725] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_hostid [ 2150.980680] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 2173.510560] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2173.662452] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2173.687108] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2173.737476] Lustre: lustre-MDT0000: new disk, initializing [ 2173.787774] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2173.813339] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2176.996515] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 2184.120240] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2184.189458] Lustre: 90788:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2184.407449] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2187.085846] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 2192.967143] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2196.402375] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2200.655801] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2200.845329] Lustre: 92752:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2204.792264] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 2207.275808] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2207.382839] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2211.945243] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2214.837455] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2214.962398] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2217.681655] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2217.856247] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2222.560844] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2222.568165] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2222.581077] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2222.584142] Lustre: Skipped 2 previous similar messages [ 2225.409813] Lustre: server umount lustre-OST0000 complete [ 2234.422281] Lustre: server umount lustre-MDT0000 complete [ 2237.215358] LustreError: 90780:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782482608 with bad export cookie 17370059680731710686 [ 2237.216534] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2237.227328] LustreError: 90780:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2237.489210] Lustre: server umount lustre-MDT0001 complete [ 2243.434963] Lustre: DEBUG MARKER: == conf-sanity test 84: check recovery_hard_time ========= 10:03:33 (1782482613) [ 2248.533702] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2248.927282] LustreError: 95166:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2248.947621] LustreError: 95166:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 2252.388262] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 2259.337938] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2263.300138] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 2269.071053] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2273.455352] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2278.929275] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2284.062581] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 2289.540640] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2292.746522] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2295.037494] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 2 sec [ 2298.033411] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2298.191502] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2303.748572] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2303.916607] Lustre: lustre-OST0001: new disk, initializing [ 2303.919383] Lustre: Skipped 2 previous similar messages [ 2303.923148] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 2303.926994] Lustre: Skipped 3 previous similar messages [ 2303.931220] Lustre: 98550:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2304.016532] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 2304.022025] Lustre: Skipped 5 previous similar messages [ 2309.154425] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 2313.302158] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 2313.309705] Lustre: Skipped 2 previous similar messages [ 2313.316551] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 2313.375973] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 2316.987690] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 2320.937967] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid 50 [ 2321.141618] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2325.106829] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [ 2325.320487] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2341.568900] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 2364.502143] Lustre: Failing over lustre-MDT0000 [ 2364.872841] Lustre: server umount lustre-MDT0000 complete [ 2364.907868] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2364.908789] LustreError: 98556:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2364.922396] Lustre: Skipped 4 previous similar messages [ 2364.951628] LustreError: 98556:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 5 previous similar messages [ 2385.410174] LDISKFS-fs (dm-0): 4 truncates cleaned up [ 2385.414749] LDISKFS-fs (dm-0): recovery complete [ 2385.420664] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2385.493596] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2385.702493] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 2388.771177] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 2388.771294] Lustre: 95163:0:(ldlm_lib.c:2071:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 2388.920939] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 2391.017990] Lustre: 95166:0:(ldlm_lib.c:2071:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 2391.025311] Lustre: 95166:0:(ldlm_lib.c:2071:extend_recovery_timer()) Skipped 1 previous similar message [ 2391.032417] Lustre: lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 2391.083384] LustreError: 101399:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2391.407135] LustreError: 101399:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2391.732555] LustreError: 101399:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2391.737193] LustreError: 101399:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 1 previous similar message [ 2392.055703] LustreError: 101399:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2392.062855] LustreError: 101399:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 1 previous similar message [ 2392.070746] Lustre: 101399:0:(ldlm_lib.c:2071:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2392.078300] Lustre: 101399:0:(ldlm_lib.c:2071:extend_recovery_timer()) Skipped 7 previous similar messages [ 2393.026867] LustreError: 101399:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2393.033477] LustreError: 101399:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 3 previous similar messages [ 2393.352023] LustreError: 101399:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2393.358107] LustreError: 101399:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 3 previous similar messages [ 2394.306871] Lustre: 101399:0:(ldlm_lib.c:2071:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2394.319257] Lustre: 101399:0:(ldlm_lib.c:2071:extend_recovery_timer()) Skipped 6 previous similar messages [ 2395.273989] LustreError: 101399:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2395.287311] LustreError: 101399:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 6 previous similar messages [ 2395.607128] LustreError: 101399:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2395.613305] LustreError: 101399:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 6 previous similar messages [ 2398.464066] Lustre: 101399:0:(ldlm_lib.c:2071:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2398.469842] Lustre: 101399:0:(ldlm_lib.c:2071:extend_recovery_timer()) Skipped 12 previous similar messages [ 2399.426733] LustreError: 101399:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2399.434115] LustreError: 101399:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 12 previous similar messages [ 2399.759134] LustreError: 101399:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2399.770162] LustreError: 101399:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 12 previous similar messages [ 2406.752065] Lustre: 101399:0:(ldlm_lib.c:2071:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2406.769554] Lustre: 101399:0:(ldlm_lib.c:2071:extend_recovery_timer()) Skipped 25 previous similar messages [ 2407.724742] LustreError: 101399:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2407.730042] LustreError: 101399:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 25 previous similar messages [ 2408.058641] LustreError: 101399:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2408.062728] LustreError: 101399:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 25 previous similar messages [ 2422.872196] Lustre: 101399:0:(ldlm_lib.c:2071:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2422.883818] Lustre: 101399:0:(ldlm_lib.c:2071:extend_recovery_timer()) Skipped 50 previous similar messages [ 2423.840594] LustreError: 101399:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2423.845024] LustreError: 101399:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 50 previous similar messages [ 2424.167142] LustreError: 101399:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2424.179491] LustreError: 101399:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 50 previous similar messages [ 2448.119305] Lustre: 101399:0:(ldlm_lib.c:2380:target_recovery_overseer()) lustre-MDT0000 recovery is aborted by hard timeout [ 2448.134207] Lustre: 101399:0:(ldlm_lib.c:2390:target_recovery_overseer()) recovery is aborted, evict exports in recovery [ 2448.147324] Lustre: 101399:0:(genops.c:1622:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client 844f7a35-03a8-40e4-b2d0-09379c7c767c@192.168.204.25@tcp [ 2448.162929] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 2448.167673] Lustre: 101399:0:(ldlm_lib.c:1900:abort_req_replay_queue()) @@@ aborted: req@000000003b9de06b x1869067935879424/t0(8589934777) o101->844f7a35-03a8-40e4-b2d0-09379c7c767c@192.168.204.25@tcp:309/0 lens 592/0 e 0 to 0 dl 1782482829 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:0 [ 2448.190197] Lustre: lustre-MDT0000-osd: cancel update llog [0x200000400:0x1:0x0] [ 2448.210619] Lustre: lustre-MDT0000: Denying connection for new client 844f7a35-03a8-40e4-b2d0-09379c7c767c (at 192.168.204.25@tcp), waiting for 3 known clients (2 recovered, 0 in progress, and 1 evicted) to recover in 0:00 [ 2448.223131] Lustre: lustre-MDT0001-osp-MDT0000: cancel update llog [0x240000401:0x1:0x0] [ 2448.253571] Lustre: lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 2448.257987] Lustre: lustre-MDT0000: Recovery over after 1:00, of 3 clients 2 recovered and 1 was evicted. [ 2448.265335] Lustre: Skipped 2 previous similar messages [ 2448.295366] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:79 to 0x280000401:577) [ 2448.296443] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:47 to 0x2c0000401:545) [ 2458.592908] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2458.598157] LustreError: Skipped 1 previous similar message [ 2458.608426] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2458.616535] Lustre: Skipped 6 previous similar messages [ 2463.917792] Lustre: server umount lustre-OST0000 complete [ 2467.813781] LustreError: 96990:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2467.824415] LustreError: 96990:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 25 previous similar messages [ 2472.665242] Lustre: server umount lustre-OST0001 complete [ 2489.311267] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2489.431857] Lustre: server umount lustre-MDT0000 complete [ 2491.568639] LustreError: 95148:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782482862 with bad export cookie 17370059680731761898 [ 2491.570761] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2491.576081] LustreError: 95148:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 2491.772613] Lustre: server umount lustre-MDT0001 complete [ 2496.721386] Lustre: DEBUG MARKER: == conf-sanity test 85: osd_ost init: fail ea_fid_set ==== 10:07:47 (1782482867) [ 2501.827953] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2501.833681] Lustre: *** cfs_fail_loc=197, val=0*** [ 2517.343760] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 2522.466147] LustreError: 103371:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.204.125@tcp: failed processing log, type 4: rc = -110 [ 2527.601462] Lustre: *** cfs_fail_loc=197, val=0*** [ 2527.604404] Lustre: Skipped 65 previous similar messages [ 2552.244978] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 2557.180757] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2558.733743] Lustre: server umount lustre-OST0000 complete [ 2565.399695] Lustre: DEBUG MARKER: == conf-sanity test 86: Replacing mkfs.lustre -G option == 10:08:55 (1782482935) [ 2583.142748] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2583.487755] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2583.491414] Lustre: Skipped 2 previous similar messages [ 2586.621272] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 2593.005477] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2596.091726] LustreError: 105022:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x200000009:0x1:0x0]: rc = -5 [ 2596.102710] LustreError: 105022:0:(lod_sub_object.c:917:lod_sub_prep_llog()) lustre-MDT0000-mdtlov: can't get id from catalogs: rc = -5 [ 2596.108476] LustreError: 105022:0:(lod_dev.c:511:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 13, retries 0, failed: rc = -5 [ 2596.386732] Lustre: server umount lustre-MDT0000 complete [ 2620.347545] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_hostid [ 2627.008211] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 2652.844797] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2653.000862] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2653.031705] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2653.108269] Lustre: lustre-MDT0000: new disk, initializing [ 2653.193842] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2656.424279] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 2664.419392] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2664.512818] Lustre: 109190:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2664.707352] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2667.686562] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 2674.461429] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2678.558973] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2684.259419] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2684.477604] Lustre: 111155:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2689.546366] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 2691.705847] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2696.534165] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2699.770934] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2699.924554] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2702.774158] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2702.911504] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2706.919554] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2706.919690] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2706.927296] LustreError: Skipped 2 previous similar messages [ 2706.928782] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2706.928788] Lustre: Skipped 11 previous similar messages [ 2706.953869] Lustre: Skipped 9 previous similar messages [ 2710.262505] Lustre: server umount lustre-OST0000 complete [ 2718.817386] Lustre: server umount lustre-MDT0000 complete [ 2721.206760] LustreError: 109183:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782483092 with bad export cookie 17370059680731772510 [ 2721.209353] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2721.212339] LustreError: 109183:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 2721.426759] Lustre: server umount lustre-MDT0001 complete [ 2727.096477] Lustre: DEBUG MARKER: == conf-sanity test 87: check if MDT inode can hold EAs with N stripes properly ========================================================== 10:11:37 (1782483097) [ 2734.270129] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing unload_modules_local [ 2736.256074] Key type lgssc unregistered [ 2736.484679] LNet: 113642:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2736.493664] LNetError: 113642:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2736.512128] LNet: Removed LNI 192.168.204.125@tcp [ 2737.128868] Key type .llcrypt unregistered [ 2737.133765] Key type ._llcrypt unregistered [ 2749.285700] Key type ._llcrypt registered [ 2749.288445] Key type .llcrypt registered [ 2749.375854] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_hostid [ 2760.085676] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 2760.542029] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2760.589091] alg: No test for adler32 (adler32-zlib) [ 2761.545511] Lustre: Lustre: Build Version: 2.17.54_95_ga6f956b [ 2761.707160] LNet: Added LNI 192.168.204.125@tcp [8/256/0/180] [ 2763.343246] Key type lgssc registered [ 2764.101603] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2788.778942] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2788.790454] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2789.955563] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2789.983309] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2790.042693] Lustre: lustre-MDT0000: new disk, initializing [ 2790.098178] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2790.110380] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2792.725356] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 2799.388523] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2799.534427] Lustre: lustre-OST0000: new disk, initializing [ 2799.537970] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 2799.542339] Lustre: Skipped 1 previous similar message [ 2799.545641] Lustre: 117790:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2799.590016] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2802.530739] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 2802.536095] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 2802.554945] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 2803.059193] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 2809.714564] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2809.838499] Lustre: lustre-OST0001: new disk, initializing [ 2809.841683] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 2809.846781] Lustre: lustre-OST0001: Not available for connect from 0@lo (not set up) [ 2809.850140] Lustre: 118652:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2809.900158] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 2813.335117] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 2814.976488] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost [ 2814.985290] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] [ 2815.002378] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 [ 2820.066776] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2820.069787] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2820.081994] Lustre: Skipped 1 previous similar message [ 2820.091281] Lustre: Skipped 1 previous similar message [ 2825.299408] Lustre: server umount lustre-MDT0000 complete [ 2829.195690] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null) [ 2831.843539] LustreError: 116977:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782483203 with bad export cookie 3375408335071854016 [ 2831.847735] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2831.853784] LustreError: 116977:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 2831.916151] Lustre: server umount lustre-OST0000 complete [ 2834.260228] Lustre: server umount lustre-OST0001 complete [ 2839.454195] Lustre: DEBUG MARKER: == conf-sanity test 88: check the default mount options can be overridden ========================================================== 10:13:30 (1782483210) [ 2845.431675] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 2860.135583] Lustre: DEBUG MARKER: == conf-sanity test 89: check tunefs --param and --erase-param{s} options ========================================================== 10:13:50 (1782483230) [ 2882.503103] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_hostid [ 2887.813780] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 2910.003691] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2910.138667] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2910.168251] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2910.229482] Lustre: lustre-MDT0000: new disk, initializing [ 2910.285479] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2910.297615] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2912.885438] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 2919.419500] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2919.497437] Lustre: 125390:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2919.553145] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 2919.556187] Lustre: Skipped 1 previous similar message [ 2919.623846] Lustre: lustre-MDT0001: new disk, initializing [ 2919.709271] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2919.738491] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 2919.744934] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2922.241503] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 2928.160806] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2931.512148] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2935.755225] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2935.937296] Lustre: lustre-OST0000: new disk, initializing [ 2935.944859] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 2935.953398] Lustre: 127354:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2936.029819] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2939.613601] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 2943.507414] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 2943.514956] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2943.570186] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2945.412743] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) failover.node=192.0.2.254@tcp0,osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2948.175058] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2948.309128] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2950.972607] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2951.090196] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2953.699172] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2953.712869] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2953.715024] Lustre: Skipped 1 previous similar message [ 2953.715451] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2953.729730] Lustre: Skipped 1 previous similar message [ 2958.348290] Lustre: server umount lustre-OST0000 complete [ 2960.864914] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2960.871320] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2960.883776] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2963.942753] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2966.716279] Lustre: server umount lustre-MDT0000 complete [ 2968.811021] LustreError: 125380:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782483339 with bad export cookie 3375408335071855234 [ 2968.811899] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2968.818565] LustreError: 125380:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2969.033779] Lustre: server umount lustre-MDT0001 complete [ 2974.008572] Lustre: DEBUG MARKER: == conf-sanity test 90a: check max_mod_rpcs_in_flight is enforced ========================================================== 10:15:44 (1782483344) [ 2977.790771] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2978.042743] LustreError: 129763:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2978.055719] LustreError: 129763:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 2978.098277] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2980.348220] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 2983.393604] LustreError: 129763:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2984.812158] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2987.102439] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 2991.122994] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2994.013846] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2997.816813] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3001.315718] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 3005.358330] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3011.855641] Lustre: *** cfs_fail_loc=159, val=0*** [ 3011.859293] Lustre: Skipped 1 previous similar message [ 3028.289616] Lustre: lustre-MDT0000: Client 8616ba09-79ae-4049-a4ce-3dce70d2092f (at 192.168.204.25@tcp) reconnecting [ 3029.127780] Lustre: *** cfs_fail_loc=159, val=0*** [ 3029.129568] Lustre: Skipped 4 previous similar messages [ 3044.670926] Lustre: lustre-MDT0000: Client 8616ba09-79ae-4049-a4ce-3dce70d2092f (at 192.168.204.25@tcp) reconnecting [ 3061.731132] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3061.734301] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3061.739870] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3061.748050] Lustre: Skipped 3 previous similar messages [ 3066.918744] Lustre: server umount lustre-OST0000 complete [ 3071.968794] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3071.969130] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3071.969766] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3071.969771] Lustre: Skipped 2 previous similar messages [ 3071.974871] Lustre: Skipped 2 previous similar messages [ 3074.719982] Lustre: server umount lustre-MDT0000 complete [ 3076.364837] LustreError: 129743:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782483447 with bad export cookie 3375408335071856123 [ 3076.365513] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3076.376809] LustreError: 129743:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 3076.530290] Lustre: server umount lustre-MDT0001 complete [ 3081.328929] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing unload_modules_local [ 3082.644794] Key type lgssc unregistered [ 3082.793743] LNet: 133537:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3082.798241] LNetError: 133537:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3082.811766] LNet: Removed LNI 192.168.204.125@tcp [ 3083.209788] Key type .llcrypt unregistered [ 3083.211575] Key type ._llcrypt unregistered [ 3095.018070] Key type ._llcrypt registered [ 3095.019117] Key type .llcrypt registered [ 3095.072698] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 3095.465645] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3095.477707] alg: No test for adler32 (adler32-zlib) [ 3096.401181] Lustre: Lustre: Build Version: 2.17.54_95_ga6f956b [ 3096.564411] LNet: Added LNI 192.168.204.125@tcp [8/256/0/180] [ 3098.183217] Key type lgssc registered [ 3098.842294] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3102.876079] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3102.887134] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3104.135478] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3106.337866] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 3111.044560] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3111.235860] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3113.402693] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 3117.024968] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3119.697869] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3123.266646] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3123.454979] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3126.599590] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 3129.584867] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:42 to 0x280000401:65) [ 3130.532244] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3140.980810] Lustre: *** cfs_fail_loc=159, val=0*** [ 3157.306556] Lustre: lustre-MDT0000: Client 1d83894a-61b4-444e-9a7e-95637d4f0216 (at 192.168.204.25@tcp) reconnecting [ 3158.537498] Lustre: *** cfs_fail_loc=159, val=0*** [ 3174.697383] Lustre: lustre-MDT0001: Client 1d83894a-61b4-444e-9a7e-95637d4f0216 (at 192.168.204.25@tcp) reconnecting [ 3175.512741] Lustre: *** cfs_fail_loc=159, val=0*** [ 3175.515587] Lustre: Skipped 3 previous similar messages [ 3192.133923] Lustre: lustre-MDT0001: Client 1d83894a-61b4-444e-9a7e-95637d4f0216 (at 192.168.204.25@tcp) reconnecting [ 3194.500392] Lustre: 137963:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3196.136785] Lustre: *** cfs_fail_loc=159, val=0*** [ 3196.144452] Lustre: Skipped 4 previous similar messages [ 3211.570411] Lustre: lustre-MDT0000: Client 090f0827-e7ae-483e-804e-8eeb5cb5196a (at 192.168.204.25@tcp) reconnecting [ 3212.385044] Lustre: *** cfs_fail_loc=159, val=0*** [ 3212.387985] Lustre: Skipped 13 previous similar messages [ 3227.973098] Lustre: lustre-MDT0000: Client 090f0827-e7ae-483e-804e-8eeb5cb5196a (at 192.168.204.25@tcp) reconnecting [ 3228.736253] Lustre: 138250:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3247.584477] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3247.591351] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3247.601793] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3249.632140] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3249.635032] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3253.046257] Lustre: server umount lustre-OST0000 complete [ 3259.874115] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3259.876865] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3259.881292] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3259.896233] Lustre: Skipped 2 previous similar messages [ 3261.242886] Lustre: server umount lustre-MDT0000 complete [ 3263.023070] LustreError: 134910:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782483634 with bad export cookie 5432201799361466714 [ 3263.028914] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3263.030426] LustreError: 134910:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3263.192636] Lustre: server umount lustre-MDT0001 complete [ 3268.058484] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing unload_modules_local [ 3269.367438] Key type lgssc unregistered [ 3269.515558] LNet: 139328:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3269.524733] LNetError: 139328:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3269.532420] LNet: Removed LNI 192.168.204.125@tcp [ 3269.916143] Key type .llcrypt unregistered [ 3269.918404] Key type ._llcrypt unregistered [ 3281.286387] Key type ._llcrypt registered [ 3281.287815] Key type .llcrypt registered [ 3281.338483] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 3281.770485] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3281.806067] alg: No test for adler32 (adler32-zlib) [ 3282.727680] Lustre: Lustre: Build Version: 2.17.54_95_ga6f956b [ 3282.844508] LNet: Added LNI 192.168.204.125@tcp [8/256/0/180] [ 3284.439668] Key type lgssc registered [ 3284.921324] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3288.535939] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3288.551088] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3289.763668] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3291.675912] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 3295.800549] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3295.990638] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3297.918536] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 3301.162464] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3303.636112] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3306.563288] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3306.722877] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3309.179508] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 3312.503284] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3313.897905] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:129) [ 3321.068484] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:97) [ 3326.361214] Lustre: 143317:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3327.326448] Lustre: 143365:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3327.964963] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 in log params [ 3329.459988] Lustre: 143511:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre/mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 (mode = 0) failed: rc = -17 [ 3329.873108] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=7 in log params [ 3329.877866] Lustre: Skipped 1 previous similar message [ 3330.275332] Lustre: 143609:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3333.850313] Lustre: server umount lustre-OST0000 complete [ 3336.674687] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3336.680368] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3336.680493] Lustre: Skipped 1 previous similar message [ 3341.793110] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3341.796705] Lustre: Skipped 2 previous similar messages [ 3344.907785] Lustre: server umount lustre-MDT0000 complete [ 3346.640199] LustreError: 140703:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782483717 with bad export cookie 16876354197279481971 [ 3346.642933] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3346.647471] LustreError: 140703:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 3356.201381] Lustre: server umount lustre-MDT0001 complete [ 3360.524750] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing unload_modules_local [ 3361.762419] Key type lgssc unregistered [ 3361.906849] LNet: 144664:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3361.911455] LNetError: 144664:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3361.929319] LNet: Removed LNI 192.168.204.125@tcp [ 3362.309313] Key type .llcrypt unregistered [ 3362.310461] Key type ._llcrypt unregistered [ 3373.403318] Key type ._llcrypt registered [ 3373.404674] Key type .llcrypt registered [ 3373.454792] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 3373.873539] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3373.919983] alg: No test for adler32 (adler32-zlib) [ 3374.802731] Lustre: Lustre: Build Version: 2.17.54_95_ga6f956b [ 3374.932741] LNet: Added LNI 192.168.204.125@tcp [8/256/0/180] [ 3376.527177] Key type lgssc registered [ 3376.990226] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3380.238709] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3380.247674] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3381.442032] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3383.020298] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 3386.470903] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3386.652784] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3388.337739] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 3391.504088] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3393.816830] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3396.860754] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3397.015454] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3399.387400] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 3402.394623] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3406.246621] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:161) [ 3411.369159] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:129) [ 3415.789560] Lustre: *** cfs_fail_loc=159, val=0*** [ 3432.245868] Lustre: lustre-MDT0000: Client 73b3775f-dd0c-47d4-9eae-909c16367edf (at 192.168.204.25@tcp) reconnecting [ 3437.026703] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3437.030647] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3437.035733] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3437.043773] Lustre: Skipped 1 previous similar message [ 3440.249196] Lustre: server umount lustre-OST0000 complete [ 3442.145237] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3442.154428] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3442.157986] Lustre: Skipped 2 previous similar messages [ 3447.264769] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3447.267327] Lustre: Skipped 1 previous similar message [ 3448.048476] Lustre: server umount lustre-MDT0000 complete [ 3449.753438] LustreError: 146037:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782483820 with bad export cookie 774001338162551619 [ 3449.757086] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3449.760568] LustreError: 146037:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3449.936854] Lustre: server umount lustre-MDT0001 complete [ 3454.934137] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing unload_modules_local [ 3456.209245] Key type lgssc unregistered [ 3456.355842] LNet: 149735:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3456.360362] LNetError: 149735:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3456.373457] LNet: Removed LNI 192.168.204.125@tcp [ 3456.802876] Key type .llcrypt unregistered [ 3456.804688] Key type ._llcrypt unregistered [ 3468.446300] Key type ._llcrypt registered [ 3468.448837] Key type .llcrypt registered [ 3468.493738] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 3469.000397] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3469.018800] alg: No test for adler32 (adler32-zlib) [ 3469.920934] Lustre: Lustre: Build Version: 2.17.54_95_ga6f956b [ 3470.036508] LNet: Added LNI 192.168.204.125@tcp [8/256/0/180] [ 3471.639182] Key type lgssc registered [ 3472.131040] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3475.456496] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3475.466160] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3476.686845] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3478.464865] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 3482.429213] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3482.631566] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3484.509362] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 3487.844693] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3490.122937] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3492.997894] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3493.181835] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3495.933137] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 3499.014151] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3501.427334] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:170 to 0x280000401:193) [ 3507.559421] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:161) [ 3525.341389] Lustre: lustre-MDT0001: evicting d5c8b261-234c-4bf4-93d7-07afe5e27e2d (at 192.168.204.25@tcp) by administrative request [ 3525.347924] Lustre: Skipped 1 previous similar message [ 3552.736666] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3552.742512] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3552.753809] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3553.760616] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3553.760904] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3553.766869] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3556.387997] Lustre: server umount lustre-OST0000 complete [ 3558.882538] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3558.885363] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3558.887202] Lustre: Skipped 1 previous similar message [ 3558.895673] Lustre: Skipped 2 previous similar messages [ 3564.001996] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3564.006225] Lustre: Skipped 1 previous similar message [ 3564.404483] Lustre: server umount lustre-MDT0000 complete [ 3566.164495] LustreError: 151122:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782483937 with bad export cookie 2357196892715341889 [ 3566.168071] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3566.174565] LustreError: 151122:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 3566.325441] Lustre: server umount lustre-MDT0001 complete [ 3571.098390] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing unload_modules_local [ 3572.463363] Key type lgssc unregistered [ 3572.633704] LNet: 155229:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3572.639786] LNetError: 155229:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3572.652554] LNet: Removed LNI 192.168.204.125@tcp [ 3573.045725] Key type .llcrypt unregistered [ 3573.047493] Key type ._llcrypt unregistered [ 3605.265869] Key type ._llcrypt registered [ 3605.267339] Key type .llcrypt registered [ 3605.321686] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 3605.678076] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3605.694299] alg: No test for adler32 (adler32-zlib) [ 3606.617960] Lustre: Lustre: Build Version: 2.17.54_95_ga6f956b [ 3606.727394] LNet: Added LNI 192.168.204.125@tcp [8/256/0/180] [ 3608.319102] Key type lgssc registered [ 3608.809931] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3612.858296] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3612.868122] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3614.054411] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3616.010881] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 3620.115469] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3620.362215] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3622.235090] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 3625.855483] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3628.582728] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3632.107341] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3632.322355] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3635.290035] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 3638.678311] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3639.528247] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:195 to 0x280000401:225) [ 3645.673414] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:193) [ 3650.016583] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3650.021570] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3650.030529] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3651.041038] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3651.041321] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3651.045382] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3654.178511] Lustre: server umount lustre-OST0000 complete [ 3656.161550] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3656.161636] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3656.162207] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3656.162212] Lustre: Skipped 1 previous similar message [ 3656.167664] Lustre: Skipped 1 previous similar message [ 3661.281408] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3661.283779] Lustre: Skipped 2 previous similar messages [ 3661.943447] Lustre: server umount lustre-MDT0000 complete [ 3663.643788] LustreError: 157717:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782484034 with bad export cookie 6999581096969065059 [ 3663.646710] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3663.653169] LustreError: 157717:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 3663.795682] Lustre: server umount lustre-MDT0001 complete [ 3668.128073] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing unload_modules_local [ 3669.277209] Key type lgssc unregistered [ 3669.413635] LNet: 161230:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3669.418386] LNetError: 161230:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3669.426311] LNet: Removed LNI 192.168.204.125@tcp [ 3669.786234] Key type .llcrypt unregistered [ 3669.788161] Key type ._llcrypt unregistered [ 3680.566425] Key type ._llcrypt registered [ 3680.568008] Key type .llcrypt registered [ 3680.613815] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 3681.072346] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3681.080139] alg: No test for adler32 (adler32-zlib) [ 3681.970850] Lustre: Lustre: Build Version: 2.17.54_95_ga6f956b [ 3682.093424] LNet: Added LNI 192.168.204.125@tcp [8/256/0/180] [ 3683.687229] Key type lgssc registered [ 3684.132906] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3689.724967] Lustre: DEBUG MARKER: == conf-sanity test 100: check lshowmount lists MGS, MDT, OST and 0@lo ========================================================== 10:27:40 (1782484060) [ 3696.062629] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_hostid [ 3699.917104] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 3713.214695] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3713.222351] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3714.302821] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3714.313320] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3714.351554] Lustre: lustre-MDT0000: new disk, initializing [ 3714.377142] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3714.383906] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3715.861783] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 3720.172158] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3720.218961] Lustre: 165470:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 3720.246788] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 3720.249327] Lustre: Skipped 1 previous similar message [ 3720.285949] Lustre: lustre-MDT0001: new disk, initializing [ 3720.326347] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3720.339603] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 3720.343522] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 3721.729691] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 3725.477585] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3727.302722] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3729.577572] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3729.687860] Lustre: lustre-OST0000: new disk, initializing [ 3729.689685] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3729.692038] Lustre: 167440:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3729.725219] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3731.749637] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 3732.664198] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 3732.667911] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 3732.705937] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 3735.475629] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3743.201249] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3743.202281] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3743.203375] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3743.204533] LustreError: Skipped 1 previous similar message [ 3743.208295] Lustre: Skipped 1 previous similar message [ 3744.850192] Lustre: server umount lustre-OST0000 complete [ 3746.272369] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3746.275968] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3746.281726] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3746.284236] Lustre: Skipped 1 previous similar message [ 3748.320313] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3748.320902] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3752.281512] Lustre: server umount lustre-MDT0000 complete [ 3753.602376] LustreError: 167439:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782484124 with bad export cookie 16535387743426132338 [ 3753.606147] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3753.607570] LustreError: 167439:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3753.750347] Lustre: server umount lustre-MDT0001 complete [ 3757.482590] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing unload_modules_local [ 3758.599647] Key type lgssc unregistered [ 3758.746466] LNet: 169342:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3758.749703] LNetError: 169342:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3758.757507] LNet: Removed LNI 192.168.204.125@tcp [ 3759.113127] Key type .llcrypt unregistered [ 3759.115901] Key type ._llcrypt unregistered [ 3769.017076] Key type ._llcrypt registered [ 3769.018283] Key type .llcrypt registered [ 3769.059263] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 3769.387441] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3769.427041] alg: No test for adler32 (adler32-zlib) [ 3770.284240] Lustre: Lustre: Build Version: 2.17.54_95_ga6f956b [ 3770.374883] LNet: Added LNI 192.168.204.125@tcp [8/256/0/180] [ 3771.959166] Key type lgssc registered [ 3772.358923] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3775.272897] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3775.280070] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3776.442466] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3778.033223] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 3781.245491] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3781.389093] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3782.933994] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 3786.230257] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3790.038172] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3795.827402] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3796.024120] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3800.406694] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 3801.127702] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:33) [ 3806.611729] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3813.474536] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3813.490511] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3813.507937] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3813.515608] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3813.526473] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3814.259763] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3814.273951] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3814.287371] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3814.296338] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3814.308751] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3815.044727] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3815.602258] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3815.606710] Lustre: Skipped 1 previous similar message [ 3815.620231] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3815.632950] Lustre: Skipped 1 previous similar message [ 3815.636783] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3815.642375] Lustre: Skipped 1 previous similar message [ 3815.646268] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3815.660791] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3815.666367] Lustre: Skipped 1 previous similar message [ 3816.368994] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3817.083672] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3817.967490] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3817.974780] Lustre: Skipped 2 previous similar messages [ 3817.989237] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3817.997671] Lustre: Skipped 2 previous similar messages [ 3818.001775] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3818.008539] Lustre: Skipped 2 previous similar messages [ 3818.012765] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3818.024560] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3818.032491] Lustre: Skipped 2 previous similar messages [ 3818.875645] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3819.600134] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3820.394718] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3821.217385] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3822.127416] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3822.131150] Lustre: Skipped 4 previous similar messages [ 3822.133802] LustreError: 170753:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 3822.140237] LustreError: 170753:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 3822.157211] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3822.164187] Lustre: Skipped 4 previous similar messages [ 3822.166940] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3822.169796] Lustre: Skipped 4 previous similar messages [ 3822.173340] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3822.181947] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3822.187242] Lustre: Skipped 4 previous similar messages [ 3822.803185] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3823.451880] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3824.074878] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3825.054795] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3825.900294] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3827.048900] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3827.663554] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3828.481971] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3829.292833] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3830.141294] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3830.146857] Lustre: Skipped 9 previous similar messages [ 3830.170701] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3830.184180] Lustre: Skipped 9 previous similar messages [ 3830.188887] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3830.194440] Lustre: Skipped 9 previous similar messages [ 3830.198716] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3830.209517] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3830.214261] Lustre: Skipped 9 previous similar messages [ 3830.985134] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3831.795572] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3832.422961] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3833.081478] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3833.787172] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3834.492147] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3835.186272] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3835.863422] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3836.692602] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3837.410947] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3838.336382] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3838.890575] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3839.503830] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3840.312819] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3841.405799] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3842.407393] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3843.370265] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3844.302304] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3845.136161] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3845.868652] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3846.585451] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3846.591041] Lustre: Skipped 20 previous similar messages [ 3846.601593] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3846.608637] Lustre: Skipped 20 previous similar messages [ 3846.614111] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3846.617490] Lustre: Skipped 20 previous similar messages [ 3846.619724] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3846.634027] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3846.639449] Lustre: Skipped 20 previous similar messages [ 3847.285147] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3848.010310] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3848.681731] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3849.459646] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3850.175669] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3850.839451] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3851.408093] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3852.058836] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3852.606975] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3853.182712] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3853.703452] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3854.194960] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3854.727942] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3855.239802] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3855.706776] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3856.300767] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3856.805320] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3857.323780] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3857.818202] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3858.365102] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3858.859552] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3859.360275] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3859.869560] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3860.416611] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3860.950808] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3861.440238] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3861.943487] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3862.520381] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3863.084588] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3863.628455] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3864.170488] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3864.642284] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3865.158963] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3865.644687] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3866.129223] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3866.653681] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3867.178581] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3867.658169] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3868.119274] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3868.557134] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3869.016317] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3869.493223] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3869.957575] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3870.465626] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3870.924867] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3871.418534] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3871.923166] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3872.435068] LustreError: 170753:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 3872.442923] LustreError: 170753:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 3872.444450] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3872.999643] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3873.495180] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3874.019588] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3874.506081] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3874.983839] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3875.478655] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3875.901657] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3876.289169] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3876.727240] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3877.113796] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3877.497590] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3877.922319] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3878.349541] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3878.773481] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3878.776477] Lustre: Skipped 61 previous similar messages [ 3878.785174] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3878.793596] Lustre: Skipped 61 previous similar messages [ 3878.796252] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3878.800065] Lustre: Skipped 61 previous similar messages [ 3878.802188] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3878.807646] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3878.812344] Lustre: Skipped 61 previous similar messages [ 3879.241524] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3879.674412] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3880.110467] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3880.604367] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3881.051464] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3881.534982] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3882.051186] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3882.534163] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3883.103794] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3883.610339] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3884.144480] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3884.678758] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3885.257739] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3885.798436] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3886.278523] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3886.808838] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3887.256613] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3887.666280] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3888.085114] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3888.511136] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3888.933622] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3889.417681] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3889.930952] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3890.446403] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3891.066480] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3891.608676] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3892.166807] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3892.683798] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3893.194647] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3893.779089] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3894.346054] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3894.872093] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3895.350921] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3895.917712] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3896.356432] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3896.861361] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3897.403501] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3897.881694] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3898.394126] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3898.965817] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3899.551276] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3900.064256] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3900.552068] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3901.066737] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3901.573591] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3902.049065] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3902.553405] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3903.095454] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3903.590182] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3904.098314] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3904.604685] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3905.045177] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3905.595229] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3906.086353] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3906.617712] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3907.185789] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3907.657714] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3908.154512] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3908.607523] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3909.063940] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3909.578897] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3910.026481] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3910.533088] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3911.083832] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3911.613638] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3912.154279] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3912.699679] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3913.246735] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3913.775777] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3914.282806] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3914.911029] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3915.402598] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3916.002395] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3916.578148] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3917.152618] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3917.701206] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3918.175913] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3918.675527] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3919.160692] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3919.697673] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3920.290656] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3920.773986] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3921.290929] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3921.827168] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3922.332559] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3922.884231] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3923.453753] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3924.023414] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3924.547084] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3925.076731] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3925.542976] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3926.007394] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3926.475433] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3926.928413] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3927.373352] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3927.898403] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3928.350748] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3928.761061] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3929.239708] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3929.695273] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3930.142152] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3930.610516] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3931.094224] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3931.537097] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3931.987480] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3932.450382] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3932.886292] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3933.288085] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3933.680220] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3934.032151] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3934.395256] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3934.773966] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3935.177195] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3935.619260] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3936.053915] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3936.507220] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3936.926866] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3937.341889] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3937.815620] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3938.339603] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3938.887181] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3939.325123] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3939.791316] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3940.292895] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3940.776284] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3941.270635] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3941.732784] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3942.127628] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3942.520974] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3942.983564] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3942.987510] Lustre: Skipped 129 previous similar messages [ 3942.998891] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3943.007231] Lustre: Skipped 129 previous similar messages [ 3943.014982] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3943.018665] Lustre: Skipped 129 previous similar messages [ 3943.023784] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3943.031899] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3943.035917] Lustre: Skipped 129 previous similar messages [ 3943.477296] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3943.895499] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3944.305630] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3944.711667] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3945.129319] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3945.564503] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3946.038424] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3946.476576] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3946.920849] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3947.351546] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3947.760332] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3948.190703] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3948.646697] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3949.068318] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3949.530492] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3950.009398] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3950.458532] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3950.953852] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3951.393229] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3951.815282] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3952.224946] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3952.656506] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3953.161187] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3953.680210] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3954.182332] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3954.655172] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3955.097506] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3955.551518] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3956.080775] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3956.695983] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3957.231203] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3957.716895] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3958.267914] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3958.875461] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3959.403603] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3960.083399] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3960.672593] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3961.208215] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3961.691726] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3962.146395] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3962.661254] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3963.090604] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3963.688459] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3964.270291] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3964.711563] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3965.176032] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3965.680553] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3966.260270] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3966.722949] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3967.202741] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3967.668893] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3968.084368] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3968.542288] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3968.979483] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3969.439994] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3969.932807] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3970.453476] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3970.957436] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3971.462095] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3972.006810] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3972.478227] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3972.967711] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3973.443186] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3973.927148] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3974.399086] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3974.948186] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3975.478445] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3975.999833] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3976.558745] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3977.017354] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3977.463985] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3977.886117] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3978.303037] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3978.779961] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3979.228850] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3979.684550] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3980.224103] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3980.726109] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3981.304829] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3981.795744] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3982.354500] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3982.916717] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3983.536692] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3984.137567] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3984.887730] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3985.778820] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3986.787950] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3987.998668] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3989.124713] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3990.059525] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3991.242092] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3992.112848] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3993.700359] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3994.910255] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3995.860451] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3996.900973] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3997.928343] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4000.272439] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4001.296157] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4002.263618] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4003.832689] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4004.800746] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4005.875169] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4007.213977] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4008.345602] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4009.333791] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4010.126648] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4010.834486] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4011.693323] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4012.819982] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4014.079293] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4015.086469] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4016.177653] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4017.570726] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4018.552960] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4019.573771] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4020.813372] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4021.600455] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4023.159949] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4024.364584] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4025.547389] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4026.456222] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4027.476983] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4028.577340] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4029.777467] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4030.953668] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4031.758680] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4032.998294] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4033.989965] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4034.998938] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4035.995305] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4037.231050] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4038.260206] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4039.309786] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4040.359689] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4041.664978] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4042.714892] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4043.601357] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4044.403547] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4045.223770] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4046.280647] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4047.276767] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4048.316351] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4049.223815] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4050.226788] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4051.276344] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4052.416086] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4053.322681] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4054.170369] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4055.070757] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4056.037101] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4056.875717] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4057.792110] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4059.232147] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4060.197758] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4061.410165] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4062.522394] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4063.309967] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4064.055306] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4065.037100] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4066.332828] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4067.634560] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4068.763292] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4070.082976] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4071.462482] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4071.469844] Lustre: Skipped 164 previous similar messages [ 4071.486362] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4071.493823] Lustre: Skipped 164 previous similar messages [ 4071.502051] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4071.504804] Lustre: Skipped 164 previous similar messages [ 4071.508962] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4071.521347] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4071.526920] Lustre: Skipped 164 previous similar messages [ 4072.598508] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4073.803334] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4074.756528] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4075.589377] LustreError: 170753:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 4075.599836] LustreError: 170753:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 4075.616215] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4076.693693] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4077.520317] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4078.745382] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4080.223904] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4081.440580] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4082.490675] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4083.446057] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4084.361893] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4085.289604] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4086.260353] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4087.107317] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4088.041771] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4088.962220] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4089.886117] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4090.687071] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4091.587190] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4092.576668] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4093.413067] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4094.217111] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4095.023026] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4095.848366] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4096.592697] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4097.317661] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4098.101861] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4098.877039] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4099.614917] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4100.385988] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4101.128221] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4101.989770] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4102.755975] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4103.574319] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4104.308479] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4105.122513] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4105.907734] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4106.631540] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4107.458385] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4108.200099] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4108.915625] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4109.639536] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4110.431186] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4111.205235] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4111.872215] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4112.592408] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4113.358781] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4114.071207] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4114.935625] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4115.745077] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4116.660620] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4117.521239] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4118.372819] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4119.159152] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4120.009977] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4120.676573] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4121.389366] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4122.107980] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4122.876934] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4123.665808] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4124.354161] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4125.216375] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4125.926587] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4126.694728] LustreError: 170753:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 4126.701248] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4126.704992] LustreError: 170753:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 4127.389480] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4128.129165] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4128.826964] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4129.601573] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4130.370847] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4131.221312] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4131.913658] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4132.756169] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4133.604778] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4134.426100] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4135.158461] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4135.949353] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4136.698471] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4137.517942] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4138.248423] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4139.043723] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4139.778902] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4140.538280] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4141.285083] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4142.087875] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4142.808625] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4143.531756] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4144.314095] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4145.062707] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4145.892192] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4146.827917] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4147.563163] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4148.328727] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4149.163485] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4149.938487] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4150.628527] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4151.416195] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4152.136797] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4152.961192] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4153.678491] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4154.524184] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4155.327024] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4156.148657] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4156.861508] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4157.846575] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4158.531878] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4159.454892] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4160.378206] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4161.345044] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4162.418096] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4163.645555] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4164.603209] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4165.422518] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4166.300446] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4167.020162] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4167.690320] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4168.676278] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4169.469884] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4170.458371] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4171.381122] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4172.107057] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4173.014903] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4173.891500] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4174.894857] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4175.646812] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4176.402956] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4177.197689] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4178.050688] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4178.949449] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4179.689628] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4180.557540] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4181.317143] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4182.079622] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4182.718596] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4183.416094] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4184.279776] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4185.092479] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4185.880893] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4186.854414] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4187.567859] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4188.415303] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4189.063471] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4189.727400] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4190.398579] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4191.154480] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4191.911821] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4192.801852] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4193.768292] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4194.803724] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4195.555882] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4196.439316] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4197.078883] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4197.722391] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4198.351623] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4199.045780] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4199.746955] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4200.540740] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4201.357289] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4202.107181] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4202.847228] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4203.647479] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4204.411559] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4205.207928] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4205.981852] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4206.695423] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4207.429258] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4208.223340] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4208.918294] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4209.680420] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4210.386517] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4211.187019] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4211.987645] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4212.798697] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4213.568927] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4214.313129] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4214.976257] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4215.553135] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4216.268171] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4216.950192] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4217.677660] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4218.344662] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4219.048201] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4219.778077] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4220.495651] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4221.190600] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4221.881095] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4222.651624] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4223.540373] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4224.246167] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4224.978379] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4225.713532] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4226.433475] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4227.108626] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4227.854650] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4228.586801] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4229.284466] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4229.970531] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4230.719515] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4231.417300] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4232.238636] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4232.957045] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4233.759893] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4234.405829] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4235.051499] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4235.831649] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4236.533162] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4237.210738] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4238.105738] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4238.874950] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4239.647402] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4240.417725] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4241.200024] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4241.944885] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4242.801682] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4243.495809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4244.319449] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4244.994346] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4245.771761] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4246.526190] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4247.273086] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4248.004286] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4248.806286] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4249.413427] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4250.117456] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4250.754204] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4251.578342] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4252.324611] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4253.095090] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4253.841733] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4254.764287] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4255.642486] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4256.412143] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4257.427464] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4258.334453] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4259.151965] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4259.986582] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4260.634614] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4261.401974] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4262.051581] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4262.710192] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4263.433634] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4264.137765] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4264.870607] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4265.531675] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4266.189926] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4266.919858] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4267.667453] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4268.400490] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4269.068427] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4269.804420] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4270.553086] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4271.366799] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4272.182871] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4273.064530] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4273.769318] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4274.533111] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4275.283441] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4276.064197] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4276.800832] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4277.524058] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4278.224688] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4279.007225] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4279.850046] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4280.604754] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4281.222397] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4281.862068] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4282.588635] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4283.402963] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4284.313074] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4285.258535] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4286.074462] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4287.032889] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4287.685557] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4288.368780] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4289.043692] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4289.730595] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4290.503291] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4291.499885] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4292.355994] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4293.226247] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4294.066885] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4294.962478] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4295.824825] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4296.885109] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4297.954604] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4298.615489] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4299.291149] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4299.961712] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4300.748904] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4301.586497] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4302.416607] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4303.171578] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4303.936736] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4304.627055] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4305.676253] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4306.690634] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4307.536321] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4308.319837] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4309.337829] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4310.113596] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4311.096117] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4312.059779] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4312.914160] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4313.504934] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4314.418169] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4315.398747] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4316.338899] LustreError: 170753:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 4316.348286] LustreError: 170753:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 4316.350853] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4317.161229] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4317.996177] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4318.758687] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4319.703264] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4320.684467] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4321.369477] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4322.057934] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4322.792520] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4323.800643] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4324.646365] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4325.614506] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4326.392519] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4327.135513] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4327.993749] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4327.997671] Lustre: Skipped 320 previous similar messages [ 4328.010990] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4328.020874] Lustre: Skipped 320 previous similar messages [ 4328.024746] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4328.033458] Lustre: Skipped 320 previous similar messages [ 4328.037429] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4328.048663] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4328.051776] Lustre: Skipped 320 previous similar messages [ 4328.782242] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4329.490814] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4330.117918] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4330.856148] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4331.579327] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4332.209326] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4332.836572] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4333.557264] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4334.205522] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4334.869972] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4335.458748] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4336.090176] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4336.710696] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4337.493372] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4338.299895] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4338.954042] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4339.610664] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4340.198340] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4340.849080] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4341.493179] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4342.118985] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4342.760164] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4343.342417] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4343.959943] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4344.499813] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4345.064252] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4345.669531] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4346.230792] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4346.784102] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4347.427818] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4347.929646] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4348.452312] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4348.945862] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4349.431488] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4349.948632] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4350.456902] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4351.025886] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4351.622176] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4352.103785] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4352.796455] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4353.376069] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4353.913851] LustreError: 170753:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 4353.923961] LustreError: 170753:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 4353.930487] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4354.547495] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4355.124490] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4355.652418] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4356.208486] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4356.764576] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4357.319440] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4357.802544] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4358.394926] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4358.927282] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4359.421622] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4359.931488] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4360.490153] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4361.023344] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4361.537235] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4362.022964] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4362.610476] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4363.105878] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4363.575648] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4364.069364] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4364.511282] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4365.017611] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4365.590509] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4366.128735] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4366.744706] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4367.311155] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4367.849443] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4368.380451] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4369.005852] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4369.563973] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4370.142586] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4370.704176] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4371.192963] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4371.652182] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4372.150317] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4372.725449] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4373.220669] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4373.735660] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4374.271764] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4374.729977] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4375.217190] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4375.718085] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4376.193310] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4376.642991] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4377.121912] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4377.601280] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4378.045601] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4378.492607] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4378.946088] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4379.381210] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4379.794475] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4380.213369] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4380.595052] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4381.043343] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4381.426322] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4381.834543] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4382.224330] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4382.623145] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4383.049979] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4383.466318] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4383.922356] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4384.372417] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4384.772420] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4385.166517] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4385.567932] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4386.002884] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4386.402846] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4386.822097] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4387.308409] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4387.749505] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4388.204102] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4388.667799] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4389.082065] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4389.490650] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4389.873442] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4390.331306] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4390.800988] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4391.263272] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4391.710083] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4392.201208] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4392.645310] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4393.119026] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4393.664511] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4394.162510] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4394.613535] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4395.087245] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4395.605579] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4396.093852] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4396.686767] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4397.193776] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4397.765567] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4398.356577] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4398.941818] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4399.422380] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4399.902702] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4400.389902] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4400.943116] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4401.480753] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4401.974299] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4402.491862] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4403.079952] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4403.688921] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4404.189371] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4404.725978] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4405.371825] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4405.972307] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4406.651163] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4407.179968] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4407.811270] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4408.366417] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4408.978431] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4409.483415] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4410.098730] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4410.588171] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4411.194938] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4411.752490] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4412.274597] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4412.780804] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4413.479250] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4414.066908] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4414.622291] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4415.122850] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4415.753179] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4416.323410] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4416.831415] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4417.321817] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4417.854361] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4418.513079] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4419.126457] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4419.618038] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4420.136598] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4420.715639] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4421.315924] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4422.033849] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4422.520812] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4423.107256] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4423.614531] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4424.163790] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4424.719603] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4425.223190] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4425.721439] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4426.187366] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4426.734757] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4427.294349] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4427.769880] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4428.345850] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4428.974510] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4429.491331] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4429.964574] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4430.492519] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4430.995427] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4431.536288] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4432.091317] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4432.639876] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4433.136661] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4433.622612] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4434.173616] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4434.646413] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4435.129895] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4435.652492] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4436.154342] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4436.691160] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4437.236393] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4437.745168] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4438.305619] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4438.899638] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4439.372758] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4439.866192] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4440.448846] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4441.006943] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4441.614215] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4442.163199] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4442.670482] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4443.250425] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4443.853517] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4444.387834] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4444.874750] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4445.434717] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4445.910232] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4446.430566] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4447.001623] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4447.520991] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4448.121837] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4448.698175] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4449.387709] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4449.965456] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4450.561197] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4451.042419] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4451.535421] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4452.005503] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4452.479928] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4453.072591] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4453.634896] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4454.184494] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4454.679199] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4455.141572] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4455.611610] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4456.054706] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4456.589544] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4457.134913] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4457.619124] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4458.159124] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4458.651399] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4459.111032] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4459.531282] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4459.933769] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4460.335280] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4460.745978] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4461.162219] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4461.541879] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4462.048608] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4462.460928] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4462.857374] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4463.255475] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4463.651437] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4464.025180] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4464.404038] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4464.778912] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4465.220806] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4465.611523] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4466.020776] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4466.409167] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4466.810112] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4467.203524] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4467.607782] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4468.084745] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4468.574051] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4469.025162] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4469.542326] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4469.942318] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4470.342038] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4470.784585] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4471.175508] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4471.559573] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4471.949542] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4472.341773] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4472.739453] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4473.157621] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4849.767198] LustreError: 172552:0:(ofd_dev.c:1780:ofd_create_hdl()) lustre-OST0000: unable to precreate: rc = -28 [ 4849.773894] LustreError: 170753:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -28 [ 4849.780799] LustreError: 170753:0:(osp_precreate.c:655:osp_precreate_send()) Skipped 1 previous similar message [ 5157.879537] LustreError: lustre-OST0000-osc-MDT0000: operation ost_destroy to node 0@lo failed: rc = -107 [ 5157.879663] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5157.884177] LustreError: Skipped 3 previous similar messages [ 5157.889742] Lustre: Skipped 279 previous similar messages [ 5157.890597] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5158.368817] LustreError: 172550:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5158.381175] LustreError: 172550:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 5158.417296] Lustre: server umount lustre-OST0000 complete [ 5160.929706] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5160.933366] Lustre: Skipped 1 previous similar message [ 5166.048057] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5166.056974] Lustre: Skipped 1 previous similar message [ 5166.241157] Lustre: server umount lustre-MDT0000 complete [ 5168.155772] LustreError: 170713:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782485539 with bad export cookie 13714085050745678509 [ 5168.158443] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5168.162738] LustreError: 170713:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 5168.373907] Lustre: server umount lustre-MDT0001 complete [ 5174.836792] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing unload_modules_local [ 5176.589779] Key type lgssc unregistered [ 5176.772887] LNet: 225882:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5176.777829] LNetError: 225882:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5176.789507] LNet: Removed LNI 192.168.204.125@tcp [ 5177.305320] Key type .llcrypt unregistered [ 5177.307746] Key type ._llcrypt unregistered [ 5191.526489] Key type ._llcrypt registered [ 5191.528074] Key type .llcrypt registered [ 5191.610987] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 5192.108754] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5192.143795] alg: No test for adler32 (adler32-zlib) [ 5193.054563] Lustre: Lustre: Build Version: 2.17.54_95_ga6f956b [ 5193.199648] LNet: Added LNI 192.168.204.125@tcp [8/256/0/180] [ 5194.824706] Key type lgssc registered [ 5195.508560] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5199.748564] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5199.757817] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5200.997333] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5203.067293] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 5208.372671] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5208.619970] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5211.304498] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 5216.187701] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5219.620665] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 5223.429563] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5223.647405] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5226.734438] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49665 to 0x280000401:49696) [ 5227.465319] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 5231.684864] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5236.146630] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5237.211917] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5237.220852] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5237.225568] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5237.231581] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5237.231787] LustreError: 227294:0:(osp_precreate.c:1268:osp_precreate_thread()) cfs_fail_timeout id 2107 sleeping for 20000ms [ 5239.085210] Lustre: lustre-OST0000: Not available for connect from 192.168.204.25@tcp (stopping) [ 5239.267174] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 5239.268184] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5239.278905] Lustre: Skipped 1 previous similar message [ 5240.298891] Lustre: server umount lustre-OST0000 complete [ 5257.327135] LustreError: 227294:0:(osp_precreate.c:1268:osp_precreate_thread()) cfs_fail_timeout id 2107 awake [ 5270.062458] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5270.279530] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5273.926596] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 5278.528291] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5279.526213] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5279.543713] LustreError: lustre-OST0000-osc-MDT0001: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5279.545423] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5279.554719] Lustre: Skipped 1 previous similar message [ 5280.498200] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 1 sec [ 5283.572551] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8b5b8a2b6000.ost_server_uuid 50 [ 5284.466887] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff8b5b8a2b6000.ost_server_uuid in FULL state after 0 sec [ 5289.961910] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 5289.962717] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5289.971810] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5289.979185] Lustre: Skipped 1 previous similar message [ 5289.982208] Lustre: Skipped 2 previous similar messages [ 5292.674421] Lustre: server umount lustre-OST0000 complete [ 5295.074938] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5295.075436] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5295.084078] Lustre: Skipped 1 previous similar message [ 5295.089499] Lustre: Skipped 2 previous similar messages [ 5300.195619] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5300.203366] Lustre: Skipped 1 previous similar message [ 5305.314497] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5305.316940] Lustre: Skipped 1 previous similar message [ 5309.407135] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 5309.505805] Lustre: server umount lustre-MDT0000 complete [ 5310.434421] LustreError: 227271:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5310.452220] LustreError: 227271:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 5311.950063] LustreError: 227256:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782485683 with bad export cookie 7739627041740929408 [ 5311.955064] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5311.972309] LustreError: 227256:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 5312.244818] Lustre: server umount lustre-MDT0001 complete [ 5323.896893] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing unload_modules_local [ 5328.485118] Key type lgssc unregistered [ 5328.809681] LNet: 232478:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5328.822565] LNetError: 232478:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5329.893275] LNet: Removed LNI 192.168.204.125@tcp [ 5330.844399] Key type .llcrypt unregistered [ 5330.846037] Key type ._llcrypt unregistered [ 5372.681464] Key type ._llcrypt registered [ 5372.686192] Key type .llcrypt registered [ 5372.805708] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 5374.156439] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5374.309192] alg: No test for adler32 (adler32-zlib) [ 5375.641412] Lustre: Lustre: Build Version: 2.17.54_95_ga6f956b [ 5376.036092] LNet: Added LNI 192.168.204.125@tcp [8/256/0/180] [ 5377.799375] Key type lgssc registered [ 5379.733796] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5390.241628] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5390.261982] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5392.023843] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5396.817278] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 5402.593071] LustreError: 234211:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5402.603423] LustreError: 234211:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 5405.923521] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5406.489619] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5411.071058] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 5413.549262] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 5419.171491] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5419.462435] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5425.063891] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 5432.165418] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5432.344955] Lustre: lustre-OST0001: new disk, initializing [ 5432.348795] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 5432.357759] Lustre: 236518:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 5432.457301] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 5437.508406] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 5437.518502] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 5437.540231] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 5437.635090] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 5438.645123] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49728) [ 5446.865310] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 5451.785048] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 5462.793406] Lustre: server umount lustre-MDT0000 complete [ 5463.009887] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5463.018058] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5463.027215] LustreError: 234211:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5464.546879] LustreError: 234212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5464.549852] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5464.560188] LustreError: 234212:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 5464.566447] Lustre: Skipped 1 previous similar message [ 5465.702630] LustreError: 234193:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782485836 with bad export cookie 18354540121117662119 [ 5465.707186] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5465.717780] LustreError: 234948:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0000-osp-MDT0001: osp_attr_get update error [0x200001b72:0x1:0x0]: rc = -5 [ 5465.717972] LustreError: 234948:0:(client.c:1380:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffffa08de15f1500 x1869071774735744/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-1.0' uid:0 gid:0 projid:4294967295 [ 5465.720265] LustreError: 234193:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 5466.073581] Lustre: server umount lustre-MDT0001 complete [ 5478.992622] Lustre: server umount lustre-OST0000 complete [ 5492.751810] Lustre: server umount lustre-OST0001 complete [ 5510.523963] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 5519.770878] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5520.294839] LustreError: 239627:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5520.355602] Lustre: mylustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5524.279797] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 5525.473745] LustreError: 239628:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5532.873982] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5533.317605] Lustre: mylustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5537.584869] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 5540.719146] Lustre: 240771:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 5547.762784] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5554.108680] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 5558.452539] LustreError: 241124:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5558.474487] Lustre: mylustre-OST0000: new connection from mylustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:100 to 0x280000400:129) [ 5558.477602] LustreError: 241124:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 5563.006813] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5563.396175] Lustre: mylustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 5563.399895] Lustre: Skipped 1 previous similar message [ 5565.446679] Lustre: mylustre-OST0000: new connection from mylustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49760) [ 5569.405728] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 5576.509624] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 5579.694876] Lustre: 242640:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 5589.317752] Lustre: server umount mylustre-MDT0000 complete [ 5589.474131] LustreError: mylustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5589.488284] Lustre: mylustre-MDT0000-osp-MDT0001: Connection to mylustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5589.513532] Lustre: Skipped 1 previous similar message [ 5589.524805] LustreError: 239627:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5593.519919] LustreError: 242642:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782485964 with bad export cookie 18354540121117664982 [ 5593.527204] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5593.537939] LustreError: 242642:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 5596.038953] Lustre: server umount mylustre-MDT0001 complete [ 5610.355056] Lustre: server umount mylustre-OST0000 complete [ 5612.511713] Lustre: 233474:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782485967/real 1782485967] req@ffffa08f01fd8a80 x1869071774795008/t0(0) o400->mylustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782485983 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 5612.541893] Lustre: mylustre-MDT0001-lwp-OST0001: Connection to mylustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5612.577530] Lustre: Skipped 3 previous similar messages [ 5614.368617] Lustre: 233472:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782485969/real 1782485969] req@ffffa08f01fd9500 x1869071774795264/t0(0) o400->mylustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782485985 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 5614.958342] Lustre: server umount mylustre-OST0001 complete [ 5637.137430] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 5648.489841] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5649.020360] LustreError: 244948:0:(ldlm_lib.c:1179:target_handle_connect()) tfs-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5649.053572] LustreError: 244948:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 4 previous similar messages [ 5649.120218] Lustre: tfs-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5654.445732] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 5662.458827] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5668.205778] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 5672.033540] Lustre: 246089:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 5680.605699] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5687.477619] Lustre: tfs-OST0000: new connection from tfs-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:100 to 0x280000400:161) [ 5688.916358] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 5693.950441] Lustre: tfs-OST0000: new connection from tfs-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49792) [ 5697.873088] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5703.163928] Lustre: tfs-OST0001: new connection from tfs-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:35 to 0x2c0000400:65) [ 5703.871406] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 5709.648606] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 5712.169525] Lustre: 247975:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 5718.521338] Lustre: tfs-MDT0000-lwp-OST0000: Connection to tfs-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5718.527596] Lustre: tfs-MDT0000: Not available for connect from 0@lo (stopping) [ 5718.537016] Lustre: Skipped 2 previous similar messages [ 5718.550161] Lustre: Skipped 3 previous similar messages [ 5723.619771] LustreError: 244943:0:(ldlm_lib.c:1179:target_handle_connect()) tfs-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5723.630505] LustreError: 244943:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 9 previous similar messages [ 5725.656655] Lustre: server umount tfs-MDT0000 complete [ 5728.976880] LustreError: 244924:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782486100 with bad export cookie 18354540121117666935 [ 5728.980858] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5728.986731] LustreError: 244924:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 5729.238895] Lustre: server umount tfs-MDT0001 complete [ 5742.122546] Lustre: server umount tfs-OST0000 complete [ 5755.321929] Lustre: server umount tfs-OST0001 complete [ 5770.457370] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 5777.303482] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5777.657222] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5777.662779] Lustre: Skipped 3 previous similar messages [ 5780.293188] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 5785.444599] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5788.482024] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 5790.368098] Lustre: 251364:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 5794.793852] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5799.114826] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 5800.447396] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:100 to 0x280000400:193) [ 5802.481218] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49824) [ 5804.898133] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5808.782400] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 5810.163142] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:35 to 0x2c0000400:97) [ 5813.809779] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 5816.148573] Lustre: 253236:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 5820.618313] Lustre: DEBUG MARKER: == conf-sanity test 104a: Make sure user defined options are reflected in mount ========================================================== 11:03:11 (1782486191) [ 5835.746347] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5835.749053] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5835.757208] Lustre: Skipped 4 previous similar messages [ 5835.763251] Lustre: Skipped 3 previous similar messages [ 5840.698994] Lustre: server umount lustre-MDT0000 complete [ 5842.545857] LustreError: 253238:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782486213 with bad export cookie 18354540121117668853 [ 5842.549833] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5842.551273] LustreError: 253238:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 5845.986311] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 5845.990201] Lustre: Skipped 1 previous similar message [ 5848.038467] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 5848.045258] Lustre: Skipped 1 previous similar message [ 5848.828816] Lustre: server umount lustre-MDT0001 complete [ 5857.172231] Lustre: server umount lustre-OST0000 complete [ 5865.713769] Lustre: server umount lustre-OST0001 complete [ 5869.832885] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_hostid [ 5876.609628] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 5900.880620] LDISKFS-fs (dm-0): Mount option "noacl" will be removed by 3.5 [ 5900.880620] Contact linux-ldiskfs@vger.kernel.org if you think we should keep it. [ 5900.880620] [ 5900.899897] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: acl,user_xattr,errors=remount-ro,noacl,no_mbcache,nodelalloc [ 5901.043598] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 5901.063387] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 5901.106376] Lustre: lustre-MDT0000: new disk, initializing [ 5901.176718] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 5903.654389] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 5910.164761] LDISKFS-fs (dm-1): Mount option "noacl" will be removed by 3.5 [ 5910.164761] Contact linux-ldiskfs@vger.kernel.org if you think we should keep it. [ 5910.164761] [ 5910.174775] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: acl,user_xattr,errors=remount-ro,noacl,no_mbcache,nodelalloc [ 5910.243652] Lustre: 256414:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 5910.286955] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 5910.290115] Lustre: Skipped 1 previous similar message [ 5910.335648] Lustre: lustre-MDT0001: new disk, initializing [ 5910.384631] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5910.387763] Lustre: Skipped 4 previous similar messages [ 5910.410746] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 5910.417747] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 5912.711432] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 5919.603135] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5919.776654] Lustre: lustre-OST0000: new disk, initializing [ 5919.779637] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 5919.784652] Lustre: 257999:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 5920.986529] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 5920.993137] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 5921.065087] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 5923.938335] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 5931.764932] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5931.921448] Lustre: lustre-OST0001: new disk, initializing [ 5931.926232] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 5931.930751] Lustre: 258868:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 5933.359385] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 5933.367214] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 5933.453631] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 5936.651268] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 5944.361777] Lustre: DEBUG MARKER: == conf-sanity test 104b: Mount uses last flock argument ========================================================== 11:05:14 (1782486314) [ 5953.130796] Lustre: DEBUG MARKER: == conf-sanity test 105: check file creation for ro and rw bind mnt pt ========================================================== 11:05:23 (1782486323) [ 5967.329366] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 5967.333279] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5967.335768] LustreError: Skipped 1 previous similar message [ 5967.336690] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5967.368393] Lustre: Skipped 3 previous similar messages [ 5972.208517] Lustre: server umount lustre-OST0000 complete [ 5974.506029] LustreError: 257981:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5974.518380] LustreError: 257981:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 21 previous similar messages [ 5977.056995] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5977.061845] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5977.064996] Lustre: Skipped 3 previous similar messages [ 5989.344458] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 5989.452044] Lustre: server umount lustre-MDT0000 complete [ 5991.619736] LustreError: 256407:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782486362 with bad export cookie 18354540121117670631 [ 5991.625867] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5991.630355] LustreError: 256407:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 5994.977751] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 5994.982763] Lustre: Skipped 6 previous similar messages [ 5997.885639] Lustre: server umount lustre-MDT0001 complete [ 6004.702240] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing unload_modules_local [ 6026.207123] Lustre: lustre-OST0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 6026.345564] Lustre: server umount lustre-OST0001 complete [ 6030.261164] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_hostid [ 6039.744744] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 6059.669896] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6059.828532] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 6059.846874] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 6059.904769] Lustre: lustre-MDT0000: new disk, initializing [ 6059.964828] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 6062.598729] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6069.383815] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6069.450683] Lustre: 263401:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 6069.636909] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 6072.355506] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6078.219592] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 6081.459025] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 6085.511613] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6085.683947] Lustre: lustre-OST0000: new disk, initializing [ 6085.688640] Lustre: Skipped 1 previous similar message [ 6085.691701] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 6085.697067] Lustre: Skipped 2 previous similar messages [ 6085.701207] Lustre: 265369:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 6087.069388] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 6087.075112] Lustre: Skipped 1 previous similar message [ 6087.079234] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 6087.143524] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 6089.305164] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6095.052784] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 6102.498216] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6102.498469] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 6102.504194] Lustre: Skipped 4 previous similar messages [ 6102.509176] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6102.514421] Lustre: Skipped 2 previous similar messages [ 6105.279655] Lustre: server umount lustre-OST0000 complete [ 6113.661873] Lustre: server umount lustre-MDT0000 complete [ 6116.096737] LustreError: 263393:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782486487 with bad export cookie 18354540121117672101 [ 6116.101835] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6116.104804] LustreError: 263393:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 6116.312983] Lustre: server umount lustre-MDT0001 complete [ 6122.762427] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing unload_modules_local [ 6124.586893] Key type lgssc unregistered [ 6124.800236] LNet: 267133:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6124.808194] LNetError: 267133:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6124.820154] LNet: Removed LNI 192.168.204.125@tcp [ 6125.325220] Key type .llcrypt unregistered [ 6125.328180] Key type ._llcrypt unregistered [ 6140.857307] Key type ._llcrypt registered [ 6140.859650] Key type .llcrypt registered [ 6140.932317] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 6141.551325] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6141.564258] alg: No test for adler32 (adler32-zlib) [ 6142.510229] Lustre: Lustre: Build Version: 2.17.54_95_ga6f956b [ 6142.683224] LNet: Added LNI 192.168.204.125@tcp [8/256/0/180] [ 6144.312455] Key type lgssc registered [ 6144.991357] Lustre: Echo OBD driver; http://www.lustre.org/ [ 6149.536123] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 6149.549438] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6150.826645] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6153.316868] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6158.241238] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6158.435401] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6160.537496] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6164.241311] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 6166.979713] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 6170.671777] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6170.875506] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6173.922698] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6174.954556] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:33) [ 6177.820981] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 6178.300895] Lustre: Setting parameter lustre-OST0000.ost.unknown_param=50 in log lustre-OST0000 [ 6180.326804] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6180.327445] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 6180.340165] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6181.422221] Lustre: server umount lustre-OST0000 complete [ 6183.907301] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 6183.915074] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6183.924115] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6188.512938] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6188.515869] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6189.678244] Lustre: server umount lustre-MDT0000 complete [ 6191.398526] LustreError: 268556:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782486562 with bad export cookie 8451919178137517021 [ 6191.402658] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6191.404396] LustreError: 268556:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 6191.549196] Lustre: server umount lustre-MDT0001 complete [ 6196.905553] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing unload_modules_local [ 6198.352722] Key type lgssc unregistered [ 6198.519023] LNet: 272151:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6198.522572] LNetError: 272151:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6198.543594] LNet: Removed LNI 192.168.204.125@tcp [ 6198.952695] Key type .llcrypt unregistered [ 6198.955602] Key type ._llcrypt unregistered [ 6207.850639] Key type ._llcrypt registered [ 6207.852466] Key type .llcrypt registered [ 6207.909717] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 6208.258266] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6208.281391] alg: No test for adler32 (adler32-zlib) [ 6209.178924] Lustre: Lustre: Build Version: 2.17.54_95_ga6f956b [ 6209.300311] LNet: Added LNI 192.168.204.125@tcp [8/256/0/180] [ 6210.911486] Key type lgssc registered [ 6211.582615] Lustre: Echo OBD driver; http://www.lustre.org/ [ 6216.531741] Lustre: lustre-OST0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 6216.555679] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6232.031960] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 6237.151766] LustreError: 273321:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.204.125@tcp: failed processing log, type 4: rc = -110 [ 6263.775192] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6267.087597] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6271.074893] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 6272.245888] Lustre: server umount lustre-OST0000 complete [ 6283.318870] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing unload_modules_local [ 6287.144312] Key type lgssc unregistered [ 6287.602611] LNet: 274952:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6287.613156] LNetError: 274952:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6287.633857] LNet: Removed LNI 192.168.204.125@tcp [ 6288.853805] Key type .llcrypt unregistered [ 6288.858154] Key type ._llcrypt unregistered [ 6338.535986] Key type ._llcrypt registered [ 6338.537349] Key type .llcrypt registered [ 6338.744444] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 6340.281954] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6340.295808] alg: No test for adler32 (adler32-zlib) [ 6341.585743] Lustre: Lustre: Build Version: 2.17.54_95_ga6f956b [ 6341.772101] LNet: Added LNI 192.168.204.125@tcp [8/256/0/180] [ 6343.425912] Key type lgssc registered [ 6344.820719] Lustre: Echo OBD driver; http://www.lustre.org/ [ 6363.728234] loop0: detected capacity change from 0 to 204800000 [ 6364.026285] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 6364.041960] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 6364.656629] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 6365.980562] loop0: detected capacity change from 0 to 204800000 [ 6366.213678] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 6366.239811] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 6366.559791] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 6368.044426] loop0: detected capacity change from 0 to 204800000 [ 6368.255371] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 6368.280032] blk_update_request: operation not supported error, dev loop0, sector 8224 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 6368.429120] blk_update_request: operation not supported error, dev loop0, sector 58264 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 6370.044254] loop0: detected capacity change from 0 to 204800000 [ 6370.454830] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 6370.479986] blk_update_request: operation not supported error, dev loop0, sector 8224 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 6370.694412] blk_update_request: operation not supported error, dev loop0, sector 58264 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 6372.228417] loop0: detected capacity change from 0 to 204800000 [ 6372.267029] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 6376.763186] loop0: detected capacity change from 0 to 204800000 [ 6376.822187] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 6380.406049] loop0: detected capacity change from 0 to 204800000 [ 6380.443995] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 6384.035637] loop0: detected capacity change from 0 to 204800000 [ 6384.062565] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 6387.284933] loop0: detected capacity change from 0 to 204800000 [ 6387.356686] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 6387.401962] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6387.478270] Lustre: 278365:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 6387.485477] Lustre: 278365:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index 'nodemap' with [0x200000003:0x3:0x0]: rc = 0 [ 6387.492608] Lustre: 278365:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000003:0xa:0x0]: rc = 0 [ 6387.499657] Lustre: 278365:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000-MDT0000' with [0x200000005:0x2:0x0]: rc = 0 [ 6387.506857] Lustre: 278365:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000003:0xc:0x0]: rc = 0 [ 6387.513685] Lustre: 278365:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000003:0xb:0x0]: rc = 0 [ 6387.522510] Lustre: 278365:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000-MDT0000' with [0x200000005:0x1:0x0]: rc = 0 [ 6387.534899] Lustre: 278365:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000-MDT0000' with [0x200000005:0x3:0x0]: rc = 0 [ 6387.545539] Lustre: 278365:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1020000' with [0x200000006:0x1020000:0x0]: rc = 0 [ 6387.562845] Lustre: 278365:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x20000' with [0x200000006:0x20000:0x0]: rc = 0 [ 6387.578171] Lustre: 278365:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2020000' with [0x200000006:0x2020000:0x0]: rc = 0 [ 6387.586190] Lustre: 278365:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000006:0x10000:0x0]: rc = 0 [ 6387.600775] Lustre: 278365:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000006:0x2010000:0x0]: rc = 0 [ 6387.619559] Lustre: 278365:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000006:0x1010000:0x0]: rc = 0 [ 6392.456672] Lustre: server umount MGS complete [ 6393.159116] loop0: detected capacity change from 0 to 204800000 [ 6393.280315] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6393.672781] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6393.707959] Lustre: lustre-MDT0000: Aborting client recovery [ 6393.735483] LustreError: 278740:0:(lod_dev.c:511:lod_sub_recovery_thread()) lustre-MDT0000-osd: get update log duration 0, retries 0, failed: rc = -108 [ 6394.380418] loop1: detected capacity change from 0 to 204800000 [ 6394.483377] LDISKFS-fs (loop1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6394.556376] Lustre: 278797:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 6394.570486] Lustre: 278797:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x10000' with [0x200000003:0x4:0x0]: rc = 0 [ 6394.577266] Lustre: 278797:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x10000-MDT0001' with [0x200000005:0x1:0x0]: rc = 0 [ 6394.583170] Lustre: 278797:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x2010000-MDT0001' with [0x200000005:0x3:0x0]: rc = 0 [ 6394.590469] Lustre: 278797:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x2010000' with [0x200000003:0x6:0x0]: rc = 0 [ 6394.609796] Lustre: 278797:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x1010000-MDT0001' with [0x200000005:0x2:0x0]: rc = 0 [ 6394.624094] Lustre: 278797:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x1010000' with [0x200000003:0x5:0x0]: rc = 0 [ 6394.645144] Lustre: Found index 1 for lustre-MDT0001, updating log [ 6394.783210] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6394.843559] Lustre: lustre-MDT0001: Aborting client recovery [ 6395.591549] loop2: detected capacity change from 0 to 204800000 [ 6395.677284] LDISKFS-fs (loop2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6395.728179] Lustre: 278876:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 6395.742447] Lustre: 278876:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x1020000-OST0000' with [0x200000005:0x2:0x0]: rc = 0 [ 6395.750776] Lustre: 278876:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 6395.757795] Lustre: 278876:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x2020000-OST0000' with [0x200000005:0x3:0x0]: rc = 0 [ 6395.776570] Lustre: 278876:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 6395.787474] Lustre: 278876:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x20000-OST0000' with [0x200000005:0x1:0x0]: rc = 0 [ 6395.797222] Lustre: 278876:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 6395.878357] Lustre: Found index 0 for lustre-OST0000, updating log [ 6395.899540] Lustre: 278895:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 6395.932694] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6395.961246] Lustre: lustre-OST0000: Aborting recovery [ 6396.801883] loop3: detected capacity change from 0 to 204800000 [ 6396.914088] LDISKFS-fs (loop3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6396.963781] Lustre: 278960:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 6396.976814] Lustre: 278960:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x20000-OST0001' with [0x200000005:0x1:0x0]: rc = 0 [ 6396.990036] Lustre: 278960:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 6396.999803] Lustre: 278960:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 6397.019727] Lustre: 278960:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x1020000-OST0001' with [0x200000005:0x2:0x0]: rc = 0 [ 6397.031401] Lustre: 278960:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 6397.043239] Lustre: 278960:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x2020000-OST0001' with [0x200000005:0x3:0x0]: rc = 0 [ 6397.068083] Lustre: Found index 1 for lustre-OST0001, updating log [ 6397.090761] Lustre: 278966:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 6397.131612] Lustre: lustre-OST0001: Aborting recovery [ 6402.552531] LustreError: 278741:0:(lod_dev.c:511:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 9, retries 0, failed: rc = -108 [ 6403.557051] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 6403.561241] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 6403.590175] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000bd0 [ 6403.604278] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000bd0 [ 6404.580499] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:5 to 0x2c0000400:33) [ 6404.580933] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:5 to 0x280000400:33) [ 6405.019578] LustreError: 278708:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0000: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0000 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0000/identity_upcall, time 582us: rc = -2 [ 6405.525325] LustreError: 278706:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0000: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0000 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0000/identity_upcall, time 1015us: rc = -2 [ 6405.539535] LustreError: 278706:0:(mdt_identity.c:115:mdt_identity_do_upcall()) Skipped 31 previous similar messages [ 6419.940153] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6419.942926] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6419.953791] Lustre: Skipped 1 previous similar message [ 6423.476629] Lustre: server umount lustre-MDT0000 complete [ 6424.211908] LustreError: 278802:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782486795 with bad export cookie 8649670992508938972 [ 6424.217818] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6424.224236] LustreError: 278802:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 6425.060426] LustreError: 278707:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6425.063578] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6425.089234] LustreError: 278707:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 6425.105162] Lustre: Skipped 2 previous similar messages [ 6425.109685] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 6425.112494] Lustre: Skipped 3 previous similar messages [ 6429.090267] LustreError: 278707:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6429.091561] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 6429.114912] Lustre: Skipped 1 previous similar message [ 6430.537372] Lustre: server umount lustre-MDT0001 complete [ 6437.419952] Lustre: server umount lustre-OST0000 complete [ 6444.473705] Lustre: server umount lustre-OST0001 complete [ 6451.217377] Lustre: DEBUG MARKER: == conf-sanity test 109a: test lctl clear_conf fsname ==== 11:13:41 (1782486821) [ 6472.736454] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_hostid [ 6480.223429] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 6507.651893] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6507.842697] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 6507.860582] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 6507.925802] Lustre: lustre-MDT0000: new disk, initializing [ 6507.971636] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6507.976192] Lustre: Skipped 1 previous similar message [ 6507.988847] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 6511.543158] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6519.882811] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6519.988184] Lustre: 283037:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 6520.039881] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 6520.043157] Lustre: Skipped 1 previous similar message [ 6520.098419] Lustre: lustre-MDT0001: new disk, initializing [ 6520.174467] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6520.209708] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 6520.222325] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 6523.209525] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6530.385678] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 6535.253667] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 6541.278774] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6541.521539] Lustre: lustre-OST0000: new disk, initializing [ 6541.523807] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 6541.528457] Lustre: 285005:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 6541.610533] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6546.718639] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6549.042331] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 6549.054559] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 6549.153618] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 6554.498850] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 6559.202447] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 6571.050069] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 6577.611245] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 6616.042329] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 6616.048995] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6616.057984] Lustre: Skipped 1 previous similar message [ 6616.061944] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6616.066168] Lustre: Skipped 1 previous similar message [ 6621.155056] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6621.164535] Lustre: Skipped 1 previous similar message [ 6629.343365] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 6629.553396] Lustre: server umount lustre-OST0000 complete [ 6632.928536] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 6632.939222] LustreError: Skipped 1 previous similar message [ 6632.949919] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6632.969272] Lustre: Skipped 1 previous similar message [ 6632.974482] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6632.979637] Lustre: Skipped 2 previous similar messages [ 6639.068945] Lustre: server umount lustre-MDT0000 complete [ 6641.634292] LustreError: 284262:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6641.653663] LustreError: 284262:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 6642.288896] LustreError: 286550:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782487013 with bad export cookie 8649670992508941674 [ 6642.289604] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6642.298494] LustreError: 286550:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 6642.651816] Lustre: server umount lustre-MDT0001 complete [ 6649.854044] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6653.320382] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6656.981970] Lustre: server umount MGS complete [ 6666.592899] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6667.006871] LustreError: 288964:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6667.027866] LustreError: 288977:0:(qmt_pool.c:1645:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 6667.085142] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6670.737369] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6672.359236] LustreError: 288965:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6677.585730] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6681.383208] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6687.024308] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 6691.787690] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 6696.871626] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6702.262636] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6707.589527] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 6738.402524] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 6738.404371] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6738.407468] LustreError: Skipped 1 previous similar message [ 6738.408234] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6738.417655] Lustre: Skipped 2 previous similar messages [ 6738.427886] Lustre: Skipped 3 previous similar messages [ 6740.144212] Lustre: server umount lustre-OST0000 complete [ 6756.319145] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 6756.400150] Lustre: server umount lustre-MDT0000 complete [ 6757.857428] LustreError: 290454:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6757.864853] LustreError: 290454:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 6758.269543] LustreError: 288944:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782487129 with bad export cookie 8649670992508943508 [ 6758.274689] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6758.280196] LustreError: 288944:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 6758.453194] Lustre: server umount lustre-MDT0001 complete [ 6763.655555] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing unload_modules_local [ 6765.062652] Key type lgssc unregistered [ 6765.223397] LNet: 292908:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6765.227977] LNetError: 292908:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6765.237640] LNet: Removed LNI 192.168.204.125@tcp [ 6765.652198] Key type .llcrypt unregistered [ 6765.654771] Key type ._llcrypt unregistered [ 6782.163697] Key type ._llcrypt registered [ 6782.165021] Key type .llcrypt registered [ 6782.224149] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_hostid [ 6789.670897] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 6790.054740] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6790.062180] alg: No test for adler32 (adler32-zlib) [ 6790.952273] Lustre: Lustre: Build Version: 2.17.54_95_ga6f956b [ 6791.056918] LNet: Added LNI 192.168.204.125@tcp [8/256/0/180] [ 6792.647166] Key type lgssc registered [ 6793.210387] Lustre: Echo OBD driver; http://www.lustre.org/ [ 6809.622060] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 6809.630445] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6810.732557] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 6810.750496] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 6810.789995] Lustre: lustre-MDT0000: new disk, initializing [ 6810.828819] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6810.858133] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 6812.589838] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6817.978422] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6818.055444] Lustre: 296855:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 6818.101965] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 6818.108448] Lustre: Skipped 1 previous similar message [ 6818.159141] Lustre: lustre-MDT0001: new disk, initializing [ 6818.223195] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6818.246572] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 6818.254287] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 6820.373040] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6825.510353] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 6828.046989] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 6831.031793] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6831.160731] Lustre: lustre-OST0000: new disk, initializing [ 6831.164345] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 6831.168188] Lustre: 298824:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 6831.215378] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6833.697915] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6838.058264] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 6838.278767] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 6838.285289] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 6838.337930] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 6847.451175] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 6854.848568] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 6864.219259] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 6899.681570] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 6899.682091] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6899.685259] LustreError: Skipped 1 previous similar message [ 6899.685908] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6899.694042] Lustre: Skipped 1 previous similar message [ 6904.802930] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6904.806323] Lustre: Skipped 2 previous similar messages [ 6905.370367] Lustre: server umount lustre-OST0000 complete [ 6909.920649] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6909.921295] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6909.926322] Lustre: Skipped 1 previous similar message [ 6915.040025] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6915.042368] Lustre: Skipped 2 previous similar messages [ 6920.160683] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6920.166991] Lustre: Skipped 1 previous similar message [ 6921.183130] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 6921.260653] Lustre: server umount lustre-MDT0000 complete [ 6922.823232] LustreError: 299678:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782487293 with bad export cookie 11198224562162807312 [ 6922.827273] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6922.828643] LustreError: 299678:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 6922.969143] Lustre: server umount lustre-MDT0001 complete [ 6926.483762] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6928.234270] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6930.462872] Lustre: server umount MGS complete [ 6935.512359] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6935.756655] LustreError: 302886:0:(qmt_pool.c:1645:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 6935.788636] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6937.583796] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6941.152117] LustreError: 302874:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6941.159810] LustreError: 302874:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 6941.289410] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6941.475753] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6943.158532] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6946.319455] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 6948.414348] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 6951.428780] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6951.587444] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6954.130452] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 6957.609897] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 6976.481842] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 6976.482158] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6976.486829] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6976.493745] Lustre: Skipped 1 previous similar message [ 6982.111871] Lustre: server umount lustre-OST0000 complete [ 6986.720916] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6986.727301] Lustre: Skipped 1 previous similar message [ 6996.961815] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6996.966507] Lustre: Skipped 8 previous similar messages [ 6997.983593] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 6998.051024] Lustre: server umount lustre-MDT0000 complete [ 6999.656484] LustreError: 305712:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782487370 with bad export cookie 11198224562162809125 [ 6999.658158] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6999.661921] LustreError: 305712:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 6999.798222] Lustre: server umount lustre-MDT0001 complete [ 7003.900709] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing unload_modules_local [ 7005.160961] Key type lgssc unregistered [ 7005.330549] LNet: 306818:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7005.335905] LNetError: 306818:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7005.348402] LNet: Removed LNI 192.168.204.125@tcp [ 7005.722080] Key type .llcrypt unregistered [ 7005.723537] Key type ._llcrypt unregistered [ 7014.292954] Key type ._llcrypt registered [ 7014.295185] Key type .llcrypt registered [ 7014.340496] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_hostid [ 7021.136710] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 7021.699829] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7021.717093] alg: No test for adler32 (adler32-zlib) [ 7022.613113] Lustre: Lustre: Build Version: 2.17.54_95_ga6f956b [ 7022.714393] LNet: Added LNI 192.168.204.125@tcp [8/256/0/180] [ 7024.311332] Key type lgssc registered [ 7024.856879] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7036.340289] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 7042.597677] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7042.606970] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7043.715142] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 7043.738155] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 7043.785048] Lustre: lustre-MDT0000: new disk, initializing [ 7043.823408] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7043.836234] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 7045.559279] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 7050.505045] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7050.669572] Lustre: lustre-OST0000: new disk, initializing [ 7050.672798] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 7050.676299] Lustre: Skipped 1 previous similar message [ 7050.682604] Lustre: 310842:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 7050.722249] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7053.472418] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 7056.392363] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 7056.395969] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 7056.412968] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 7394.273479] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7394.286974] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7399.246529] Lustre: server umount lustre-MDT0000 complete [ 7404.213516] LustreError: 310030:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782487775 with bad export cookie 3510904828147629767 [ 7404.223310] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7404.251993] LustreError: 310030:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 7404.602641] Lustre: server umount lustre-OST0000 complete [ 7454.084385] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_hostid [ 7468.557521] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 7514.735302] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7515.033641] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 7515.074567] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 7515.125689] Lustre: lustre-MDT0000: new disk, initializing [ 7515.199425] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7515.218058] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 7519.632492] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 7528.692543] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7528.820537] Lustre: 315120:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 7528.887744] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 7528.892122] Lustre: Skipped 1 previous similar message [ 7528.964327] Lustre: lustre-MDT0001: new disk, initializing [ 7529.064578] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7529.111152] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 7529.126226] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 7533.533128] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 7542.063793] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 7547.384367] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 7553.921385] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7554.258271] Lustre: lustre-OST0000: new disk, initializing [ 7554.264581] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 7554.274836] Lustre: 317089:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 7554.380817] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7561.233762] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 7561.786166] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 7561.794242] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 7561.871720] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 7570.526890] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7575.861395] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 7576.086556] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 7580.980180] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 7581.333207] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 7587.812705] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 7587.814706] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7587.836368] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7587.863058] Lustre: Skipped 1 previous similar message [ 7587.880187] Lustre: Skipped 1 previous similar message [ 7589.541524] Lustre: server umount lustre-OST0000 complete [ 7595.493380] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7595.506689] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7595.549638] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7598.050109] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7598.050977] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7599.962149] Lustre: server umount lustre-MDT0000 complete [ 7603.691018] LustreError: 315924:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782487974 with bad export cookie 3510904828150570558 [ 7603.703658] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7603.706593] LustreError: 315924:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 7604.028293] Lustre: server umount lustre-MDT0001 complete [ 7607.198575] Lustre: DEBUG MARKER: SKIP: conf-sanity test_111 skipping SLOW test 111 [ 7608.945331] Lustre: DEBUG MARKER: == conf-sanity test 112a: mount OST with no_create option ========================================================== 11:32:58 (1782487978) [ 7615.585870] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7616.028359] LustreError: 319399:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7616.046905] LustreError: 319399:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 7616.128544] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7620.516112] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 7621.601824] LustreError: 319400:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7626.729182] LustreError: 319399:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7628.233391] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7633.071227] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 7640.831632] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 7646.054463] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 7653.035901] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7653.404853] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7653.411860] Lustre: Skipped 1 previous similar message [ 7659.166655] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 7666.042350] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7673.067209] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7673.230886] Lustre: lustre-OST0001: new disk, initializing [ 7673.235725] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 7673.246941] Lustre: 322235:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 7679.363525] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 7681.594296] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 7681.606132] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 7681.673885] LustreError: 322701:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [ 7681.695835] LustreError: 322701:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 1 previous similar message [ 7682.728822] LustreError: 322701:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [ 7682.743319] LustreError: 322701:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 1 previous similar message [ 7683.748894] LustreError: 322697:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 7685.857043] LustreError: 322697:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 7685.870274] LustreError: 322697:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 4 previous similar messages [ 7688.909347] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 7689.178376] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 7690.017282] LustreError: 322697:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 7690.038266] LustreError: 322697:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 7 previous similar messages [ 7694.787537] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8b5b86bd1000.ost_server_uuid 50 [ 7696.362664] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff8b5b86bd1000.ost_server_uuid in FULL state after 0 sec [ 7698.275126] LustreError: 322697:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 7698.286075] LustreError: 322697:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 14 previous similar messages [ 7701.789608] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8b5b86bd1000.ost_server_uuid 50 [ 7703.097778] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-ffff8b5b86bd1000.ost_server_uuid in FULL state after 0 sec [ 7704.523797] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 7719.905428] LustreError: lustre-OST0001-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 7719.914980] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7719.921405] LustreError: Skipped 1 previous similar message [ 7719.922429] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 7719.945040] Lustre: Skipped 1 previous similar message [ 7719.982405] Lustre: Skipped 2 previous similar messages [ 7724.330734] Lustre: server umount lustre-OST0001 complete [ 7725.348097] LustreError: 322243:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 192.168.204.25@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7730.146177] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 7730.153913] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7730.178634] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7730.186214] Lustre: Skipped 3 previous similar messages [ 7733.223818] LustreError: 321223:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7733.241045] LustreError: 321223:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 7736.263210] Lustre: server umount lustre-OST0000 complete [ 7741.411788] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7741.415624] LustreError: Skipped 1 previous similar message [ 7746.689866] Lustre: server umount lustre-MDT0000 complete [ 7748.584115] LustreError: 320415:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7748.623384] LustreError: 320415:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 7751.144778] LustreError: 323885:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782488122 with bad export cookie 3510904828150571440 [ 7751.156057] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7751.166901] LustreError: 323885:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 7751.711032] Lustre: server umount lustre-MDT0001 complete [ 7762.129781] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing unload_modules_local [ 7764.619052] Key type lgssc unregistered [ 7764.979197] LNet: 324928:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7764.989470] LNetError: 324928:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7765.005180] LNet: Removed LNI 192.168.204.125@tcp [ 7765.917091] Key type .llcrypt unregistered [ 7765.918707] Key type ._llcrypt unregistered [ 7788.349862] Key type ._llcrypt registered [ 7788.352791] Key type .llcrypt registered [ 7788.444493] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 7789.499625] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7789.537836] alg: No test for adler32 (adler32-zlib) [ 7790.750535] Lustre: Lustre: Build Version: 2.17.54_95_ga6f956b [ 7791.038134] LNet: Added LNI 192.168.204.125@tcp [8/256/0/180] [ 7792.751775] Key type lgssc registered [ 7794.024373] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7801.842582] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7801.875292] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7803.462857] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7808.376224] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 7813.602285] LustreError: 326347:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7813.628845] LustreError: 326347:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 7815.637969] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 7818.733638] LustreError: 326348:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7823.098424] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7823.497928] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7828.505205] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 7838.695935] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7839.030500] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7845.499209] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 7848.240446] LustreError: 328028:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7848.264955] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:65) [ 7848.266354] LustreError: 328028:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 7853.351392] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7853.567976] LustreError: 328029:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7858.659914] LustreError: 328029:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7858.686075] LustreError: 328029:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 7860.059764] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7860.441718] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 7865.861746] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:33) [ 7866.978519] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 7875.661952] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 7883.358075] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing wait_import_state (FULL|IDLE) os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [ 7883.746574] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 7998.949511] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7998.964199] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 7998.983419] LustreError: lustre-OST0001-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 8002.834318] Lustre: server umount lustre-OST0001 complete [ 8004.076218] LustreError: 328509:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8004.123818] LustreError: 328509:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 8009.185989] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8009.191497] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8009.209502] Lustre: Skipped 2 previous similar messages [ 8009.221990] Lustre: Skipped 2 previous similar messages [ 8014.310815] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8014.321805] Lustre: Skipped 1 previous similar message [ 8014.744398] Lustre: server umount lustre-OST0000 complete [ 8023.021164] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8023.030393] LustreError: Skipped 1 previous similar message [ 8023.034577] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8023.044732] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8026.832337] Lustre: server umount lustre-MDT0000 complete [ 8029.675228] LustreError: 326348:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8029.714366] LustreError: 326348:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 5 previous similar messages [ 8033.297407] LustreError: 330031:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782488404 with bad export cookie 4725414641561869062 [ 8033.304433] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8033.334063] LustreError: 330031:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 8034.560867] Lustre: server umount lustre-MDT0001 complete [ 8046.810200] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing unload_modules_local [ 8050.373870] Key type lgssc unregistered [ 8050.729944] LNet: 331294:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8050.733969] LNetError: 331294:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8051.760632] LNet: Removed LNI 192.168.204.125@tcp [ 8052.799752] Key type .llcrypt unregistered [ 8052.801592] Key type ._llcrypt unregistered [ 8105.853344] Key type ._llcrypt registered [ 8105.856248] Key type .llcrypt registered [ 8105.960447] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 8107.503206] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8107.537865] alg: No test for adler32 (adler32-zlib) [ 8108.804164] Lustre: Lustre: Build Version: 2.17.54_95_ga6f956b [ 8108.996131] LNet: Added LNI 192.168.204.125@tcp [8/256/0/180] [ 8110.631323] Key type lgssc registered [ 8112.061823] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8122.104239] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 8122.139347] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8123.545625] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8126.667441] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8132.451821] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8132.746731] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8135.938495] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8137.786341] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 8141.539204] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8141.765842] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8142.827803] LustreError: 335078:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8142.847387] LustreError: 335078:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 8145.003125] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8147.937664] LustreError: 335079:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8147.951033] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:97) [ 8147.951283] LustreError: 335079:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 8149.880751] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8150.025630] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 8153.500754] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8155.121575] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:65) [ 8159.404261] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 8164.379933] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 8173.537230] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8173.542776] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8173.555557] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8175.585946] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8175.592667] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8175.603095] Lustre: Skipped 1 previous similar message [ 8177.866612] Lustre: server umount lustre-MDT0000 complete [ 8179.713601] LustreError: 333571:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782488550 with bad export cookie 6340087790344324423 [ 8179.715140] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8179.721097] LustreError: 333571:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 8179.901217] Lustre: server umount lustre-MDT0001 complete [ 8192.152502] Lustre: server umount lustre-OST0000 complete [ 8204.578726] Lustre: server umount lustre-OST0001 complete [ 8211.746706] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 8215.464207] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8215.607493] LustreError: 338850:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8215.624778] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8217.117167] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8220.340651] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8222.053723] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8223.157705] Lustre: 339992:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 8225.490521] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8225.620826] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8225.623745] Lustre: Skipped 1 previous similar message [ 8226.659725] LustreError: 340344:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8226.663543] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:129) [ 8227.582806] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8230.591647] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8231.725929] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:97) [ 8232.847516] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8236.087371] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 8237.323514] Lustre: 341860:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 8241.119982] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8241.122384] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8241.126345] Lustre: Skipped 1 previous similar message [ 8241.128109] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8241.130086] Lustre: Skipped 3 previous similar messages [ 8244.508883] Lustre: server umount lustre-MDT0000 complete [ 8245.776824] LustreError: 341873:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782488616 with bad export cookie 6340087790344326131 [ 8245.779569] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8245.781078] LustreError: 341873:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 8245.894319] Lustre: server umount lustre-MDT0001 complete [ 8257.478540] Lustre: server umount lustre-OST0000 complete [ 8267.992858] Lustre: server umount lustre-OST0001 complete [ 8269.169028] Lustre: DEBUG MARKER: SKIP: conf-sanity test_114 skipping SLOW test 114 [ 8269.695235] Lustre: DEBUG MARKER: SKIP: conf-sanity test_115 skipping excluded test 115 [ 8270.304872] Lustre: DEBUG MARKER: == conf-sanity test 116: big size MDT support ============ 11:44:01 (1782488641) [ 8278.028532] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 8281.268682] loop0: detected capacity change from 0 to 1099511627776 [ 8281.425477] SGI XFS with ACLs, security attributes, quota, no debug enabled [ 8281.428844] *** VALIDATE xfs *** [ 8281.434359] XFS (loop0): Mounting V5 Filesystem [ 8281.442953] XFS (loop0): Ending clean mount [ 8281.915436] loop1: detected capacity change from 0 to 18691697672192 [ 8304.334659] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_hostid [ 8307.844600] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 8320.171984] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8320.255749] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 8320.269401] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 8320.306292] Lustre: lustre-MDT0000: new disk, initializing [ 8320.331248] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8320.334262] Lustre: Skipped 1 previous similar message [ 8320.340213] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 8321.715903] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8326.267386] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8326.313845] Lustre: 346971:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8326.339057] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 8326.341518] Lustre: Skipped 1 previous similar message [ 8326.379953] Lustre: lustre-MDT0001: new disk, initializing [ 8326.444178] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 8326.449350] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 8327.993390] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8331.894594] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8333.804285] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8336.368882] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8336.474654] Lustre: lustre-OST0000: new disk, initializing [ 8336.476618] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 8336.480484] Lustre: 348938:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8337.532834] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 8337.537291] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 8337.575296] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 8338.516629] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8342.521251] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8344.057985] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 8344.150291] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 8345.692491] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 8345.768557] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 8348.130204] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 8348.130692] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8348.135926] Lustre: Skipped 3 previous similar messages [ 8348.138058] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8348.139795] Lustre: Skipped 5 previous similar messages [ 8348.495398] Lustre: server umount lustre-OST0000 complete [ 8352.223944] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8352.227348] LustreError: Skipped 1 previous similar message [ 8352.229179] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8352.233939] Lustre: Skipped 1 previous similar message [ 8352.236913] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8363.488262] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8363.490427] Lustre: Skipped 5 previous similar messages [ 8363.999111] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 8364.061443] Lustre: server umount lustre-MDT0000 complete [ 8365.315352] LustreError: 346963:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782488736 with bad export cookie 6340087790344327664 [ 8365.318806] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8365.319269] LustreError: 346963:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 8365.440689] Lustre: server umount lustre-MDT0001 complete [ 8369.528755] XFS (loop0): Unmounting Filesystem [ 8371.453065] Lustre: DEBUG MARKER: == conf-sanity test 117: lctl get_param return errors properly ========================================================== 11:45:42 (1782488742) [ 8375.072153] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8375.416647] LustreError: 351496:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8375.510853] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8375.519302] Lustre: Skipped 2 previous similar messages [ 8378.578743] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8384.988680] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8384.993518] LustreError: 351497:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8385.011869] LustreError: 351497:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 8388.129303] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8393.114388] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8397.304072] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8402.240841] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8407.822368] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8413.682351] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8435.169099] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 8435.177466] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8435.179367] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8435.197395] Lustre: Skipped 2 previous similar messages [ 8435.211562] Lustre: Skipped 1 previous similar message [ 8437.422715] Lustre: server umount lustre-OST0000 complete [ 8446.626078] Lustre: server umount lustre-MDT0000 complete [ 8450.107167] LustreError: 351478:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782488821 with bad export cookie 6340087790344328546 [ 8450.112384] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8450.120388] LustreError: 351478:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 8450.372867] Lustre: server umount lustre-MDT0001 complete [ 8458.799776] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing unload_modules_local [ 8460.919931] Key type lgssc unregistered [ 8461.174628] LNet: 355143:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8461.182646] LNetError: 355143:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8461.215708] LNet: Removed LNI 192.168.204.125@tcp [ 8461.823274] Key type .llcrypt unregistered [ 8461.827475] Key type ._llcrypt unregistered [ 8479.137311] Key type ._llcrypt registered [ 8479.138769] Key type .llcrypt registered [ 8479.207152] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 8479.784920] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8479.852138] alg: No test for adler32 (adler32-zlib) [ 8480.825417] Lustre: Lustre: Build Version: 2.17.54_95_ga6f956b [ 8480.970231] LNet: Added LNI 192.168.204.125@tcp [8/256/0/180] [ 8482.583543] Key type lgssc registered [ 8483.096036] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8488.643737] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 8488.667469] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8489.988191] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8492.369351] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8497.292757] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8497.525622] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8500.100822] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8504.601713] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8508.372099] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8513.045518] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8513.286352] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8517.026631] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8521.020329] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8527.842618] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8527.851353] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 8527.854457] Lustre: Skipped 1 previous similar message [ 8528.686330] Lustre: lustre-MDT0001: Not available for connect from 192.168.204.25@tcp (stopping) [ 8532.780205] Lustre: server umount lustre-MDT0001 complete [ 8532.961735] LustreError: 356700:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8532.973120] LustreError: 356700:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 8533.796895] LustreError: 356696:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.204.25@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8538.080373] LustreError: 357427:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8538.089039] LustreError: 357427:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 8538.837643] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8538.901126] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [ 8538.903507] Lustre: Found index 1 for lustre-MDT0001, updating log [ 8538.923862] Lustre: 356690:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8539.107734] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8541.491373] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8544.235224] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 8545.775467] LustreError: 360354:0:(obd_mount.c:225:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [ 8545.780753] LustreError: 360354:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [ 8545.791120] LustreError: 356692:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [ 8545.838995] LustreError: 360361:0:(obd_config.c:2103:class_config_llog_handler()) MGC192.168.204.125@tcp: cfg command failed: rc = -17 [ 8545.844393] Lustre: cmd=cf001 0:lustre-MDT0001-osp-MDT0000 1:osp 2:lustre-MDT0000-mdtlov_UUID [ 8545.844393] [ 8851.275786] Lustre: lustre-MDT0001: Not available for connect from 192.168.204.25@tcp (stopping) [ 8851.434126] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [ 8851.436350] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8851.481458] Lustre: Skipped 1 previous similar message [ 8854.923439] Lustre: server umount lustre-MDT0001 complete [ 8856.355316] LustreError: 362826:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.204.25@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8856.382519] LustreError: 362826:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 8861.487099] LustreError: 356695:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.204.25@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8861.503243] LustreError: 356695:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 8865.258950] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8865.429890] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [ 8865.434804] Lustre: Found index 1 for lustre-MDT0001, updating log [ 8865.491530] Lustre: 356690:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8865.926606] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8870.393124] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 8871.410157] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 8875.020194] LustreError: 369872:0:(obd_mount.c:225:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [ 8875.036731] LustreError: 369872:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [ 8875.069091] LustreError: 356692:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [ 8875.086882] LustreError: 356692:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [ 8875.160601] LustreError: 369881:0:(obd_config.c:761:class_setup()) osp: device 8 already setup: rc = -17 [ 8875.168994] LustreError: 369881:0:(obd_config.c:866:class_detach()) OBD device 8 still set up [ 8875.171974] LustreError: 369881:0:(obd_config.c:2103:class_config_llog_handler()) MGC192.168.204.125@tcp: cfg command failed: rc = -17 [ 8875.183636] Lustre: cmd=cf003 0:lustre-MDT0001-osp-MDT0000 1:lustre-MDT0001_UUID 2:192.168.204.125@tcp [ 8875.183636] [ 9176.917296] Lustre: lustre-MDT0001: Not available for connect from 192.168.204.25@tcp (stopping) [ 9176.928804] Lustre: Skipped 2 previous similar messages [ 9178.595372] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9178.603635] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [ 9178.608133] Lustre: Skipped 1 previous similar message [ 9181.997471] Lustre: lustre-MDT0001: Not available for connect from 192.168.204.25@tcp (stopping) [ 9182.016624] Lustre: Skipped 2 previous similar messages [ 9183.116149] Lustre: server umount lustre-MDT0001 complete [ 9183.722720] LustreError: 356701:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9183.764459] LustreError: 356701:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 9195.096642] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9195.215535] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [ 9195.224615] Lustre: Found index 1 for lustre-MDT0001, updating log [ 9195.280216] Lustre: 356687:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 9195.596771] Lustre: lustre-MDT0001: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [ 9200.619048] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 9201.042328] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 9203.733895] LustreError: 378518:0:(obd_mount.c:225:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [ 9203.746362] LustreError: 378518:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [ 9203.769212] LustreError: 356692:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [ 9203.780289] LustreError: 356692:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [ 9203.866185] LustreError: 378526:0:(lod_lov.c:212:lod_add_device()) lustre-MDT0001-osp-MDT0000: cannot connect to next dev lustre-MDT0001_UUID (-114) [ 9203.897234] LustreError: 378526:0:(obd_config.c:2103:class_config_llog_handler()) MGC192.168.204.125@tcp: cfg command failed: rc = -114 [ 9203.904783] Lustre: cmd=cf014 0:lustre-MDT0000-mdtlov 1:lustre-MDT0001_UUID 2:1 3:1 [ 9203.904783] [ 9523.175551] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9523.184774] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 9523.187378] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9523.191633] Lustre: Skipped 2 previous similar messages [ 9527.263469] Lustre: server umount lustre-MDT0000 complete [ 9528.291249] LustreError: 356696:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9528.327406] LustreError: 356696:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 8 previous similar messages [ 9531.912476] LustreError: 356680:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782489903 with bad export cookie 10409803885249253630 [ 9531.916712] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9531.924707] LustreError: 356680:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 9533.434599] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9533.450297] Lustre: Skipped 1 previous similar message [ 9541.604344] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 9541.609032] Lustre: Skipped 4 previous similar messages [ 9546.208303] Lustre: lustre-MDT0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 9546.700425] Lustre: server umount lustre-MDT0001 complete [ 9551.406643] Lustre: server umount lustre-OST0000 complete [ 9564.005615] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_hostid [ 9576.645681] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 9614.112406] Lustre: DEBUG MARKER: == conf-sanity test 120: cross-target rename should not create bad symlinks ========================================================== 12:06:24 (1782489984) [ 9621.025358] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9621.346646] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 9621.386958] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 9621.478256] Lustre: lustre-MDT0000: new disk, initializing [ 9621.605421] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9621.630879] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 9626.137208] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 9637.582924] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9637.752525] Lustre: 388839:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 9637.835717] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 9637.843760] Lustre: Skipped 1 previous similar message [ 9637.853097] Lustre: lustre-MDT0001: Not available for connect from 0@lo (not set up) [ 9637.855956] Lustre: Skipped 1 previous similar message [ 9638.031319] Lustre: lustre-MDT0001: new disk, initializing [ 9638.125882] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9638.162543] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 9638.174031] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 9643.145763] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 9652.377561] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9659.389772] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 9666.883626] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9667.379474] Lustre: lustre-OST0000: new disk, initializing [ 9667.389368] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 9667.397293] Lustre: 390810:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 9667.551221] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9675.284166] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_default_debug -1 all [ 9675.340914] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 9675.353265] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 9675.507555] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 9685.538629] Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 9694.689584] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 9694.699548] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9696.226037] LustreError: 388850:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9696.255736] LustreError: 388850:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 6 previous similar messages [ 9697.527367] Lustre: server umount lustre-MDT0000 complete [ 9701.467155] LustreError: 388832:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782490072 with bad export cookie 10409803885249255569 [ 9701.471115] LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9701.472267] LustreError: 389650:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0000-osp-MDT0001: osp_attr_get update error [0x200000401:0x2:0x0]: rc = -5 [ 9701.479406] LustreError: 388832:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 9701.855762] Lustre: server umount lustre-MDT0001 complete [ 9716.418513] Lustre: server umount lustre-OST0000 complete [ 9747.406666] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing set_hostid [ 9758.215470] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing load_modules_local [ 9791.167245] Lustre: DEBUG MARKER: == conf-sanity test complete, duration 9440 sec ========== 12:09:20 (1782490160) [ 9793.219128] Lustre: DEBUG MARKER: === conf-sanity: start cleanup 12:09:22 (1782490162) === [ 9797.139556] Lustre: DEBUG MARKER: === conf-sanity: finish cleanup 12:09:26 (1782490166) === [ 9838.504507] Lustre: DEBUG MARKER: oleg425-server.virtnet: executing unload_modules_local [ 9841.824398] Key type lgssc unregistered [ 9842.069640] LNet: 397178:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 9842.075753] LNetError: 397178:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 9842.090587] LNet: Removed LNI 192.168.204.125@tcp [ 9843.183497] Key type .llcrypt unregistered [ 9843.185289] Key type ._llcrypt unregistered