[ 0.000000] Linux version 4.18.0rh8.10-debug (green@maintenance) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-26) (GCC)) #2 SMP Mon Jul 14 01:24:22 EDT 2025 [ 0.000000] Command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffcdfff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffce000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x0000000146dfffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0.0 present. [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.3-2.fc40 04/01/2014 [ 0.000000] Hypervisor detected: KVM [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 493337000 cycles [ 0.000000] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns [ 0.000000] tsc: Detected 2399.998 MHz processor [ 0.000000] last_pfn = 0x146e00 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0xbffce max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000f53f0-0x000f53ff] [ 0.000000] RAMDISK: [mem 0xbcc54000-0xbffbffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F5200 000014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 0x00000000BFFE1D87 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 0x00000000BFFE1C23 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 0x00000000BFFE0040 001BE3 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 0x00000000BFFE0000 000040 [ 0.000000] ACPI: APIC 0x00000000BFFE1C97 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: HPET 0x00000000BFFE1D27 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: WAET 0x00000000BFFE1D5F 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0xbffe1c23-0xbffe1c96] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe1c22] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0xbffe1c97-0xbffe1d26] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0xbffe1d27-0xbffe1d5e] [ 0.000000] ACPI: Reserving WAET table memory at [mem 0xbffe1d5f-0xbffe1d86] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x0000000146dfffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x1465a3000-0x1465cdfff] [ 0.000000] Reserving 256MB of memory at 2752MB for crashkernel (System RAM: 4205MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009efff] [ 0.000000] node 0: [mem 0x0000000000100000-0x00000000bffcdfff] [ 0.000000] node 0: [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Zeroed struct page in unavailable ranges: 4756 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x0000000146dfffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] TSC deadline timer available [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] kvm-guest: KVM setup pv remote TLB flush [ 0.000000] kvm-guest: setup PV sched yield [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbffce000-0xbfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.000000] [mem 0xc0000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u524288 [ 0.000000] kvm-guest: PV spinlocks enabled [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1059606 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] audit: disabled (until reboot) [ 0.000000] software IO TLB: area num 4. [ 0.000000] Memory: 2829652K/4306352K available (18435K kernel code, 11221K rwdata, 7248K rodata, 2908K init, 18040K bss, 524580K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] ftrace: allocating 41240 entries in 162 pages [ 0.000000] ftrace: allocated 162 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU event tracing is enabled. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=4. [ 0.000000] rcu: RCU callback double-/use-after-free debug enabled. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 [ 0.000000] NR_IRQS: 524544, nr_irqs: 456, preallocated irqs: 16 [ 0.000000] random: get_random_bytes called from start_kernel+0x622/0x9a8 with crng_init=0 [ 0.001000] Console: colour *CGA 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns [ 0.001019] APIC: Switch to symmetric I/O mode setup [ 0.002360] x2apic enabled [ 0.003013] Switched APIC routing to physical x2apic. [ 0.004016] kvm-guest: setup PV IPIs [ 0.007644] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.008000] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 0.008023] Calibrating delay loop (skipped) preset value.. 4799.99 BogoMIPS (lpj=2399998) [ 0.009014] pid_max: default: 32768 minimum: 301 [ 0.011077] LSM: Security Framework initializing [ 0.012000] Yama: becoming mindful. [ 0.012058] SELinux: Initializing. [ 0.013082] *** VALIDATE selinux *** [ 0.022628] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, vmalloc) [ 0.027387] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc) [ 0.028149] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.030126] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.031128] *** VALIDATE tmpfs *** [ 0.033340] *** VALIDATE proc *** [ 0.034298] *** VALIDATE cgroup *** [ 0.035015] *** VALIDATE cgroup2 *** [ 0.036304] x86/cpu: User Mode Instruction Prevention (UMIP) activated [ 0.037153] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.038009] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 [ 0.039033] Spectre V2 : User space: Vulnerable [ 0.040012] Speculative Store Bypass: Vulnerable [ 0.043169] debug: unmapping init [mem 0xffffffffbce59000-0xffffffffbce60fff] [ 0.045231] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (family: 0x6, model: 0x3e, stepping: 0x4) [ 0.046755] Performance Events: IvyBridge events, full-width counters, Intel PMU driver. [ 0.047035] ... version: 2 [ 0.048014] ... bit width: 48 [ 0.049013] ... generic registers: 4 [ 0.050014] ... value mask: 0000ffffffffffff [ 0.051018] ... max period: 00007fffffffffff [ 0.052020] ... fixed-purpose events: 3 [ 0.053017] ... event mask: 000000070000000f [ 0.054392] rcu: Hierarchical SRCU implementation. [ 0.056477] smp: Bringing up secondary CPUs ... [ 0.057643] x86: Booting SMP configuration: [ 0.058035] .... node #0, CPUs: #1 #2 #3 [ 0.068588] smp: Brought up 1 node, 4 CPUs [ 0.070017] smpboot: Max logical packages: 1 [ 0.071013] smpboot: Total of 4 processors activated (19199.98 BogoMIPS) [ 0.256520] node 0 deferred pages initialised in 180ms [ 0.259276] devtmpfs: initialized [ 0.261395] x86/mm: Memory block size: 128MB [ 0.264573] gcov: version magic: 0x41383552 [ 0.268084] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.269103] futex hash table entries: 1024 (order: 4, 65536 bytes, vmalloc) [ 0.271456] pinctrl core: initialized pinctrl subsystem [ 0.274277] [ 0.274884] ************************************************************* [ 0.277034] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.279020] ** ** [ 0.282024] ** IOMMU DebugFS SUPPORT HAS BEEN ENABLED IN THIS KERNEL ** [ 0.284018] ** ** [ 0.286020] ** This means that this kernel is built to expose internal ** [ 0.289022] ** IOMMU data structures, which may compromise security on ** [ 0.291019] ** your system. ** [ 0.294022] ** ** [ 0.296016] ** If you see this message and you are not debugging the ** [ 0.298022] ** kernel, report this immediately to your vendor! ** [ 0.301022] ** ** [ 0.303017] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.305022] ************************************************************* [ 0.307844] NET: Registered protocol family 16 [ 0.310382] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations [ 0.311058] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.314076] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.318075] cpuidle: using governor menu [ 0.319678] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.321629] PCI: Using configuration type 1 for base access [ 0.324148] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.334142] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.337032] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.340145] cryptd: max_cpu_qlen set to 1000 [ 0.343361] ACPI: Added _OSI(Module Device) [ 0.345043] ACPI: Added _OSI(Processor Device) [ 0.346022] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.348015] ACPI: Added _OSI(Processor Aggregator Device) [ 0.353069] ACPI: 1 ACPI AML tables successfully acquired and loaded [ 0.359583] ACPI: Interpreter enabled [ 0.360065] ACPI: PM: (supports S0 S3 S4 S5) [ 0.361000] ACPI: Using IOAPIC for interrupt routing [ 0.361000] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.364382] ACPI: Enabled 2 GPEs in block 00 to 0F [ 0.375208] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.377059] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3] [ 0.379029] acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI] [ 0.382121] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.387578] acpiphp: Slot [2] registered [ 0.389225] acpiphp: Slot [5] registered [ 0.391223] acpiphp: Slot [6] registered [ 0.392156] acpiphp: Slot [7] registered [ 0.394174] acpiphp: Slot [8] registered [ 0.395203] acpiphp: Slot [9] registered [ 0.397184] acpiphp: Slot [10] registered [ 0.398170] acpiphp: Slot [3] registered [ 0.400144] acpiphp: Slot [4] registered [ 0.401144] acpiphp: Slot [11] registered [ 0.402152] acpiphp: Slot [12] registered [ 0.404141] acpiphp: Slot [13] registered [ 0.406139] acpiphp: Slot [14] registered [ 0.408172] acpiphp: Slot [15] registered [ 0.409152] acpiphp: Slot [16] registered [ 0.411130] acpiphp: Slot [17] registered [ 0.412127] acpiphp: Slot [18] registered [ 0.413113] acpiphp: Slot [19] registered [ 0.415153] acpiphp: Slot [20] registered [ 0.416136] acpiphp: Slot [21] registered [ 0.418193] acpiphp: Slot [22] registered [ 0.420149] acpiphp: Slot [23] registered [ 0.421086] acpiphp: Slot [24] registered [ 0.422097] acpiphp: Slot [25] registered [ 0.423077] acpiphp: Slot [26] registered [ 0.425151] acpiphp: Slot [27] registered [ 0.427179] acpiphp: Slot [28] registered [ 0.428165] acpiphp: Slot [29] registered [ 0.430166] acpiphp: Slot [30] registered [ 0.431146] acpiphp: Slot [31] registered [ 0.433086] PCI host bridge to bus 0000:00 [ 0.434022] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.437048] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.439029] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.441031] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 0.444034] pci_bus 0000:00: root bus resource [mem 0x380000000000-0x38007fffffff window] [ 0.446036] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.449064] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.452720] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.456000] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 0.464824] pci 0000:00:01.1: reg 0x20: [io 0xc320-0xc32f] [ 0.468065] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.472034] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.475027] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.477026] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.479732] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 0.482125] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 0.485056] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 0.487949] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 [ 0.493022] pci 0000:00:02.0: reg 0x10: [io 0xc300-0xc31f] [ 0.506991] pci 0000:00:02.0: reg 0x20: [mem 0x380000000000-0x380000003fff 64bit pref] [ 0.510896] pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 0.516898] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 [ 0.523021] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] [ 0.530019] pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] [ 0.545019] pci 0000:00:05.0: reg 0x20: [mem 0x380000004000-0x380000007fff 64bit pref] [ 0.553000] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 [ 0.562027] pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] [ 0.567026] pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 0.585023] pci 0000:00:06.0: reg 0x20: [mem 0x380000008000-0x38000000bfff 64bit pref] [ 0.594235] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 [ 0.601025] pci 0000:00:07.0: reg 0x10: [io 0xc100-0xc17f] [ 0.609022] pci 0000:00:07.0: reg 0x14: [mem 0xfebc2000-0xfebc2fff] [ 0.620024] pci 0000:00:07.0: reg 0x20: [mem 0x38000000c000-0x38000000ffff 64bit pref] [ 0.630930] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 [ 0.639028] pci 0000:00:08.0: reg 0x10: [io 0xc180-0xc1ff] [ 0.644026] pci 0000:00:08.0: reg 0x14: [mem 0xfebc3000-0xfebc3fff] [ 0.658025] pci 0000:00:08.0: reg 0x20: [mem 0x380000010000-0x380000013fff 64bit pref] [ 0.669200] pci 0000:00:09.0: [1af4:1001] type 00 class 0x010000 [ 0.676017] pci 0000:00:09.0: reg 0x10: [io 0xc200-0xc27f] [ 0.681015] pci 0000:00:09.0: reg 0x14: [mem 0xfebc4000-0xfebc4fff] [ 0.693020] pci 0000:00:09.0: reg 0x20: [mem 0x380000014000-0x380000017fff 64bit pref] [ 0.703830] pci 0000:00:0a.0: [1af4:1001] type 00 class 0x010000 [ 0.710021] pci 0000:00:0a.0: reg 0x10: [io 0xc280-0xc2ff] [ 0.716024] pci 0000:00:0a.0: reg 0x14: [mem 0xfebc5000-0xfebc5fff] [ 0.730023] pci 0000:00:0a.0: reg 0x20: [mem 0x380000018000-0x38000001bfff 64bit pref] [ 0.743480] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 [ 0.745537] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 0.748380] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 [ 0.750413] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 0.752271] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 [ 0.757199] iommu: Default domain type: Passthrough [ 0.759556] SCSI subsystem initialized [ 0.761176] ACPI: bus type USB registered [ 0.762161] usbcore: registered new interface driver usbfs [ 0.764148] usbcore: registered new interface driver hub [ 0.766138] usbcore: registered new device driver usb [ 0.768208] pps_core: LinuxPPS API ver. 1 registered [ 0.770016] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 0.772072] PTP clock support registered [ 0.775186] EDAC MC: Ver: 3.0.0 [ 0.778202] PCI: Using ACPI for IRQ routing [ 0.780616] NetLabel: Initializing [ 0.781014] NetLabel: domain hash size = 128 [ 0.783015] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 0.785112] NetLabel: unlabeled traffic allowed by default [ 0.787191] vgaarb: loaded [ 0.789379] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 0.790017] hpet0: 3 comparators, 64-bit 100.000000 MHz counter [ 0.797000] clocksource: Switched to clocksource kvm-clock [ 0.930581] VFS: Disk quotas dquot_6.6.0 [ 0.933903] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 0.936707] *** VALIDATE ramfs *** [ 0.938247] *** VALIDATE hugetlbfs *** [ 0.940424] pnp: PnP ACPI init [ 0.943616] pnp: PnP ACPI: found 6 devices [ 0.963826] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 0.967097] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 0.969539] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 0.971672] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 0.973994] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 0.976406] pci_bus 0000:00: resource 8 [mem 0x380000000000-0x38007fffffff window] [ 0.979252] NET: Registered protocol family 2 [ 0.982498] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, vmalloc) [ 0.988582] tcp_listen_portaddr_hash hash table entries: 4096 (order: 5, 163840 bytes, vmalloc) [ 0.992050] TCP established hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.997478] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc) [ 1.001398] TCP: Hash tables configured (established 65536 bind 65536) [ 1.004618] MPTCP token hash table entries: 8192 (order: 6, 393216 bytes, vmalloc) [ 1.007829] UDP hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 1.010460] UDP-Lite hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 1.014213] NET: Registered protocol family 1 [ 1.016834] RPC: Registered named UNIX socket transport module. [ 1.018686] RPC: Registered udp transport module. [ 1.020371] RPC: Registered tcp transport module. [ 1.022104] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 1.024640] NET: Registered protocol family 44 [ 1.026721] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 1.029105] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 1.031515] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 1.034297] PCI: CLS 0 bytes, default 64 [ 1.036092] Unpacking initramfs... [ 2.454875] debug: unmapping init [mem 0xffff95417cc54000-0xffff95417ffbffff] [ 2.458364] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 2.460476] software IO TLB: mapped [mem 0x00000000a8000000-0x00000000ac000000] (64MB) [ 2.463319] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 2.962165] Initialise system trusted keyrings [ 2.964048] Key type blacklist registered [ 2.965843] workingset: timestamp_bits=36 max_order=20 bucket_order=0 [ 2.977093] zbud: loaded [ 2.980211] *** VALIDATE nfs *** [ 2.981558] *** VALIDATE nfs4 *** [ 2.983233] pstore: using deflate compression [ 2.986082] Platform Keyring initialized [ 3.093526] NET: Registered protocol family 38 [ 3.095590] Key type asymmetric registered [ 3.097547] Asymmetric key parser 'x509' registered [ 3.099579] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 3.102804] io scheduler mq-deadline registered [ 3.104520] io scheduler kyber registered [ 3.106127] io scheduler bfq registered [ 3.107994] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 3.110972] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.113726] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 3.116684] ACPI: Power Button [PWRF] [ 3.209707] ACPI: \_SB_.LNKB: Enabled at IRQ 10 [ 3.300295] ACPI: \_SB_.LNKA: Enabled at IRQ 11 [ 3.484430] ACPI: \_SB_.LNKC: Enabled at IRQ 11 [ 3.578843] ACPI: \_SB_.LNKD: Enabled at IRQ 10 [ 3.762728] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 3.793057] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.822622] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.827704] Non-volatile memory driver v1.3 [ 3.829499] Linux agpgart interface v0.103 [ 3.864344] virtio_blk virtio1: [vda] 133840 512-byte logical blocks (68.5 MB/65.4 MiB) [ 3.867443] vda: detected capacity change from 0 to 68526080 [ 3.884596] virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) [ 3.886974] vdb: detected capacity change from 0 to 1073741824 [ 3.902138] virtio_blk virtio3: [vdc] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 3.905396] vdc: detected capacity change from 0 to 2621440000 [ 3.919152] virtio_blk virtio4: [vdd] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 3.922076] vdd: detected capacity change from 0 to 2621440000 [ 3.936907] virtio_blk virtio5: [vde] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 3.939603] vde: detected capacity change from 0 to 4294967296 [ 3.952957] virtio_blk virtio6: [vdf] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 3.955708] vdf: detected capacity change from 0 to 4294967296 [ 3.962678] libphy: Fixed MDIO Bus: probed [ 3.971275] usbcore: registered new interface driver usbserial_generic [ 3.973558] usbserial: USB Serial support registered for generic [ 3.975810] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 3.980082] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 3.981704] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 3.984050] mousedev: PS/2 mouse device common for all mice [ 3.988001] rtc_cmos 00:05: RTC can wake from S4 [ 3.991116] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 3.992281] rtc_cmos 00:05: registered as rtc0 [ 3.996464] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 3.998065] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 [ 3.999875] intel_pstate: CPU model not supported [ 4.004851] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 [ 4.009651] hid: raw HID events driver (C) Jiri Kosina [ 4.011543] usbcore: registered new interface driver usbhid [ 4.013248] usbhid: USB HID core driver [ 4.014598] drop_monitor: Initializing network drop monitor service [ 4.016658] Initializing XFRM netlink socket [ 4.018444] NET: Registered protocol family 10 [ 4.021320] Segment Routing with IPv6 [ 4.022795] NET: Registered protocol family 17 [ 4.025666] mpls_gso: MPLS GSO support [ 4.033124] RAS: Correctable Errors collector initialized. [ 4.035527] AVX version of gcm_enc/dec engaged. [ 4.037431] AES CTR mode by8 optimization enabled [ 4.130418] sched_clock: Marking stable (4130395238, 0)->(5114484861, -984089623) [ 4.134933] registered taskstats version 1 [ 4.139525] Loading compiled-in X.509 certificates [ 4.142474] zswap: loaded using pool lzo/zbud [ 4.171243] Key type big_key registered [ 4.184555] Key type encrypted registered [ 4.185808] ima: No TPM chip found, activating TPM-bypass! [ 4.187510] ima: Allocated hash algorithm: sha1 [ 4.188870] ima: No architecture policies found [ 4.190141] evm: Initialising EVM extended attributes: [ 4.191453] evm: security.selinux [ 4.192654] evm: security.ima [ 4.193437] evm: security.capability [ 4.194637] evm: HMAC attrs: 0x1 [ 4.197028] rtc_cmos 00:05: setting system clock to 2025-11-17 01:09:23 UTC (1763341763) [ 4.203352] debug: unmapping init [mem 0xffffffffbde03000-0xffffffffbdffffff] [ 4.208259] debug: unmapping init [mem 0xffffffffbcb82000-0xffffffffbce58fff] [ 4.215117] Write protecting the kernel read-only data: 28672k [ 4.218835] debug: unmapping init [mem 0xffffffffbb203000-0xffffffffbb3fffff] [ 4.221606] debug: unmapping init [mem 0xffffffffbbb14000-0xffffffffbbbfffff] [ 4.255168] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 4.263792] systemd[1]: Detected virtualization kvm. [ 4.265921] systemd[1]: Detected architecture x86-64. [ 4.267594] systemd[1]: Running in initial RAM disk. Welcome to Rocky Linux 8.10 (Green Obsidian) dracut-049-233.git20240115.el8 (Initramfs)! [ 4.296400] systemd[1]: No hostname configured. [ 4.298361] systemd[1]: Set hostname to . [ 4.300454] random: systemd: uninitialized urandom read (16 bytes read) [ 4.303039] systemd[1]: Initializing machine ID from random generator. [ 4.353203] random: ln: uninitialized urandom read (6 bytes read) [ 4.444744] random: systemd: uninitialized urandom read (16 bytes read) [ 4.447440] systemd[1]: Reached target Swap. [ OK ] Reached target Swap. [ 4.451623] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 4.456262] systemd[1]: Reached target Timers. [ OK ] Reached target Timers. [ OK ] Listening on udev Kernel Socket. [ OK ] Reached target Initrd Root Device. [ OK ] Reached target Local File Systems. [ OK ] Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket. Starting Create Volatile Files and Directories... Starting Setup Virtual Console... [ OK ] Started Memstrack Anylazing Service. Starting Create list of required st…ce nodes for the current kernel... Starting Apply Kernel Variables... Starting Journal Service... [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Paths. [ OK ] Reached target Slices. [ OK ] Reached target Sockets. [ OK ] Started Create Volatile Files and Directories. [ OK ] Started Setup Virtual Console. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Apply Kernel Variables. Starting Create Static Device Nodes in /dev... Starting dracut cmdline hook... [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started Journal Service. [ OK ] Started dracut cmdline hook. [ 5.048298] random: fast init done Starting dracut pre-udev hook... [ 5.114245] device-mapper: uevent: version 1.0.3 [ 5.116428] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting dracut pre-trigger hook... [ OK ] Started dracut pre-trigger hook. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. Starting dracut initqueue hook... [ OK ] Reached target System Initialization. [ OK ] Reached target Basic System. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. [ 5.769468] virtio_net virtio0 ens2: renamed from eth0 [ 5.788832] scsi host0: ata_piix [ 5.843566] scsi host1: ata_piix [ 5.845337] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc320 irq 14 [ 5.847904] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc328 irq 15 [ 10.125938] dracut-initqueue[585]: RTNETLINK answers: File exists [ 10.718803] random: crng init done [ 10.720508] random: 7 urandom warning(s) missed due to ratelimiting Starting nbd nbd0... [ OK ] Started nbd nbd0. [ OK ] Started dracut initqueue hook. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Mounting /sysroot... [ 11.059680] EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Timers. [ OK ] Stopped dracut pre-pivot and cleanup hook. Stopping Hardware RNG Entropy Gatherer Daemon... [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped Hardware RNG Entropy Gatherer Daemon. [ OK ] Stopped target Basic System. [ OK ] Stopped target System Initialization. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped dracut pre-trigger hook. Stopping udev Kernel Device Manager... [ OK ] Stopped target Swap. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Local Encrypted Volumes. [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped target Paths. [ OK ] Stopped Dispatch Password Requests to Console Directory Watch. [ OK ] Stopped target Sockets. [ OK ] Stopped target Slices. [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Closed udev Kernel Socket. [ OK ] Closed udev Control Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Reached target Switch Root. Starting Switch Root... [ 12.268051] printk: systemd: 26 output lines suppressed due to ratelimiting [ 12.494174] SELinux: Disabled at runtime. [ 12.558715] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 12.567252] systemd[1]: Detected virtualization kvm. [ 12.568857] systemd[1]: Detected architecture x86-64. Welcome to Rocky Linux 8.10 (Green Obsidian)! [ 13.008475] systemd[1]: initrd-switch-root.service: Succeeded. [ 13.012344] systemd[1]: Stopped Switch Root. [ OK ] Stopped Switch Root. [ 13.017446] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. [ 13.021524] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 13.025253] systemd[1]: Stopped Journal Service. [ OK ] Stopped Journal Service. [ 13.036755] systemd[1]: Starting Journal Service... Starting Journal Service... [ 13.043634] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ OK ] Created slice User and Session Slice. [ OK ] Created slice system-sshd\x2dkeygen.slice. Mounting Kernel Debug File System... Starting Remount Root and Kernel File Systems... [FAILED] Failed to set up automount Arbitrar…rmats File System Automount Point. See 'systemctl status proc-sys-fs-binfmt_misc.automount' for details. [ OK ] Created slice system-serial\x2dgetty.slice. Starting Apply Kernel Variables... [ OK ] Created slice system-getty.slice. [ OK ] Reached target rpc_pipefs.target. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Listening on udev Control Socket. Starting udev Coldplug all Devices... [ OK ] Started Forward Password Requests to Wall Directory Watch. Mounting POSIX Message Queue File System... [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd File Systems. Mounting Huge Pages File System... Activating swap /dev/disk/by-label/SWAP... [ OK ] Reached target Slices. [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Paths. [ OK ] Reached target RPC Port Mapper. Starting Create list of required st…ce nodes for the current kernel... [ OK ] Stopped target Initrd Root File System. [ OK ] Listening on initctl Compatibility Named Pipe. [ 13.206865] Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS [ OK ] Listening on Process Core Dump Socket. [ OK ] Started Journal Service. [ OK ] Mounted Kernel Debug File System. [FAILED] Failed to start Remount Root and Kernel File Systems. See 'systemctl status systemd-remount-fs.service' for details. [ OK ] Started Apply Kernel Variables. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted Huge Pages File System. [ OK ] Activated swap /dev/disk/by-label/SWAP. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Reached target Swap. Starting Configure read-only root support... Starting Create Static Device Nodes in /dev... Starting Flush Journal to Persistent Storage... [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Reached target Local File Systems (Pre). Mounting /mnt... Mounting /home/green/git/lustre-release... Starting udev Kernel Device Manager... [ OK ] Started udev Coldplug all Devices. [ OK ] Mounted /mnt. [ 13.474447] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ OK ] Mounted /home/green/git/lustre-release. [ OK ] Started udev Kernel Device Manager. [ 13.741661] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 13.780243] input: PC Speaker as /devices/platform/pcspkr/input/input5 [ 13.886119] RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer [ 13.897161] EDAC sbridge: Ver: 1.1.2 [ 15.427866] Key type dns_resolver registered [ 15.721650] NFS: Registering the id_resolver key type [ 15.723743] Key type id_resolver registered [ 15.725509] Key type id_legacy registered [ OK ] Started Configure read-only root support. Starting Load/Save Random Seed... [ OK ] Reached target Local File Systems. Starting Rebuild Dynamic Linker Cache... Starting Mark the need to relabel after reboot... Starting Create Volatile Files and Directories... [ OK ] Started Load/Save Random Seed. [ OK ] Started Mark the need to relabel after reboot. [ OK ] Started Create Volatile Files and Directories. Starting RPC Bind... Starting Update UTMP about System Boot/Shutdown... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Started RPC Bind. [ OK ] Started Rebuild Dynamic Linker Cache. Starting Update is Completed... [ OK ] Started Update is Completed. [ OK ] Reached target System Initialization. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Started dnf makecache --timer. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. Starting Login Service... [ OK ] Started Hardware RNG Entropy Gatherer Daemon. [ OK ] Started D-Bus System Message Bus. Starting Network Manager... Starting Restore /run/initramfs on shutdown... [ OK ] Started irqbalance daemon. [ OK ] Reached target sshd-keygen.target. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Reached target Timers. [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Login Service. [ OK ] Started Network Manager. Starting Network Manager Wait Online... [ OK ] Reached target Network. Starting OpenSSH server daemon... Starting Dynamic System Tuning Daemon... Starting GSSAPI Proxy Daemon... Starting Hostname Service... [ OK ] Started OpenSSH server daemon. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Started Permit User Sessions. [ OK ] Started Getty on tty1. [ OK ] Started Serial Getty on ttyS1. [ OK ] Started Serial Getty on ttyS0. [ OK ] Reached target Login Prompts. [ OK ] Started Command Scheduler. [ OK ] Started Hostname Service. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Notify NFS peers of a restart... Starting Crash recovery kernel arming... Starting System Logging Service... [ OK ] Started Notify NFS peers of a restart. [ OK ] Started System Logging Service. Starting Authorization Manager... [ OK ] Started Authorization Manager. [ OK ] Started Dynamic System Tuning Daemon. [ OK ] Reached target Multi-User System. [ OK ] Reached target Graphical Interface. Starting Update UTMP about System Runlevel Changes... [ OK ] Started Update UTMP about System Runlevel Changes. Rocky Linux 8.10 (Green Obsidian) Kernel 4.18.0rh8.10-debug on an x86_64 oleg155-server login: [ 50.011431] libcfs: loading out-of-tree module taints kernel. [ 50.026960] Key type ._llcrypt registered [ 50.028713] Key type .llcrypt registered [ 50.112151] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_hostid [ 63.290046] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [ 64.160718] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 64.184207] alg: No test for adler32 (adler32-zlib) [ 65.430548] Lustre: Lustre: Build Version: 2.16.61_48_ga3a4329 [ 66.050392] LNet: Added LNI 192.168.201.155@tcp [8/256/0/180] [ 67.745335] Key type lgssc registered [ 69.030306] Lustre: Echo OBD driver; http://www.lustre.org/ [ 82.372504] hrtimer: interrupt took 6493935 ns [ 84.168283] ZFS: Loaded module v2.3.2-1, ZFS pool version 5000, ZFS filesystem version 5 [ 85.784746] LDISKFS-fs (vdc): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 92.433715] LDISKFS-fs (vdd): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 97.990581] LDISKFS-fs (vde): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 104.042971] LDISKFS-fs (vdf): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 117.802067] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [ 128.483240] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 128.558273] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 128.587029] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 129.818481] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 129.858110] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 129.907447] Lustre: lustre-MDT0000: new disk, initializing [ 130.016520] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 130.045384] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 133.953297] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 145.884588] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 145.951969] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 146.003804] Lustre: 6510:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 146.026190] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 146.032363] Lustre: Skipped 1 previous similar message [ 146.158180] Lustre: lustre-MDT0001: new disk, initializing [ 146.218386] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 146.246165] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 146.259433] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 150.017477] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 154.664153] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 162.118761] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 162.189696] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 162.427350] Lustre: lustre-OST0000: new disk, initializing [ 162.441662] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 162.543965] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 166.268892] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 166.304913] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 166.399149] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 167.562196] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 178.898644] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 178.953995] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 179.037474] Lustre: lustre-OST0001: new disk, initializing [ 179.041719] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 179.109399] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 183.575149] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 186.400181] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 186.405718] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 186.473828] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 192.995747] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 198.867873] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 208.161674] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing check_logdir /tmp/testlogs/ [ 210.818965] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing yml_node [ 214.496814] Lustre: DEBUG MARKER: Client: 2.16.61.48 [ 216.251841] Lustre: DEBUG MARKER: MDS: 2.16.61.48 [ 218.085863] Lustre: DEBUG MARKER: OSS: 2.16.61.48 [ 219.188933] Lustre: DEBUG MARKER: -----============= acceptance-small: conf-sanity ============----- Sun Nov 16 20:12:57 EST 2025 [ 233.126345] Lustre: DEBUG MARKER: excepting tests: 102 106 115 32newtarball [ 234.352351] Lustre: DEBUG MARKER: skipping tests SLOW=no: 45 69 106 111 114 [ 248.803179] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 248.808947] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 248.822191] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 252.896499] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 252.896737] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 252.922254] Lustre: Skipped 1 previous similar message [ 252.946950] Lustre: Skipped 3 previous similar messages [ 254.519303] LustreError: 12212:0:(obd_class.h:479:obd_check_dev()) Device 28 not setup [ 254.629165] Lustre: server umount lustre-MDT0000 complete [ 257.465401] LustreError: 10277:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763342016 with bad export cookie 1295144182235730517 [ 257.472428] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 257.480863] LustreError: 10277:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 258.017167] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 258.023667] Lustre: Skipped 1 previous similar message [ 258.029563] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 258.035029] Lustre: Skipped 1 previous similar message [ 262.048035] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 262.055350] Lustre: Skipped 1 previous similar message [ 263.643168] LustreError: 12414:0:(obd_class.h:479:obd_check_dev()) Device 27 not setup [ 263.645445] LustreError: 12414:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 263.724943] Lustre: server umount lustre-MDT0001 complete [ 267.078448] LustreError: 12615:0:(obd_class.h:479:obd_check_dev()) Device 19 not setup [ 267.081269] LustreError: 12615:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 267.123484] Lustre: server umount lustre-OST0000 complete [ 269.941182] LustreError: 12815:0:(obd_class.h:479:obd_check_dev()) Device 2 not setup [ 269.943582] LustreError: 12815:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 270.035923] Lustre: server umount lustre-OST0001 complete [ 274.828695] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_hostid [ 281.924650] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [ 289.115954] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 293.568969] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 298.118259] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 303.341512] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 308.398431] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 308.450894] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 308.701362] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 308.747878] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 308.803490] Lustre: lustre-MDT0000: new disk, initializing [ 308.890248] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 308.908663] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 311.761806] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 320.143108] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 320.184427] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 320.256091] Lustre: 14997:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 320.319623] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 320.322398] Lustre: Skipped 1 previous similar message [ 320.377842] Lustre: lustre-MDT0001: new disk, initializing [ 320.465613] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 320.502745] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 320.509892] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 323.235896] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 329.643445] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 332.704623] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 337.628594] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 337.675685] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 337.873350] Lustre: lustre-OST0000: new disk, initializing [ 337.877584] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 337.953809] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 339.506558] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 339.514650] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 339.633965] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 341.834707] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 346.754509] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 349.653850] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 349.803593] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 352.511908] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 352.687330] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 355.307386] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 355.308109] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 355.320380] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 355.320854] LustreError: Skipped 1 previous similar message [ 355.334983] Lustre: Skipped 2 previous similar messages [ 360.059158] LustreError: 17938:0:(obd_class.h:479:obd_check_dev()) Device 19 not setup [ 360.068235] LustreError: 17938:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 360.154843] Lustre: server umount lustre-OST0000 complete [ 365.537273] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 365.543828] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 365.544988] Lustre: Skipped 1 previous similar message [ 365.549182] Lustre: Skipped 1 previous similar message [ 369.336754] LustreError: 18141:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup [ 369.343897] LustreError: 18141:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 369.431977] Lustre: server umount lustre-MDT0000 complete [ 370.659142] LustreError: 15010:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 370.714732] LustreError: 15010:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 6 previous similar messages [ 372.528682] LustreError: 14989:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763342131 with bad export cookie 1295144182235732050 [ 372.535571] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 372.771498] Lustre: server umount lustre-MDT0001 complete [ 376.951980] Lustre: DEBUG MARKER: == conf-sanity test 76a: set permanent params with lctl across mounts ========================================================== 20:15:35 (1763342135) [ 383.586736] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 383.995189] LustreError: 18869:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 384.099179] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 387.398492] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 389.604114] LustreError: 18869:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 389.624733] LustreError: 18869:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 394.721748] LustreError: 18869:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 394.999330] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 398.676770] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 402.994083] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 405.931802] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 411.214164] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 416.390944] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 421.425357] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 435.883168] Lustre: Modifying parameter general.osc.*.max_dirty_mb=452 in log params [ 441.314599] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 441.321408] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 441.339486] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 441.344340] Lustre: Skipped 1 previous similar message [ 447.489381] LustreError: 21191:0:(obd_class.h:479:obd_check_dev()) Device 9 not setup [ 447.492656] LustreError: 21191:0:(obd_class.h:479:obd_check_dev()) Skipped 13 previous similar messages [ 447.570692] Lustre: server umount lustre-MDT0000 complete [ 450.529063] LustreError: 20375:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 450.542172] LustreError: 20375:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 450.703875] LustreError: 18849:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763342210 with bad export cookie 1295144182235732932 [ 450.716609] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 450.992389] Lustre: server umount lustre-MDT0001 complete [ 464.336513] Lustre: server umount lustre-OST0000 complete [ 481.344373] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [ 490.204588] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 490.584368] LustreError: 22919:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 490.654312] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 490.657374] Lustre: Skipped 2 previous similar messages [ 494.098862] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 503.215929] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 508.333586] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 511.041706] Lustre: Setting parameter general.debug_raw_pointers=Y in log params [ 517.504081] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 523.296334] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 530.699395] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 530.760944] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 530.894250] Lustre: lustre-OST0001: new disk, initializing [ 530.904628] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 532.219700] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 532.222431] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 532.332935] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 536.215083] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 544.775256] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 548.082798] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 569.313165] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 569.321199] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 569.346378] Lustre: Skipped 5 previous similar messages [ 569.361717] Lustre: Skipped 6 previous similar messages [ 571.675203] LustreError: 26401:0:(obd_class.h:479:obd_check_dev()) Device 28 not setup [ 571.683865] LustreError: 26401:0:(obd_class.h:479:obd_check_dev()) Skipped 17 previous similar messages [ 571.762671] Lustre: server umount lustre-MDT0000 complete [ 574.436582] LustreError: 22918:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 574.446567] LustreError: 22918:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 5 previous similar messages [ 574.855500] LustreError: 25190:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763342334 with bad export cookie 1295144182235733779 [ 574.865548] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 574.876259] LustreError: 25190:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 7 previous similar messages [ 575.223638] Lustre: server umount lustre-MDT0001 complete [ 587.826929] Lustre: server umount lustre-OST0000 complete [ 601.301471] Lustre: server umount lustre-OST0001 complete [ 614.114487] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [ 623.536909] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 623.891379] LustreError: 28179:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 623.992712] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 624.011230] Lustre: Skipped 3 previous similar messages [ 627.576796] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 635.121411] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 639.077077] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 641.564901] Lustre: 29294:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 647.581529] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 654.356887] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 663.563527] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 669.740923] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 676.416906] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 679.488748] Lustre: 31151:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 689.637488] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 689.645438] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 689.664422] Lustre: Skipped 2 previous similar messages [ 689.666149] Lustre: Skipped 1 previous similar message [ 695.492212] LustreError: 31355:0:(obd_class.h:479:obd_check_dev()) Device 10 not setup [ 695.497506] LustreError: 31355:0:(obd_class.h:479:obd_check_dev()) Skipped 25 previous similar messages [ 695.566924] Lustre: server umount lustre-MDT0000 complete [ 698.659559] LustreError: 31153:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763342457 with bad export cookie 1295144182235735074 [ 698.663509] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 698.675537] LustreError: 31153:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 699.027457] Lustre: server umount lustre-MDT0001 complete [ 712.650629] Lustre: server umount lustre-OST0000 complete [ 715.744164] Lustre: 3653:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1763342459/real 1763342459] req@ffff9541ffc59f80 x1848997917771136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1763342475 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 715.881807] Lustre: server umount lustre-OST0001 complete [ 722.957945] Lustre: DEBUG MARKER: == conf-sanity test 76b: verify params log setup correctly ========================================================== 20:21:21 (1763342481) [ 746.773404] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [ 756.276788] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 756.679977] LustreError: 33939:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 756.704914] LustreError: 33939:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 7 previous similar messages [ 760.478538] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 768.310863] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 771.707593] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 773.916914] Lustre: 35053:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 779.054872] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 784.192242] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 791.881610] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 796.992610] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 803.550736] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 806.367114] Lustre: 36910:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 818.659700] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 818.663587] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 818.681638] Lustre: Skipped 3 previous similar messages [ 818.686020] Lustre: Skipped 6 previous similar messages [ 821.398689] Lustre: server umount lustre-MDT0000 complete [ 824.498342] LustreError: 33920:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763342583 with bad export cookie 1295144182235736180 [ 824.502404] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 824.518943] LustreError: 33920:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 1 previous similar message [ 824.694177] LustreError: 37265:0:(obd_class.h:479:obd_check_dev()) Device 18 not setup [ 824.702756] LustreError: 37265:0:(obd_class.h:479:obd_check_dev()) Skipped 33 previous similar messages [ 824.875451] Lustre: server umount lustre-MDT0001 complete [ 838.224378] Lustre: server umount lustre-OST0000 complete [ 851.585781] Lustre: server umount lustre-OST0001 complete [ 859.429853] Lustre: DEBUG MARKER: == conf-sanity test 76c: verify changelog_mask is applied with lctl set_param -P ========================================================== 20:23:37 (1763342617) [ 872.011667] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [ 880.295209] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 880.775030] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 880.783905] Lustre: Skipped 7 previous similar messages [ 884.041552] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 886.249538] LustreError: 39054:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 886.260043] LustreError: 39054:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 10 previous similar messages [ 891.488452] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 895.063414] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 897.644098] Lustre: 40153:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 902.974523] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 907.966807] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 915.711540] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 920.721069] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 927.168579] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 929.892340] Lustre: 42009:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 935.494817] Lustre: Setting parameter general.mdd.*.changelog_mask=-CLOSE in log params [ 935.497936] Lustre: Skipped 1 previous similar message [ 943.642759] Lustre: server umount lustre-MDT0000 complete [ 946.071406] LustreError: 40538:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763342705 with bad export cookie 1295144182235737286 [ 946.080054] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 946.087615] LustreError: 40538:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 947.684620] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 947.693389] Lustre: Skipped 7 previous similar messages [ 952.388403] Lustre: server umount lustre-MDT0001 complete [ 958.690724] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 971.246960] Lustre: Evicted from MGS (at 0@lo) after server handle changed from 0x0 to 0x11f946c59313315e [ 971.255560] Lustre: MGC192.168.201.155@tcp: Connection restored to 0@lo (at 0@lo) [ 974.624157] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 980.900675] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 981.489083] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 985.258581] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 987.115099] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 987.124995] Lustre: Skipped 1 previous similar message [ 989.817762] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 991.158151] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 994.202728] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 995.912213] Lustre: DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec [ 1002.468665] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1005.708200] Lustre: server umount lustre-MDT0000 complete [ 1008.577359] LustreError: 39015:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763342767 with bad export cookie 1295144182235738462 [ 1008.582906] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1008.590495] LustreError: 39015:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 1008.826562] Lustre: server umount lustre-MDT0001 complete [ 1022.012306] Lustre: server umount lustre-OST0000 complete [ 1035.727075] Lustre: server umount lustre-OST0001 complete [ 1045.719800] Lustre: DEBUG MARKER: == conf-sanity test 76d: verify llite.*.xattr_cache can be set by 'lctl set_param -P' correctly ========================================================== 20:26:43 (1763342803) [ 1059.089360] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [ 1067.672665] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1071.869884] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 1079.982328] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1083.455595] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 1085.816479] Lustre: 47501:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 1092.115320] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1097.940267] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 1105.275859] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1110.404957] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 1117.867333] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1127.640324] Lustre: Setting parameter general.llite.*.xattr_cache=0 in log params [ 1141.559225] LustreError: 49578:0:(obd_class.h:479:obd_check_dev()) Device 10 not setup [ 1141.568631] LustreError: 49578:0:(obd_class.h:479:obd_check_dev()) Skipped 59 previous similar messages [ 1141.692087] Lustre: server umount lustre-MDT0000 complete [ 1141.727931] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1145.055710] LustreError: 46360:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763342904 with bad export cookie 1295144182235739246 [ 1145.067935] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1145.076636] LustreError: 46360:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 1145.321108] Lustre: server umount lustre-MDT0001 complete [ 1159.102105] Lustre: server umount lustre-OST0000 complete [ 1172.329504] Lustre: server umount lustre-OST0001 complete [ 1181.280218] Lustre: DEBUG MARKER: == conf-sanity test 77: comma-separated MGS NIDs and failover node NIDs ========================================================== 20:28:59 (1763342939) [ 1183.622146] Lustre: DEBUG MARKER: SKIP: conf-sanity test_77 mixed loopback and real device not working [ 1185.493989] Lustre: DEBUG MARKER: == conf-sanity test 78: run resize2fs on MDT and OST filesystems ========================================================== 20:29:03 (1763342943) [ 1195.599839] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_hostid [ 1204.385150] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [ 1215.196042] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 1221.880077] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 1228.450633] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 1228.540039] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1228.848390] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1228.904209] Lustre: lustre-MDT0000: new disk, initializing [ 1229.003211] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1232.477551] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 1239.480424] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1245.645214] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 1245.690515] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1245.952238] Lustre: lustre-OST0000: new disk, initializing [ 1245.957643] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1245.960566] Lustre: Skipped 1 previous similar message [ 1247.151716] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 1247.162302] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 1247.206066] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 1251.271542] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 1257.850615] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1259.993532] Lustre: DEBUG MARKER: create test files [ 1283.046710] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1283.057614] Lustre: Skipped 8 previous similar messages [ 1283.060024] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1283.061413] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1283.068236] Lustre: Skipped 20 previous similar messages [ 1284.658520] Lustre: server umount lustre-OST0000 complete [ 1287.435639] Lustre: server umount lustre-MDT0000 complete [ 1294.770872] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing unload_modules_local [ 1297.146894] Key type lgssc unregistered [ 1297.384764] LNet: 54915:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1297.390266] LNetError: 54915:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1297.402924] LNet: Removed LNI 192.168.201.155@tcp [ 1298.120565] Key type .llcrypt unregistered [ 1298.122189] Key type ._llcrypt unregistered [ 1322.414572] Key type ._llcrypt registered [ 1322.416469] Key type .llcrypt registered [ 1322.494297] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [ 1323.330437] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1323.348284] alg: No test for adler32 (adler32-zlib) [ 1324.320935] Lustre: Lustre: Build Version: 2.16.61_48_ga3a4329 [ 1324.488044] LNet: Added LNI 192.168.201.155@tcp [8/256/0/180] [ 1326.127192] Key type lgssc registered [ 1326.912135] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1332.405643] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1332.425191] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1333.831462] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1337.155103] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 1341.611042] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1346.613587] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1346.909777] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1351.143337] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 1354.886355] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1359.149825] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:102 to 0x240000400:129) [ 1359.258489] Lustre: 57502:0:(osd_internal.h:1472:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 515 < left 544, rollback = 9 [ 1359.269100] Lustre: 57502:0:(osd_handler.c:2082:osd_trans_dump_creds()) create: 32/128/0, destroy: 0/0/0 [ 1359.275749] Lustre: 57502:0:(osd_handler.c:2089:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 1359.281834] Lustre: 57502:0:(osd_handler.c:2099:osd_trans_dump_creds()) write: 2/13/1, punch: 0/0/0, quota 1/3/0 [ 1359.293558] Lustre: 57502:0:(osd_handler.c:2106:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 1359.304424] Lustre: 57502:0:(osd_handler.c:2113:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 1364.333056] Lustre: DEBUG MARKER: check files after expanding the MDT and OST filesystems [ 1368.804698] Lustre: DEBUG MARKER: create more files after expanding the MDT and OST filesystems [ 1374.696073] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1374.696795] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1374.708790] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1379.342338] LustreError: 58249:0:(obd_class.h:479:obd_check_dev()) Device 13 not setup [ 1379.467755] Lustre: server umount lustre-OST0000 complete [ 1383.059625] LustreError: 58451:0:(obd_class.h:479:obd_check_dev()) Device 8 not setup [ 1383.066516] LustreError: 58451:0:(obd_class.h:479:obd_check_dev()) Skipped 1 previous similar message [ 1383.265383] Lustre: server umount lustre-MDT0000 complete [ 1392.341360] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing unload_modules_local [ 1394.240113] Key type lgssc unregistered [ 1394.472776] LNet: 58982:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1394.486594] LNetError: 58982:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1395.558973] LNet: Removed LNI 192.168.201.155@tcp [ 1396.158756] Key type .llcrypt unregistered [ 1396.160870] Key type ._llcrypt unregistered [ 1423.435924] Key type ._llcrypt registered [ 1423.437348] Key type .llcrypt registered [ 1423.530559] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [ 1424.302747] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1424.323637] alg: No test for adler32 (adler32-zlib) [ 1425.273315] Lustre: Lustre: Build Version: 2.16.61_48_ga3a4329 [ 1425.440540] LNet: Added LNI 192.168.201.155@tcp [8/256/0/180] [ 1427.071186] Key type lgssc registered [ 1427.898819] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1435.601076] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1435.623900] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1437.058850] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1441.860258] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 1447.355648] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1453.833287] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1454.160326] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1459.399168] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 1462.388411] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:140 to 0x240000400:161) [ 1462.490471] Lustre: 61668:0:(osd_internal.h:1472:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 515 < left 544, rollback = 9 [ 1462.508760] Lustre: 61668:0:(osd_handler.c:2082:osd_trans_dump_creds()) create: 32/128/0, destroy: 0/0/0 [ 1462.522980] Lustre: 61668:0:(osd_handler.c:2089:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 1462.532728] Lustre: 61668:0:(osd_handler.c:2099:osd_trans_dump_creds()) write: 2/13/1, punch: 0/0/0, quota 1/3/0 [ 1462.541445] Lustre: 61668:0:(osd_handler.c:2106:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 1462.550285] Lustre: 61668:0:(osd_handler.c:2113:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 1464.065779] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1468.110101] Lustre: DEBUG MARKER: check files after shrinking the MDT and OST filesystems [ 1478.113499] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1478.115591] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1478.141963] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1480.576149] LustreError: 62365:0:(obd_class.h:479:obd_check_dev()) Device 13 not setup [ 1480.681797] Lustre: server umount lustre-OST0000 complete [ 1483.913608] LustreError: 62567:0:(obd_class.h:479:obd_check_dev()) Device 8 not setup [ 1483.918070] LustreError: 62567:0:(obd_class.h:479:obd_check_dev()) Skipped 1 previous similar message [ 1484.050825] Lustre: server umount lustre-MDT0000 complete [ 1490.715808] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing unload_modules_local [ 1492.607356] Key type lgssc unregistered [ 1492.829942] LNet: 63099:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1492.840234] LNetError: 63099:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1492.856668] LNet: Removed LNI 192.168.201.155@tcp [ 1493.420512] Key type .llcrypt unregistered [ 1493.422942] Key type ._llcrypt unregistered [ 1507.576820] Key type ._llcrypt registered [ 1507.578253] Key type .llcrypt registered [ 1507.653503] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_hostid [ 1518.978726] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [ 1519.622866] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1519.652203] alg: No test for adler32 (adler32-zlib) [ 1520.740699] Lustre: Lustre: Build Version: 2.16.61_48_ga3a4329 [ 1520.927873] LNet: Added LNI 192.168.201.155@tcp [8/256/0/180] [ 1522.575173] Key type lgssc registered [ 1523.475690] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1530.576227] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 1535.822628] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 1541.323763] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 1547.410254] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 1553.613357] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 1553.662203] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1553.673931] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1554.871265] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1554.903967] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1554.961882] Lustre: lustre-MDT0000: new disk, initializing [ 1555.039403] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1555.059311] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1558.474814] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 1567.996889] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 1568.042719] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1568.155640] Lustre: 66206:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1568.198393] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 1568.201803] Lustre: Skipped 1 previous similar message [ 1568.255246] Lustre: lustre-MDT0001: new disk, initializing [ 1568.371936] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1568.420291] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 1568.431526] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1571.755370] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 1578.699773] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1581.970772] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1587.337171] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 1587.398166] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1587.603638] Lustre: lustre-OST0000: new disk, initializing [ 1587.608658] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1587.703691] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1592.576504] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 1593.919588] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 1593.925434] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1593.998906] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1598.578275] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1601.761908] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1601.941495] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1605.060730] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1605.247391] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1609.696762] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1609.700142] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1609.709771] LustreError: Skipped 1 previous similar message [ 1609.710661] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1609.717037] Lustre: Skipped 1 previous similar message [ 1609.727863] Lustre: Skipped 1 previous similar message [ 1612.862165] LustreError: 69145:0:(obd_class.h:479:obd_check_dev()) Device 19 not setup [ 1612.976174] Lustre: server umount lustre-OST0000 complete [ 1619.429457] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1619.433657] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1619.440740] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1622.164517] LustreError: 69347:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup [ 1622.167493] LustreError: 69347:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 1622.243909] Lustre: server umount lustre-MDT0000 complete [ 1625.205981] LustreError: 66197:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763343384 with bad export cookie 3381489189610942808 [ 1625.210537] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1625.221514] LustreError: 66197:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 1625.357533] LustreError: 69549:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 1625.360412] LustreError: 69549:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 1625.476776] Lustre: server umount lustre-MDT0001 complete [ 1633.897342] Lustre: DEBUG MARKER: == conf-sanity test 79: format MDT/OST without mgs option (should return errors) ========================================================== 20:36:32 (1763343392) [ 1643.016513] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [ 1652.268261] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 1672.112207] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_hostid [ 1679.080349] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [ 1687.104168] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 1692.401995] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 1697.969585] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 1703.141312] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 1708.565370] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 1708.608285] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1708.754828] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1708.784915] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1708.831323] Lustre: lustre-MDT0000: new disk, initializing [ 1708.899913] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1708.916025] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1711.725912] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 1720.361589] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 1720.448325] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1720.556390] Lustre: 73789:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1720.621106] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 1720.623600] Lustre: Skipped 1 previous similar message [ 1720.680757] Lustre: lustre-MDT0001: new disk, initializing [ 1720.812654] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1720.871596] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 1720.884889] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1724.327743] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 1730.986925] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1734.275922] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1740.030818] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 1740.101652] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1740.313391] Lustre: lustre-OST0000: new disk, initializing [ 1740.319108] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1740.385358] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1744.862630] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 1748.575146] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 1748.590696] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1748.717541] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1751.558895] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1754.688887] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1754.829468] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1757.783535] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1757.972346] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1764.322220] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1764.325419] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1764.330826] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1764.354451] Lustre: Skipped 2 previous similar messages [ 1764.356663] Lustre: Skipped 1 previous similar message [ 1765.508125] LustreError: 76727:0:(obd_class.h:479:obd_check_dev()) Device 19 not setup [ 1765.512910] LustreError: 76727:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 1765.746266] Lustre: server umount lustre-OST0000 complete [ 1769.440637] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1769.442821] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1769.450400] Lustre: Skipped 1 previous similar message [ 1769.453041] Lustre: Skipped 1 previous similar message [ 1774.566824] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1774.585342] Lustre: Skipped 2 previous similar messages [ 1774.835679] LustreError: 76928:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup [ 1774.848257] LustreError: 76928:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 1774.934806] Lustre: server umount lustre-MDT0000 complete [ 1778.074842] LustreError: 73780:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763343537 with bad export cookie 3381489189610943690 [ 1778.080509] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1778.088347] LustreError: 73780:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 1778.319054] Lustre: server umount lustre-MDT0001 complete [ 1784.236216] Lustre: DEBUG MARKER: == conf-sanity test 80: mgc import reconnect race ======== 20:39:03 (1763343543) [ 1788.429638] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1788.710233] LustreError: 77800:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1788.726717] LustreError: 77800:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 1788.780510] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1791.403265] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 1794.025205] LustreError: 77800:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1799.143160] LustreError: 77800:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1800.008757] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1804.258620] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 1809.003752] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1811.775418] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1817.448670] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1822.612701] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 1827.239695] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1829.570220] Lustre: 80138:0:(genops.c:1791:obd_export_evict_by_uuid()) MGS: evicting 43a22526-1e2f-44af-ae12-3bd6279d36f7 at adminstrative request [ 1830.373232] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1830.400200] Lustre: *** cfs_fail_loc=906, val=2147483648*** [ 1840.673776] Lustre: MGS: Client 43a22526-1e2f-44af-ae12-3bd6279d36f7 (at 0@lo) reconnecting [ 1840.687605] Lustre: Evicted from MGS (at 0@lo) after server handle changed from 0x2eed76808695783c to 0x2eed768086957ad5 [ 1840.714915] Lustre: MGC192.168.201.155@tcp: Connection restored to 0@lo (at 0@lo) [ 1865.707835] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 1865.768411] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1866.008397] Lustre: lustre-OST0001: new disk, initializing [ 1866.012272] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 1866.120638] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 1866.126733] Lustre: Skipped 2 previous similar messages [ 1871.787688] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 1872.454161] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 1872.472492] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 1872.568649] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 1877.802787] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 1883.106790] LustreError: lustre-OST0001-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1883.106892] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1883.111159] LustreError: Skipped 2 previous similar messages [ 1883.118647] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 1883.126413] Lustre: Skipped 1 previous similar message [ 1885.758813] LustreError: 81276:0:(obd_class.h:479:obd_check_dev()) Device 25 not setup [ 1885.763630] LustreError: 81276:0:(obd_class.h:479:obd_check_dev()) Skipped 13 previous similar messages [ 1885.856265] Lustre: server umount lustre-OST0001 complete [ 1888.228206] LustreError: 79398:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1888.244610] LustreError: 79398:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 1890.785327] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1891.808233] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1891.814356] Lustre: Skipped 2 previous similar messages [ 1893.356753] LustreError: 79398:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1893.375137] LustreError: 79398:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 1895.421913] Lustre: server umount lustre-OST0000 complete [ 1903.072086] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1903.078386] LustreError: Skipped 1 previous similar message [ 1903.087919] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1903.092470] Lustre: Skipped 4 previous similar messages [ 1913.311518] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 1913.539384] LustreError: 81679:0:(obd_class.h:479:obd_check_dev()) Device 28 not setup [ 1913.558297] LustreError: 81679:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 1913.752487] Lustre: server umount lustre-MDT0000 complete [ 1913.833821] LustreError: 79861:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1913.874506] LustreError: 79861:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 1918.003229] LustreError: 77779:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763343677 with bad export cookie 3381489189610945237 [ 1918.010842] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1918.386336] Lustre: server umount lustre-MDT0001 complete [ 1928.162478] Lustre: DEBUG MARKER: == conf-sanity test 81: sparse OST indexing ============== 20:41:25 (1763343685) [ 1929.978903] Lustre: DEBUG MARKER: SKIP: conf-sanity test_81 needs >= 3 OSTs [ 1931.893188] Lustre: DEBUG MARKER: == conf-sanity test 82a: specify OSTs for file (succeed) or directory (succeed) ========================================================== 20:41:30 (1763343690) [ 1933.550426] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82a needs >= 3 OSTs [ 1935.257199] Lustre: DEBUG MARKER: == conf-sanity test 82b: specify OSTs for file with --pool and --ost-list options ========================================================== 20:41:33 (1763343693) [ 1936.509585] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82b needs >= 4 OSTs [ 1938.291904] Lustre: DEBUG MARKER: == conf-sanity test 83: ENOSPACE on OST doesn't cause message VFS: Busy inodes after unmount ... ========================================================== 20:41:36 (1763343696) [ 1939.728143] Lustre: DEBUG MARKER: mount the OST /dev/mapper/ost1_flakey as a ldiskfs filesystem [ 1944.316703] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 1945.115421] loop: module loaded [ 1945.129564] loop0: detected capacity change from 0 to 4294967296 [ 1945.154520] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 1946.468156] Lustre: DEBUG MARKER: run llverfs in partial mode on the OST ldiskfs /mnt/lustre-ost1 [ 1948.888528] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing run_llverfs /mnt/lustre-ost1 -vpl no [ 1952.163816] Lustre: DEBUG MARKER: unmount the OST /dev/mapper/ost1_flakey [ 1958.258839] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 1960.991712] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 1963.658369] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 1966.571966] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 1972.671445] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 1972.744604] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1972.769520] LustreError: 84459:0:(obd_config.c:783:class_setup()) setup lustre-OST0000-osd failed (-28) [ 1972.780220] LustreError: 84459:0:(obd_mount.c:193:lustre_start_simple()) lustre-OST0000-osd setup error -28 [ 1972.787539] LustreError: 84459:0:(tgt_mount.c:2447:server_fill_super()) Unable to start osd on /dev/mapper/ost1_flakey: -28 [ 1972.793889] LustreError: 84459:0:(super25.c:199:lustre_fill_super()) llite: Unable to mount : rc = -28 [ 1988.626277] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_hostid [ 1996.997755] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [ 2006.197713] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2012.013689] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2016.343018] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2020.633279] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2025.888356] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2025.942639] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2026.117711] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2026.143630] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2026.223487] Lustre: lustre-MDT0000: new disk, initializing [ 2026.359859] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2026.374924] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2029.663514] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 2039.585388] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2039.646175] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 2039.745396] Lustre: 87306:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2039.997521] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2043.876597] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 2050.752743] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2054.169939] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2060.800936] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2060.884226] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 2067.714791] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 2070.629226] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2070.789441] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2074.451815] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2077.523985] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2077.709227] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2080.720556] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2080.884194] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2086.375150] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2086.378581] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2086.379175] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2086.384036] Lustre: Skipped 3 previous similar messages [ 2086.392574] Lustre: Skipped 3 previous similar messages [ 2088.580464] LustreError: 90247:0:(obd_class.h:479:obd_check_dev()) Device 19 not setup [ 2088.593553] LustreError: 90247:0:(obd_class.h:479:obd_check_dev()) Skipped 17 previous similar messages [ 2088.844478] Lustre: server umount lustre-OST0000 complete [ 2107.360601] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2107.680831] Lustre: server umount lustre-MDT0000 complete [ 2110.946378] LustreError: 87314:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2110.970080] LustreError: 87314:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 2111.481979] LustreError: 87300:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763343870 with bad export cookie 3381489189610945839 [ 2111.483484] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2111.493073] LustreError: 87300:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 8 previous similar messages [ 2111.776851] Lustre: server umount lustre-MDT0001 complete [ 2119.326680] Lustre: DEBUG MARKER: == conf-sanity test 84: check recovery_hard_time ========= 20:44:37 (1763343877) [ 2124.314464] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2128.224920] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 2135.521030] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 2138.873786] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 2144.017423] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2146.947648] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2152.768799] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 2157.972570] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 2163.023543] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2166.715182] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2171.136671] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 4 sec [ 2174.199452] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2174.389721] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2180.209811] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2180.275792] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 2180.401161] Lustre: lustre-OST0001: new disk, initializing [ 2180.404054] Lustre: Skipped 2 previous similar messages [ 2180.408225] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 2180.420872] Lustre: Skipped 3 previous similar messages [ 2180.559145] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 2180.564365] Lustre: Skipped 5 previous similar messages [ 2186.354962] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 2190.168160] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 2190.174210] Lustre: Skipped 2 previous similar messages [ 2190.179498] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 2190.327814] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 2194.662171] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 2198.992108] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid 50 [ 2199.298354] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2203.562614] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [ 2203.723121] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2218.678652] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 2243.453306] Lustre: Failing over lustre-MDT0000 [ 2243.555704] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2243.562897] LustreError: Skipped 2 previous similar messages [ 2243.566115] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2243.578719] Lustre: Skipped 2 previous similar messages [ 2243.583796] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2243.586706] Lustre: Skipped 7 previous similar messages [ 2245.733936] LustreError: 96260:0:(obd_class.h:479:obd_check_dev()) Device 28 not setup [ 2245.741201] LustreError: 96260:0:(obd_class.h:479:obd_check_dev()) Skipped 17 previous similar messages [ 2245.794571] Lustre: server umount lustre-MDT0000 complete [ 2246.495667] LustreError: 91318:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.55@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2246.512302] LustreError: 91318:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 4 previous similar messages [ 2261.985222] Lustre: 64417:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1763344005/real 1763344005] req@0000000078b6ea53 x1848999443417088/t0(0) o400->MGC192.168.201.155@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1763344021 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 2262.030418] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2268.210769] LDISKFS-fs (dm-0): 4 truncates cleaned up [ 2268.214160] LDISKFS-fs (dm-0): recovery complete [ 2268.222565] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2272.236859] Lustre: Evicted from MGS (at 0@lo) after server handle changed from 0x0 to 0x2eed76808696453b [ 2272.252377] Lustre: MGC192.168.201.155@tcp: Connection restored to 0@lo (at 0@lo) [ 2272.542855] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 2273.103104] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 2273.106467] Lustre: 92745:0:(ldlm_lib.c:2067:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 2276.349467] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 2277.863133] Lustre: lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 2277.866593] Lustre: 91321:0:(ldlm_lib.c:2067:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 2277.875461] Lustre: 91321:0:(ldlm_lib.c:2067:extend_recovery_timer()) Skipped 1 previous similar message [ 2277.936247] LustreError: 97010:0:(ldlm_lib.c:2679:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2278.255270] LustreError: 97010:0:(ldlm_lib.c:2679:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2278.579388] LustreError: 97010:0:(ldlm_lib.c:2679:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2278.590328] LustreError: 97010:0:(ldlm_lib.c:2679:replay_request_or_update()) Skipped 1 previous similar message [ 2278.927184] LustreError: 97010:0:(ldlm_lib.c:2679:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2278.932946] LustreError: 97010:0:(ldlm_lib.c:2679:replay_request_or_update()) Skipped 1 previous similar message [ 2278.937304] Lustre: 97010:0:(ldlm_lib.c:2067:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2278.953986] Lustre: 97010:0:(ldlm_lib.c:2067:extend_recovery_timer()) Skipped 7 previous similar messages [ 2279.616130] LustreError: 97010:0:(ldlm_lib.c:2679:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2279.620422] LustreError: 97010:0:(ldlm_lib.c:2679:replay_request_or_update()) Skipped 2 previous similar messages [ 2279.943207] LustreError: 97010:0:(ldlm_lib.c:2679:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2279.967214] LustreError: 97010:0:(ldlm_lib.c:2679:replay_request_or_update()) Skipped 2 previous similar messages [ 2281.004695] Lustre: 97010:0:(ldlm_lib.c:2067:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2281.018041] Lustre: 97010:0:(ldlm_lib.c:2067:extend_recovery_timer()) Skipped 5 previous similar messages [ 2281.664506] LustreError: 97010:0:(ldlm_lib.c:2679:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2281.677165] LustreError: 97010:0:(ldlm_lib.c:2679:replay_request_or_update()) Skipped 5 previous similar messages [ 2281.991492] LustreError: 97010:0:(ldlm_lib.c:2679:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2281.994391] LustreError: 97010:0:(ldlm_lib.c:2679:replay_request_or_update()) Skipped 5 previous similar messages [ 2285.191245] Lustre: 97010:0:(ldlm_lib.c:2067:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2285.209088] Lustre: 97010:0:(ldlm_lib.c:2067:extend_recovery_timer()) Skipped 12 previous similar messages [ 2285.877483] LustreError: 97010:0:(ldlm_lib.c:2679:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2285.895494] LustreError: 97010:0:(ldlm_lib.c:2679:replay_request_or_update()) Skipped 12 previous similar messages [ 2286.220049] LustreError: 97010:0:(ldlm_lib.c:2679:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2286.223730] LustreError: 97010:0:(ldlm_lib.c:2679:replay_request_or_update()) Skipped 12 previous similar messages [ 2293.234890] Lustre: 97010:0:(ldlm_lib.c:2067:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2293.250977] Lustre: 97010:0:(ldlm_lib.c:2067:extend_recovery_timer()) Skipped 24 previous similar messages [ 2293.914511] LustreError: 97010:0:(ldlm_lib.c:2679:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2293.921318] LustreError: 97010:0:(ldlm_lib.c:2679:replay_request_or_update()) Skipped 24 previous similar messages [ 2294.242935] LustreError: 97010:0:(ldlm_lib.c:2679:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2294.271606] LustreError: 97010:0:(ldlm_lib.c:2679:replay_request_or_update()) Skipped 24 previous similar messages [ 2309.337250] Lustre: 97010:0:(ldlm_lib.c:2067:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2309.360690] Lustre: 97010:0:(ldlm_lib.c:2067:extend_recovery_timer()) Skipped 49 previous similar messages [ 2310.019794] LustreError: 97010:0:(ldlm_lib.c:2679:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2310.055638] LustreError: 97010:0:(ldlm_lib.c:2679:replay_request_or_update()) Skipped 49 previous similar messages [ 2310.383286] LustreError: 97010:0:(ldlm_lib.c:2679:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2310.399859] LustreError: 97010:0:(ldlm_lib.c:2679:replay_request_or_update()) Skipped 49 previous similar messages [ 2333.095168] Lustre: 97010:0:(ldlm_lib.c:2375:target_recovery_overseer()) lustre-MDT0000 recovery is aborted by hard timeout [ 2333.104232] Lustre: 97010:0:(ldlm_lib.c:2385:target_recovery_overseer()) recovery is aborted, evict exports in recovery [ 2333.129608] Lustre: 97010:0:(genops.c:1618:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client 6553492a-3ad7-439f-bacb-9a04dc8749bf@192.168.201.55@tcp [ 2333.141239] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 2333.156329] Lustre: 97010:0:(ldlm_lib.c:1897:abort_req_replay_queue()) @@@ aborted: req@00000000a97f0ab1 x1848999431702272/t0(8589934768) o35->6553492a-3ad7-439f-bacb-9a04dc8749bf@192.168.201.55@tcp:78/0 lens 392/0 e 0 to 0 dl 1763344103 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:0 [ 2333.179544] Lustre: lustre-MDT0000-osd: cancel update llog [0x200000400:0x1:0x0] [ 2333.187877] Lustre: lustre-MDT0000: Denying connection for new client 6553492a-3ad7-439f-bacb-9a04dc8749bf (at 192.168.201.55@tcp), waiting for 3 known clients (2 recovered, 0 in progress, and 1 evicted) already passed deadline 0:00 [ 2333.196695] Lustre: lustre-MDT0001-osp-MDT0000: cancel update llog [0x240000401:0x1:0x0] [ 2333.281167] Lustre: lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 2333.283766] Lustre: Skipped 2 previous similar messages [ 2333.287787] Lustre: lustre-MDT0000: Recovery over after 1:00, of 3 clients 2 recovered and 1 was evicted. [ 2333.323474] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:77 to 0x280000401:577) [ 2333.325374] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:45 to 0x2c0000401:545) [ 2345.443194] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2345.449065] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2345.458080] Lustre: Skipped 3 previous similar messages [ 2350.874984] Lustre: server umount lustre-OST0000 complete [ 2354.658343] LustreError: 92918:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2354.685024] LustreError: 92918:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 39 previous similar messages [ 2360.387432] Lustre: server umount lustre-OST0001 complete [ 2370.072931] Lustre: server umount lustre-MDT0000 complete [ 2374.006076] LustreError: 91303:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763344133 with bad export cookie 3381489189610997051 [ 2374.009945] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2374.014911] LustreError: 91303:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 2374.165513] LustreError: 98276:0:(obd_class.h:479:obd_check_dev()) Device 27 not setup [ 2374.175435] LustreError: 98276:0:(obd_class.h:479:obd_check_dev()) Skipped 23 previous similar messages [ 2374.341142] Lustre: server umount lustre-MDT0001 complete [ 2382.503959] Lustre: DEBUG MARKER: == conf-sanity test 85: osd_ost init: fail ea_fid_set ==== 20:49:00 (1763344140) [ 2388.464773] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 2388.471400] Lustre: *** cfs_fail_loc=197, val=0*** [ 2404.002813] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 2409.119452] LustreError: 98967:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.201.155@tcp: failed processing log, type 4: rc = -110 [ 2414.269432] Lustre: *** cfs_fail_loc=197, val=0*** [ 2414.271204] Lustre: Skipped 65 previous similar messages [ 2438.987639] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 2443.911407] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2445.848019] Lustre: server umount lustre-OST0000 complete [ 2453.590273] Lustre: DEBUG MARKER: == conf-sanity test 86: Replacing mkfs.lustre -G option == 20:50:11 (1763344211) [ 2472.909608] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2473.402443] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2473.406050] Lustre: Skipped 2 previous similar messages [ 2477.465464] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 2483.680883] LustreError: 100476:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2483.693990] LustreError: 100476:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 6 previous similar messages [ 2484.372730] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2488.152428] LustreError: 100506:0:(osp_object.c:617:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x200000009:0x1:0x0]: rc = -5 [ 2488.170603] LustreError: 100506:0:(lod_sub_object.c:917:lod_sub_prep_llog()) lustre-MDT0000-mdtlov: can't get id from catalogs: rc = -5 [ 2488.179635] LustreError: 100506:0:(lod_dev.c:510:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 15, retries 0, failed: rc = -5 [ 2488.572986] Lustre: server umount lustre-MDT0000 complete [ 2502.996393] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2525.171263] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_hostid [ 2537.981757] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [ 2549.748183] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2557.560849] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2564.889247] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2572.291969] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2579.556572] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2579.646643] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2579.962965] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2580.012260] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2580.115670] Lustre: lustre-MDT0000: new disk, initializing [ 2580.234230] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2584.255582] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 2594.696803] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2594.783351] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 2594.892779] Lustre: 104549:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2595.166400] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2598.789288] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 2605.720597] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2609.797540] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2616.785361] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2616.874097] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 2623.393124] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 2626.182101] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2629.856938] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2633.510263] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2633.759731] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2637.971203] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2638.172578] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2641.377787] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2641.390699] LustreError: Skipped 4 previous similar messages [ 2641.400360] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2641.429204] Lustre: Skipped 5 previous similar messages [ 2641.432471] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2641.438193] Lustre: Skipped 8 previous similar messages [ 2646.080384] LustreError: 107492:0:(obd_class.h:479:obd_check_dev()) Device 19 not setup [ 2646.094530] LustreError: 107492:0:(obd_class.h:479:obd_check_dev()) Skipped 25 previous similar messages [ 2646.237648] Lustre: server umount lustre-OST0000 complete [ 2656.018661] Lustre: server umount lustre-MDT0000 complete [ 2659.396567] LustreError: 104543:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763344418 with bad export cookie 3381489189611007607 [ 2659.402219] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2659.420399] LustreError: 104543:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 2659.830166] Lustre: server umount lustre-MDT0001 complete [ 2668.051778] Lustre: DEBUG MARKER: == conf-sanity test 87: check if MDT inode can hold EAs with N stripes properly ========================================================== 20:53:46 (1763344426) [ 2677.052774] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing unload_modules_local [ 2680.015710] Key type lgssc unregistered [ 2680.323486] LNet: 108622:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2680.342723] LNetError: 108622:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2680.360074] LNet: Removed LNI 192.168.201.155@tcp [ 2681.248282] Key type .llcrypt unregistered [ 2681.250915] Key type ._llcrypt unregistered [ 2696.987105] Key type ._llcrypt registered [ 2696.992218] Key type .llcrypt registered [ 2697.118895] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_hostid [ 2714.980517] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [ 2716.123131] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2716.163485] alg: No test for adler32 (adler32-zlib) [ 2717.186938] Lustre: Lustre: Build Version: 2.16.61_48_ga3a4329 [ 2717.378285] LNet: Added LNI 192.168.201.155@tcp [8/256/0/180] [ 2719.055642] Key type lgssc registered [ 2720.368160] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2729.565440] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2736.018561] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2741.733946] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2747.656271] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2752.915457] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2759.203421] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2759.248230] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2759.270905] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2760.503874] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2760.548764] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2760.620847] Lustre: lustre-MDT0000: new disk, initializing [ 2760.710536] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2760.740412] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2764.332416] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 2773.586601] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2773.642436] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 2773.808923] Lustre: lustre-OST0000: new disk, initializing [ 2773.817375] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 2773.820360] Lustre: Skipped 1 previous similar message [ 2773.904117] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2779.170345] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 2779.181450] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 2779.225536] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 2779.494658] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 2789.333508] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2789.421184] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 2789.575330] Lustre: lustre-OST0001: new disk, initializing [ 2789.579940] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 2789.664637] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 2795.303462] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 2799.698361] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost [ 2799.702850] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] [ 2799.738293] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 [ 2804.710596] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2804.741129] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2809.753826] LustreError: 114202:0:(obd_class.h:479:obd_check_dev()) Device 17 not setup [ 2809.951428] Lustre: server umount lustre-MDT0000 complete [ 2815.949834] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null) [ 2820.161061] LustreError: 112757:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763344579 with bad export cookie 12865307151861077205 [ 2820.161974] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2820.188107] LustreError: 112757:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 2820.232163] LustreError: 114797:0:(obd_class.h:479:obd_check_dev()) Device 12 not setup [ 2820.236975] LustreError: 114797:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 2820.286881] Lustre: server umount lustre-OST0000 complete [ 2823.403883] LustreError: 114999:0:(obd_class.h:479:obd_check_dev()) Device 2 not setup [ 2823.409160] LustreError: 114999:0:(obd_class.h:479:obd_check_dev()) Skipped 1 previous similar message [ 2823.552878] Lustre: server umount lustre-OST0001 complete [ 2832.839556] Lustre: DEBUG MARKER: == conf-sanity test 88: check the default mount options can be overridden ========================================================== 20:56:30 (1763344590) [ 2841.896175] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [ 2850.116460] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2851.058713] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2855.239776] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2856.020028] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2861.485892] Lustre: DEBUG MARKER: == conf-sanity test 89: check tunefs --param and --erase-param{s} options ========================================================== 20:56:59 (1763344619) [ 2871.095814] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2872.775801] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2874.465083] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2876.159580] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2876.912075] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2878.545933] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2892.296219] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_hostid [ 2902.656574] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [ 2912.287487] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2919.006582] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2926.779968] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2933.372329] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2940.870392] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2940.932336] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2941.113629] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2941.146118] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2941.208282] Lustre: lustre-MDT0000: new disk, initializing [ 2941.309461] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2941.343190] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2945.687489] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 2956.583903] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2956.676063] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 2956.816248] Lustre: 120328:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2956.929706] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 2956.945376] Lustre: Skipped 1 previous similar message [ 2957.097960] Lustre: lustre-MDT0001: new disk, initializing [ 2957.304444] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2957.362737] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 2957.371281] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2961.770186] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 2969.073974] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2973.042368] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2979.407811] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 2979.458882] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 2979.755570] Lustre: lustre-OST0000: new disk, initializing [ 2979.767560] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 2979.875523] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2985.234141] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 2985.571651] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 2985.585202] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2985.738819] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2991.317851] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount (FULL|IDLE) failover.node=192.0.2.254@tcp0,osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2994.580726] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2994.822479] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2998.282994] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2998.474572] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 3001.319204] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3001.320645] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3001.325721] LustreError: Skipped 1 previous similar message [ 3001.332042] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3001.334623] Lustre: Skipped 2 previous similar messages [ 3001.337351] Lustre: Skipped 1 previous similar message [ 3006.415046] LustreError: 123265:0:(obd_class.h:479:obd_check_dev()) Device 19 not setup [ 3006.419176] LustreError: 123265:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 3006.435534] LustreError: 122059:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3006.453454] LustreError: 122059:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 4 previous similar messages [ 3006.528183] Lustre: server umount lustre-OST0000 complete [ 3011.552989] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3011.563349] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3011.571034] Lustre: Skipped 2 previous similar messages [ 3016.672797] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3016.687183] Lustre: Skipped 1 previous similar message [ 3021.792718] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3021.798188] Lustre: Skipped 1 previous similar message [ 3024.352489] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 3024.479879] LustreError: 123468:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup [ 3024.483454] LustreError: 123468:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 3024.561943] Lustre: server umount lustre-MDT0000 complete [ 3026.925942] LustreError: 120340:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3026.940946] LustreError: 120340:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 3027.640831] LustreError: 120320:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763344786 with bad export cookie 12865307151861078416 [ 3027.652770] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3027.656641] LustreError: 120320:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 3028.056799] Lustre: server umount lustre-MDT0001 complete [ 3034.739249] Lustre: DEBUG MARKER: == conf-sanity test 90a: check max_mod_rpcs_in_flight is enforced ========================================================== 20:59:53 (1763344793) [ 3039.555129] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3039.874975] LustreError: 124345:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3039.965877] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3043.727352] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 3045.345606] LustreError: 124345:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3050.465117] LustreError: 124345:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3051.106631] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 3054.834669] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 3059.573627] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3062.973709] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3069.853315] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 3075.052565] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 3080.270693] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3090.010297] Lustre: *** cfs_fail_loc=159, val=0*** [ 3105.702971] Lustre: lustre-MDT0000: Client b2f613fc-155f-439e-9a5d-31dcd7af658a (at 192.168.201.55@tcp) reconnecting [ 3107.056555] Lustre: *** cfs_fail_loc=159, val=0*** [ 3107.060548] Lustre: Skipped 5 previous similar messages [ 3122.542922] Lustre: lustre-MDT0000: Client b2f613fc-155f-439e-9a5d-31dcd7af658a (at 192.168.201.55@tcp) reconnecting [ 3126.753271] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3126.758880] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3126.759739] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3126.765059] Lustre: Skipped 2 previous similar messages [ 3131.450618] LustreError: 126843:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 3131.452589] LustreError: 126843:0:(obd_class.h:479:obd_check_dev()) Skipped 13 previous similar messages [ 3131.533430] Lustre: server umount lustre-OST0000 complete [ 3136.993281] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3137.010894] Lustre: Skipped 1 previous similar message [ 3142.115337] LustreError: 125407:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3142.126784] LustreError: 125407:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 3142.665415] Lustre: server umount lustre-MDT0000 complete [ 3145.569118] LustreError: 124324:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763344904 with bad export cookie 12865307151861079305 [ 3145.578454] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3145.580814] LustreError: 124324:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3145.807116] Lustre: server umount lustre-MDT0001 complete [ 3152.979339] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing unload_modules_local [ 3155.099870] Key type lgssc unregistered [ 3155.378767] LNet: 127778:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3155.388158] LNetError: 127778:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3155.399937] LNet: Removed LNI 192.168.201.155@tcp [ 3156.100723] Key type .llcrypt unregistered [ 3156.107930] Key type ._llcrypt unregistered [ 3174.568230] Key type ._llcrypt registered [ 3174.571522] Key type .llcrypt registered [ 3174.656165] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [ 3175.400113] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3175.410432] alg: No test for adler32 (adler32-zlib) [ 3176.473884] Lustre: Lustre: Build Version: 2.16.61_48_ga3a4329 [ 3176.681546] LNet: Added LNI 192.168.201.155@tcp [8/256/0/180] [ 3178.319169] Key type lgssc registered [ 3179.420827] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3185.983430] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3186.000286] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3187.743855] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3192.353355] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 3196.898483] LustreError: 129154:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3196.909023] LustreError: 129154:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 3201.327885] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 3201.732905] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3206.086829] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 3210.691288] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3214.009569] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3220.592431] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 3220.954117] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3225.481828] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 3229.722970] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3232.240483] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:42 to 0x280000401:65) [ 3242.494711] Lustre: *** cfs_fail_loc=159, val=0*** [ 3258.748558] Lustre: lustre-MDT0000: Client a16374d0-04ea-4243-988a-f7222f3cac16 (at 192.168.201.55@tcp) reconnecting [ 3260.634402] Lustre: *** cfs_fail_loc=159, val=0*** [ 3260.640668] Lustre: Skipped 1 previous similar message [ 3277.179647] Lustre: lustre-MDT0001: Client a16374d0-04ea-4243-988a-f7222f3cac16 (at 192.168.201.55@tcp) reconnecting [ 3278.573587] Lustre: *** cfs_fail_loc=159, val=0*** [ 3278.585476] Lustre: Skipped 2 previous similar messages [ 3295.115168] Lustre: lustre-MDT0001: Client a16374d0-04ea-4243-988a-f7222f3cac16 (at 192.168.201.55@tcp) reconnecting [ 3310.427976] Lustre: 131889:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3312.936205] Lustre: *** cfs_fail_loc=159, val=0*** [ 3312.947582] Lustre: Skipped 5 previous similar messages [ 3328.368079] Lustre: lustre-MDT0000: Client b53a18b0-f54c-4948-956d-06abb9876afe (at 192.168.201.55@tcp) reconnecting [ 3329.504779] Lustre: *** cfs_fail_loc=159, val=0*** [ 3329.511314] Lustre: Skipped 13 previous similar messages [ 3345.786327] Lustre: lustre-MDT0000: Client b53a18b0-f54c-4948-956d-06abb9876afe (at 192.168.201.55@tcp) reconnecting [ 3346.858590] Lustre: 132178:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3365.344946] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3365.352249] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3365.363674] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3365.364718] Lustre: Skipped 1 previous similar message [ 3365.372048] Lustre: Skipped 1 previous similar message [ 3370.464833] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3370.467682] Lustre: Skipped 1 previous similar message [ 3370.877178] LustreError: 132302:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 3370.949497] Lustre: server umount lustre-OST0000 complete [ 3375.588411] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3375.591827] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3375.594895] Lustre: Skipped 1 previous similar message [ 3375.610474] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3379.818295] LustreError: 132503:0:(obd_class.h:479:obd_check_dev()) Device 9 not setup [ 3379.823356] LustreError: 132503:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 3379.887471] Lustre: server umount lustre-MDT0000 complete [ 3380.715149] LustreError: 131703:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3382.761032] LustreError: 129134:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763345142 with bad export cookie 6943382834549578175 [ 3382.761728] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3382.766951] LustreError: 129134:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 1 previous similar message [ 3382.865492] LustreError: 132705:0:(obd_class.h:479:obd_check_dev()) Device 16 not setup [ 3382.872571] LustreError: 132705:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 3382.998646] Lustre: server umount lustre-MDT0001 complete [ 3391.106796] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing unload_modules_local [ 3393.286894] Key type lgssc unregistered [ 3393.512784] LNet: 133237:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3393.528762] LNetError: 133237:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3393.545265] LNet: Removed LNI 192.168.201.155@tcp [ 3394.155923] Key type .llcrypt unregistered [ 3394.157877] Key type ._llcrypt unregistered [ 3412.644396] Key type ._llcrypt registered [ 3412.645971] Key type .llcrypt registered [ 3412.748234] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [ 3413.515103] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3413.575335] alg: No test for adler32 (adler32-zlib) [ 3414.587876] Lustre: Lustre: Build Version: 2.16.61_48_ga3a4329 [ 3414.767169] LNet: Added LNI 192.168.201.155@tcp [8/256/0/180] [ 3416.399180] Key type lgssc registered [ 3417.391193] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3424.739890] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3424.767104] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3426.350554] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3430.229588] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 3436.514477] LustreError: 134613:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3436.557369] LustreError: 134613:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 3438.395156] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 3439.026286] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3442.750284] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 3447.483605] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3451.124592] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3457.327521] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 3457.617169] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3463.303410] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 3463.787639] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:97) [ 3467.601649] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3470.969561] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:129) [ 3476.952192] Lustre: 136860:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3479.325684] Lustre: 136908:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3480.700721] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 in log params [ 3481.546227] Lustre: Setting parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=8 in log params [ 3484.391859] Lustre: 137056:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify lustre/mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 (mode = 0) failed: rc = -17 [ 3485.126086] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=7 in log params [ 3485.893194] Lustre: 137154:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3489.760474] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3489.766851] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3489.783233] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3491.812136] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3491.813330] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3491.818678] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3494.841322] LustreError: 137262:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 3494.952973] Lustre: server umount lustre-OST0000 complete [ 3500.516827] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3500.519876] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3500.534762] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3500.537819] Lustre: Skipped 1 previous similar message [ 3504.304652] LustreError: 137464:0:(obd_class.h:479:obd_check_dev()) Device 9 not setup [ 3504.310939] LustreError: 137464:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 3504.411808] Lustre: server umount lustre-MDT0000 complete [ 3507.169581] LustreError: 134609:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3507.179359] LustreError: 134609:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 3507.655332] LustreError: 134594:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763345266 with bad export cookie 7810114662542901343 [ 3507.661203] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3507.670921] LustreError: 134594:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3507.859270] LustreError: 137665:0:(obd_class.h:479:obd_check_dev()) Device 16 not setup [ 3507.867554] LustreError: 137665:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 3508.026577] Lustre: server umount lustre-MDT0001 complete [ 3515.336632] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing unload_modules_local [ 3517.463219] Key type lgssc unregistered [ 3517.704387] LNet: 138195:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3517.711116] LNetError: 138195:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3517.727690] LNet: Removed LNI 192.168.201.155@tcp [ 3518.321712] Key type .llcrypt unregistered [ 3518.323802] Key type ._llcrypt unregistered [ 3536.420981] Key type ._llcrypt registered [ 3536.425955] Key type .llcrypt registered [ 3536.520874] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [ 3537.062703] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3537.076860] alg: No test for adler32 (adler32-zlib) [ 3538.071271] Lustre: Lustre: Build Version: 2.16.61_48_ga3a4329 [ 3538.230817] LNet: Added LNI 192.168.201.155@tcp [8/256/0/180] [ 3539.879584] Key type lgssc registered [ 3540.685444] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3547.974426] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3547.993809] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3549.402715] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3553.799521] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 3558.884801] LustreError: 139571:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3558.900219] LustreError: 139571:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 3561.509779] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 3561.770934] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3565.049219] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 3570.190608] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3573.870582] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3579.197362] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 3579.444044] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3583.456890] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 3586.615231] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:129) [ 3587.755797] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3593.792630] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:161) [ 3602.670790] Lustre: *** cfs_fail_loc=159, val=0*** [ 3619.207197] Lustre: lustre-MDT0000: Client d621dbe7-bcc3-44d8-8792-cee5e9b11ca2 (at 192.168.201.55@tcp) reconnecting [ 3637.732923] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3637.736483] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3637.769828] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3639.779863] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3639.786646] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3639.793871] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3642.369052] LustreError: 141972:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 3642.542413] Lustre: server umount lustre-OST0000 complete [ 3648.992229] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3649.008730] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3649.045193] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3649.060317] Lustre: Skipped 1 previous similar message [ 3652.656728] LustreError: 142175:0:(obd_class.h:479:obd_check_dev()) Device 9 not setup [ 3652.659693] LustreError: 142175:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 3652.747760] Lustre: server umount lustre-MDT0000 complete [ 3655.141914] LustreError: 141738:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3655.163222] LustreError: 141738:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 3655.949216] LustreError: 139552:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763345415 with bad export cookie 2973219300894864457 [ 3655.951082] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3655.962833] LustreError: 139552:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 3656.104396] LustreError: 142377:0:(obd_class.h:479:obd_check_dev()) Device 16 not setup [ 3656.115070] LustreError: 142377:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 3656.266041] Lustre: server umount lustre-MDT0001 complete [ 3664.096950] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing unload_modules_local [ 3665.825952] Key type lgssc unregistered [ 3666.043701] LNet: 142907:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3666.050757] LNetError: 142907:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3666.068587] LNet: Removed LNI 192.168.201.155@tcp [ 3666.685555] Key type .llcrypt unregistered [ 3666.688229] Key type ._llcrypt unregistered [ 3684.395272] Key type ._llcrypt registered [ 3684.396780] Key type .llcrypt registered [ 3684.527750] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [ 3685.368537] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3685.393950] alg: No test for adler32 (adler32-zlib) [ 3686.414947] Lustre: Lustre: Build Version: 2.16.61_48_ga3a4329 [ 3686.633505] LNet: Added LNI 192.168.201.155@tcp [8/256/0/180] [ 3688.306468] Key type lgssc registered [ 3689.332834] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3695.430155] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3695.454794] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3696.946567] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3700.213337] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 3707.371219] LustreError: 144283:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3707.403608] LustreError: 144283:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 3707.757836] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 3708.043783] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3711.364603] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 3716.027810] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3719.153892] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3725.474605] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 3725.849159] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3730.788444] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 3733.045632] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:161) [ 3736.242119] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3743.291238] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:170 to 0x280000401:193) [ 3765.619777] Lustre: lustre-OST0000: evicting 6fb8b16b-1936-42a2-93bb-92ed8da515f4 (at 192.168.201.55@tcp) by administrative request [ 3765.623801] Lustre: Skipped 1 previous similar message [ 3794.409188] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3794.410267] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3794.411769] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3794.426416] Lustre: Skipped 1 previous similar message [ 3798.462080] LustreError: 147085:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 3798.584461] Lustre: server umount lustre-OST0000 complete [ 3804.642280] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3804.643254] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3804.650553] Lustre: Skipped 1 previous similar message [ 3804.654469] Lustre: Skipped 1 previous similar message [ 3807.744447] LustreError: 147286:0:(obd_class.h:479:obd_check_dev()) Device 9 not setup [ 3807.751471] LustreError: 147286:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 3807.821405] Lustre: server umount lustre-MDT0000 complete [ 3809.761478] LustreError: 144283:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3809.779318] LustreError: 144283:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 3810.634954] LustreError: 144263:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763345569 with bad export cookie 5459660157226389061 [ 3810.637744] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3810.645159] LustreError: 144263:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 3810.800652] LustreError: 147487:0:(obd_class.h:479:obd_check_dev()) Device 16 not setup [ 3810.803691] LustreError: 147487:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 3810.939828] Lustre: server umount lustre-MDT0001 complete [ 3820.342888] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing unload_modules_local [ 3822.938726] Key type lgssc unregistered [ 3823.220753] LNet: 148020:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3823.234900] LNetError: 148020:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3823.257594] LNet: Removed LNI 192.168.201.155@tcp [ 3823.987532] Key type .llcrypt unregistered [ 3823.989250] Key type ._llcrypt unregistered [ 3890.368560] Key type ._llcrypt registered [ 3890.369961] Key type .llcrypt registered [ 3890.435742] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [ 3891.183202] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3891.287736] alg: No test for adler32 (adler32-zlib) [ 3892.339949] Lustre: Lustre: Build Version: 2.16.61_48_ga3a4329 [ 3892.490380] LNet: Added LNI 192.168.201.155@tcp [8/256/0/180] [ 3894.151268] Key type lgssc registered [ 3895.088740] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3901.508608] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3901.523436] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3902.905862] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3906.238298] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 3913.195235] LustreError: 150467:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3913.215211] LustreError: 150467:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 3913.947711] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 3914.715628] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3919.456978] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 3926.082054] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3930.766390] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3936.970320] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 3937.297351] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3939.380978] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:193) [ 3942.743588] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 3947.533549] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3948.595534] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:195 to 0x280000401:225) [ 3963.875028] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3963.875846] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3963.881146] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3963.896558] Lustre: Skipped 1 previous similar message [ 3966.023855] LustreError: 152747:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 3966.145449] Lustre: server umount lustre-OST0000 complete [ 3971.040192] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3971.044093] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3971.052615] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3971.055458] Lustre: Skipped 1 previous similar message [ 3974.112985] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3974.113890] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3974.141303] Lustre: Skipped 1 previous similar message [ 3975.475370] LustreError: 152948:0:(obd_class.h:479:obd_check_dev()) Device 9 not setup [ 3975.516380] LustreError: 152948:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 3975.640763] Lustre: server umount lustre-MDT0000 complete [ 3979.233586] LustreError: 150464:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3979.274036] LustreError: 150464:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 3979.302391] LustreError: 150447:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763345738 with bad export cookie 11605682081229414893 [ 3979.306344] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3979.313366] LustreError: 150447:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 3979.447217] LustreError: 153150:0:(obd_class.h:479:obd_check_dev()) Device 16 not setup [ 3979.454991] LustreError: 153150:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 3979.614607] Lustre: server umount lustre-MDT0001 complete [ 3988.397491] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing unload_modules_local [ 3990.673626] Key type lgssc unregistered [ 3990.885446] LNet: 153682:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3990.892609] LNetError: 153682:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3990.906254] LNet: Removed LNI 192.168.201.155@tcp [ 3991.586574] Key type .llcrypt unregistered [ 3991.588160] Key type ._llcrypt unregistered [ 4012.700924] Key type ._llcrypt registered [ 4012.702722] Key type .llcrypt registered [ 4012.825200] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [ 4013.399823] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4013.436215] alg: No test for adler32 (adler32-zlib) [ 4014.518692] Lustre: Lustre: Build Version: 2.16.61_48_ga3a4329 [ 4014.738945] LNet: Added LNI 192.168.201.155@tcp [8/256/0/180] [ 4016.431206] Key type lgssc registered [ 4017.304822] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4024.239595] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 4031.734961] Lustre: DEBUG MARKER: == conf-sanity test 100: check lshowmount lists MGS, MDT, OST and 0@lo ========================================================== 21:16:30 (1763345790) [ 4045.844975] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_hostid [ 4054.191520] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [ 4063.131508] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 4070.186992] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 4076.087984] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 4082.713313] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 4088.211705] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 4088.256623] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4088.265458] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4089.427418] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 4089.450861] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 4089.495121] Lustre: lustre-MDT0000: new disk, initializing [ 4089.566928] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4089.583098] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 4092.448645] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 4100.925445] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 4101.009083] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 4101.148908] Lustre: 157905:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 4101.201063] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 4101.203700] Lustre: Skipped 1 previous similar message [ 4101.276173] Lustre: lustre-MDT0001: new disk, initializing [ 4101.356213] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4101.384128] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 4101.395970] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 4104.570979] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 4111.783714] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4115.169745] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4120.162608] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 4120.227920] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 4120.397838] Lustre: lustre-OST0000: new disk, initializing [ 4120.401043] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 4120.486580] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4124.717807] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 4127.283192] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 4127.288412] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 4127.393887] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 4130.592596] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4143.079798] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4143.083657] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4143.085046] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4143.092399] Lustre: Skipped 1 previous similar message [ 4143.097031] LustreError: Skipped 1 previous similar message [ 4145.278855] LustreError: 160490:0:(obd_class.h:479:obd_check_dev()) Device 19 not setup [ 4145.390949] Lustre: server umount lustre-OST0000 complete [ 4152.802136] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4152.810314] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4152.826643] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4152.829273] Lustre: Skipped 1 previous similar message [ 4154.553698] LustreError: 160691:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup [ 4154.560058] LustreError: 160691:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 4154.670561] Lustre: server umount lustre-MDT0000 complete [ 4158.159482] LustreError: 158685:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763345917 with bad export cookie 15247990971936507183 [ 4158.169545] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4158.259195] LustreError: 160893:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 4158.262045] LustreError: 160893:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 4158.397363] Lustre: server umount lustre-MDT0001 complete [ 4167.365765] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing unload_modules_local [ 4169.874161] Key type lgssc unregistered [ 4170.208735] LNet: 161424:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4170.221537] LNetError: 161424:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4170.241711] LNet: Removed LNI 192.168.201.155@tcp [ 4171.074047] Key type .llcrypt unregistered [ 4171.075743] Key type ._llcrypt unregistered [ 4194.657416] Key type ._llcrypt registered [ 4194.660024] Key type .llcrypt registered [ 4194.765989] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [ 4195.549140] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4195.586925] alg: No test for adler32 (adler32-zlib) [ 4196.586359] Lustre: Lustre: Build Version: 2.16.61_48_ga3a4329 [ 4196.753670] LNet: Added LNI 192.168.201.155@tcp [8/256/0/180] [ 4198.376247] Key type lgssc registered [ 4199.362341] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4205.595248] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4205.614395] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4206.953528] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4210.490488] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 4217.313635] LustreError: 162820:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4217.324273] LustreError: 162820:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 4219.085567] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 4219.347029] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4223.850929] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 4230.054104] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4233.435333] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4239.533431] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 4239.792031] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4246.216697] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 4251.292877] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4252.200484] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:33) [ 4258.003942] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4258.018833] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4258.042291] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4258.059250] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4258.089981] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4258.999353] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4259.008585] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4259.015346] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4259.019086] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4259.024563] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4259.932868] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4260.752498] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4260.760532] Lustre: Skipped 1 previous similar message [ 4260.784291] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4260.792515] Lustre: Skipped 1 previous similar message [ 4260.799199] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4260.805313] Lustre: Skipped 1 previous similar message [ 4260.812304] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4260.824082] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4260.833181] Lustre: Skipped 1 previous similar message [ 4261.761681] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4262.635781] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4263.438693] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4263.445960] Lustre: Skipped 2 previous similar messages [ 4263.472903] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4263.478681] Lustre: Skipped 2 previous similar messages [ 4263.481584] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4263.487077] Lustre: Skipped 2 previous similar messages [ 4263.496536] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4263.508706] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4263.525861] Lustre: Skipped 2 previous similar messages [ 4264.376530] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4265.243093] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4266.154893] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4266.967211] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4267.777539] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4267.780748] Lustre: Skipped 4 previous similar messages [ 4267.789772] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4267.796517] Lustre: Skipped 4 previous similar messages [ 4267.802715] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4267.806488] Lustre: Skipped 4 previous similar messages [ 4267.811378] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4267.819684] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4267.824562] Lustre: Skipped 4 previous similar messages [ 4268.571367] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4269.532044] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4270.644187] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4271.458665] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4272.271416] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4273.154826] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4274.196077] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4275.199385] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4276.216531] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4276.251838] Lustre: Skipped 8 previous similar messages [ 4276.276875] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4276.281807] Lustre: Skipped 8 previous similar messages [ 4276.284519] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4276.288586] Lustre: Skipped 8 previous similar messages [ 4276.297861] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4276.335915] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4276.357329] Lustre: Skipped 8 previous similar messages [ 4277.333776] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4278.371750] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4279.408565] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4280.292528] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4281.280765] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4282.430358] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4283.742274] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4284.872422] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4286.041216] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4286.959145] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4288.138935] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4289.059450] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4290.426716] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4291.685132] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4292.768122] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4292.770822] Lustre: Skipped 14 previous similar messages [ 4292.803185] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4292.840929] Lustre: Skipped 14 previous similar messages [ 4292.850672] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4292.853962] Lustre: Skipped 14 previous similar messages [ 4292.865244] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4292.879137] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4292.881898] Lustre: Skipped 14 previous similar messages [ 4293.761839] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4294.826038] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4295.977694] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4297.033645] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4298.043551] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4298.930608] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4299.676397] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4300.531833] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4301.508464] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4302.529743] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4303.362405] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4304.041686] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4304.887777] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4305.741969] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4306.578711] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4307.407221] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4308.228798] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4308.954594] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4309.728481] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4310.586516] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4311.436222] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4312.344604] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4313.051848] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4313.977246] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4314.879092] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4315.751117] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4316.625068] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4317.450640] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4318.333882] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4319.183525] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4319.931891] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4320.690310] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4321.522846] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4322.351575] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4323.176479] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4323.960622] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4324.648896] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4325.415879] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4325.418704] Lustre: Skipped 37 previous similar messages [ 4325.437927] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4325.446538] Lustre: Skipped 37 previous similar messages [ 4325.450596] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4325.455383] Lustre: Skipped 37 previous similar messages [ 4325.458128] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4325.477135] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4325.480184] Lustre: Skipped 37 previous similar messages [ 4326.303652] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4327.160047] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4328.045339] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4328.991529] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4329.785650] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4330.587448] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4331.460303] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4332.201734] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4332.922327] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4333.671913] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4334.629339] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4335.493271] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4336.334966] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4337.308856] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4338.196206] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4339.184725] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4339.987591] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4340.883827] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4341.856156] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4342.844042] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4343.796292] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4344.605198] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4345.474716] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4346.733751] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4347.640865] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4348.803562] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4349.928868] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4350.966570] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4352.306213] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4353.289153] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4354.411691] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4355.533187] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4356.637316] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4357.445692] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4358.558399] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4359.540078] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4360.568939] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4361.485392] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4362.594519] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4363.726690] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4364.984929] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4365.999652] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4366.954528] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4367.861283] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4368.897747] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4370.204862] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4371.176367] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4372.561930] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4373.693068] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4375.103417] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4376.448340] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4377.530683] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4378.543151] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4379.429157] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4380.370173] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4381.418156] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4382.296399] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4383.349235] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4384.264317] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4385.404563] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4386.362931] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4387.407651] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4388.425919] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4389.236881] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4390.204956] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4390.207375] Lustre: Skipped 64 previous similar messages [ 4390.223259] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4390.232371] Lustre: Skipped 64 previous similar messages [ 4390.242752] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4390.248825] Lustre: Skipped 64 previous similar messages [ 4390.258663] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4390.265897] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4390.268769] Lustre: Skipped 64 previous similar messages [ 4391.234566] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4392.207168] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4393.039026] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4393.970242] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4394.924751] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4395.705232] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4396.758096] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4397.659381] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4398.575874] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4399.546964] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4400.685859] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4401.695245] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4402.837848] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4404.011365] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4405.072819] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4406.181812] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4407.142927] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4408.009720] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4408.869277] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4409.781988] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4410.691142] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4411.712532] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4412.581089] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4413.973043] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4414.934533] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4416.028826] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4416.940194] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4417.907700] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4418.824384] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4419.873031] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4420.700773] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4421.492569] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4422.494309] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4423.522236] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4424.534425] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4425.461435] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4426.285612] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4427.187225] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4428.107632] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4428.955684] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4429.947963] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4430.879252] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4432.485744] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4433.419340] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4434.526265] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4435.844959] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4436.784026] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4437.889370] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4438.814973] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4439.767839] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4440.814375] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4442.083516] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4443.115334] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4444.221532] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4445.299994] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4446.298834] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4447.546966] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4448.390109] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4449.338236] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4450.391378] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4451.208203] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4452.249288] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4453.335077] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4454.342382] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4455.214633] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4456.215410] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4457.444842] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4458.390277] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4459.453310] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4460.404187] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4461.707324] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4462.843328] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4463.724336] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4464.764328] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4465.900810] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4466.883420] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4467.794530] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4468.707296] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4469.788813] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4470.746512] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4471.798553] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4472.589281] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4473.575314] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4474.589067] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4475.505366] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4476.325429] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4477.222160] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4478.136663] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4479.219987] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4480.248405] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4481.048352] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4481.999279] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4482.941484] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4483.863440] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4484.992037] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4485.831579] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4486.678571] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4487.626281] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4488.504442] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4489.384399] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4490.148176] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4491.056251] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4491.936212] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4492.807385] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4493.684931] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4494.539923] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4495.582879] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4496.482880] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4497.378255] LustreError: 162839:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 4497.386844] LustreError: 162839:0:(osp_precreate.c:1355:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 4497.393031] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4498.083953] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4499.001983] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4499.849342] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4500.616054] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4501.358473] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4502.250026] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4503.015306] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4503.902545] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4504.687748] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4505.659968] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4506.413379] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4507.160670] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4507.962274] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4508.742955] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4509.534249] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4510.505275] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4511.300264] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4512.235501] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4513.211798] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4514.355699] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4515.518166] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4516.556531] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4517.445563] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4518.262052] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4518.265557] Lustre: Skipped 132 previous similar messages [ 4518.276707] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4518.282963] Lustre: Skipped 132 previous similar messages [ 4518.288140] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4518.290691] Lustre: Skipped 132 previous similar messages [ 4518.297268] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4518.306258] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4518.309014] Lustre: Skipped 132 previous similar messages [ 4519.366091] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4520.428848] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4521.487119] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4522.533649] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4523.599734] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4524.696223] LustreError: 162839:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 4524.703349] LustreError: 162839:0:(osp_precreate.c:1355:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 4524.718824] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4525.563913] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4526.514986] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4527.369673] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4528.283955] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4529.278603] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4530.280094] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4531.225585] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4532.137958] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4532.836209] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4533.711651] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4534.477501] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4535.495932] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4536.700248] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4537.615246] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4538.508284] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4539.458875] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4540.218931] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4540.965796] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4541.828743] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4542.782510] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4543.843671] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4544.816800] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4545.733131] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4546.753640] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4547.911155] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4549.450989] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4550.870890] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4551.840081] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4553.319737] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4554.373382] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4555.429853] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4556.721203] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4558.096091] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4559.502729] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4560.656976] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4561.594682] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4562.643273] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4563.673467] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4564.561993] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4565.547121] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4566.834172] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4567.922792] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4568.922624] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4570.000864] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4571.071318] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4572.187131] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4573.221414] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4574.325638] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4575.432810] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4576.456935] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4577.830301] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4578.932358] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4580.288834] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4581.325906] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4582.432247] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4583.417464] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4584.424860] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4585.337312] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4586.498097] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4587.501449] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4588.514921] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4589.396408] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4590.489990] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4591.597293] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4592.585425] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4593.682201] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4594.686741] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4595.591634] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4596.668556] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4597.456886] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4598.328190] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4599.230293] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4600.113429] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4600.765884] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4601.668878] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4602.466732] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4603.343386] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4604.156541] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4604.978283] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4605.771037] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4606.604244] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4607.682408] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4608.568264] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4609.484541] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4610.367588] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4611.296284] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4612.110663] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4612.871964] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4613.572722] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4614.442209] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4615.544791] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4616.334369] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4617.181627] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4618.019827] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4618.828859] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4619.642449] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4620.476689] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4621.282302] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4622.068978] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4622.995882] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4623.919430] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4624.794156] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4625.780243] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4626.722501] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4627.640355] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4628.662648] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4629.938883] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4631.040773] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4632.101975] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4633.222208] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4634.258777] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4635.380143] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4636.393129] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4637.464887] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4638.568100] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4639.450599] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4640.521434] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4641.519698] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4642.480322] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4643.459964] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4644.365994] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4645.275506] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4646.209728] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4647.175517] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4648.113135] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4648.974416] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4649.878195] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4650.786741] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4651.607438] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4652.512819] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4653.426961] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4654.158882] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4655.072474] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4655.871347] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4656.595062] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4657.372464] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4658.232387] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4659.041845] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4659.789624] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4660.628252] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4661.412339] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4662.375724] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4663.241435] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4664.209306] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4665.248863] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4666.176166] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4667.125833] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4667.983492] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4668.726691] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4669.439870] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4670.213175] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4670.961369] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4671.724825] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4672.445397] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4673.136045] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4673.968063] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4674.902238] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4675.754060] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4676.645798] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4677.488972] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4678.303725] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4679.178418] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4679.963065] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4680.694667] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4681.583145] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4682.478229] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4683.258441] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4684.165252] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4684.960086] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4685.827834] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4686.647954] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4687.494402] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4688.380476] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4689.217783] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4689.994439] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4690.870131] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4691.829325] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4692.753692] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4693.529717] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4694.327745] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4694.984759] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4695.836140] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4696.612392] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4697.520623] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4698.368850] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4699.147750] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4699.955239] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4700.679318] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4701.402946] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4702.208758] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4702.911179] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4703.762592] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4704.548993] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4705.406820] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4706.092414] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4706.968663] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4707.722206] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4708.561453] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4709.311592] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4710.079823] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4710.840756] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4711.609539] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4712.283756] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4713.002526] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4713.731231] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4714.499222] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4715.247311] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4716.101170] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4716.904486] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4717.682037] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4718.544348] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4719.368328] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4720.313810] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4721.084894] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4721.952315] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4722.787156] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4723.601858] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4724.378416] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4725.249187] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4726.098465] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4727.000963] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4727.923281] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4728.858614] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4729.763314] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4730.560115] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4731.440024] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4732.368132] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4733.097349] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4733.926398] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4734.588771] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4735.339819] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4736.009885] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4736.888055] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4737.826480] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4738.669729] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4739.503696] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4740.318495] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4740.982628] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4741.751638] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4742.568379] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4743.357419] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4744.263796] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4745.202923] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4745.969706] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4746.759829] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4747.547073] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4748.292873] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4749.042543] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4749.741899] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4750.528860] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4751.392173] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4752.182586] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4752.983180] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4753.694374] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4754.406728] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4755.295847] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4756.194649] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4756.905845] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4757.774904] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4758.688595] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4759.563546] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4760.360672] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4761.338794] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4762.156327] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4762.858158] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4763.579252] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4764.320327] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4764.950129] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4765.645181] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4766.366430] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4767.092032] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4767.787426] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4768.650113] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4769.451133] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4770.280042] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4771.031456] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4771.790387] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4772.475314] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4773.220640] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4773.930358] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4774.796256] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4774.799565] Lustre: Skipped 286 previous similar messages [ 4774.818716] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4774.834760] Lustre: Skipped 286 previous similar messages [ 4774.839724] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4774.843738] Lustre: Skipped 286 previous similar messages [ 4774.847969] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4774.857259] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4774.860511] Lustre: Skipped 286 previous similar messages [ 4775.649069] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4776.517548] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4777.305696] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4778.216857] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4779.134402] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4780.052325] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4780.944251] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4781.792993] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4782.585474] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4783.467786] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4784.314308] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4785.478142] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4786.376642] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4787.351019] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4788.273573] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4789.463854] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4790.317896] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4791.156426] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4792.216991] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4793.246358] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4794.160947] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4795.313942] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4796.225349] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4797.368986] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4798.263219] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4799.177208] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4800.061720] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4800.951171] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4801.704031] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4802.377182] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4803.226549] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4804.052743] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4804.895262] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4805.680349] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4806.514312] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4807.254290] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4807.992789] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4808.862965] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4809.705189] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4810.542775] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4811.340584] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4812.199475] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4813.175635] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4813.984820] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4814.798784] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4815.405437] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4816.084735] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4816.749937] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4817.413182] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4818.164483] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4819.013405] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4820.082878] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4820.955432] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4821.816491] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4822.610375] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4823.563091] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4824.564856] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4825.542735] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4826.440293] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4827.470723] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4828.413240] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4829.671841] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4830.652697] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4831.805589] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4832.538285] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4833.614847] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4834.717372] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4835.664959] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4836.543652] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4837.398489] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4838.510846] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4839.657493] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4840.701043] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4841.568159] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4842.377890] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4843.264169] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4844.018322] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4844.735292] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4845.497617] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4846.205224] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4846.983937] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4847.902224] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4848.628053] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4849.461251] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4850.427226] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4851.457623] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4852.413830] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4853.276280] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4854.073847] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4854.759346] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4855.658868] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4856.776258] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4857.669704] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4858.483543] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4859.297259] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4860.167587] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4860.981577] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4861.757442] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4862.554726] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4863.298496] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4864.038092] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4864.809130] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4865.530099] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4866.139670] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4866.807483] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4867.479356] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4868.231373] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4868.926605] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4869.651601] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4870.317228] LustreError: 162839:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 4870.322061] LustreError: 162839:0:(osp_precreate.c:1355:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 4870.335823] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4871.068882] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4872.006773] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4872.858705] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4873.609924] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4874.355774] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4875.045954] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4875.783599] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4876.500736] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4877.113177] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4877.726700] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4878.370489] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4879.025290] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4879.640061] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4880.313656] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4880.952139] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4881.648781] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4882.231600] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4882.826728] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4883.394945] LustreError: 162839:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -108 [ 4883.401350] LustreError: 162839:0:(osp_precreate.c:1355:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -108 [ 4883.406866] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4884.098234] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4884.739041] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4885.326209] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4885.854873] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4886.481923] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4887.099733] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4887.612265] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4888.152858] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4888.721542] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4889.290678] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4889.852131] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4890.440375] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4891.001862] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4891.657399] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4892.231125] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4892.826848] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4893.385924] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4894.105275] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4894.733178] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4895.469327] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4896.126216] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4897.030738] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4898.108593] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4899.043897] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4899.833762] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4900.580850] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4901.508108] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4902.374699] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4903.040777] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4903.755341] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4904.467279] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4905.087272] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4905.708139] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4906.273537] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4906.849656] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4907.535450] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4908.185663] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4908.786947] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4909.462257] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4910.022228] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4910.595107] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4911.160344] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4911.846331] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4912.422418] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4912.974227] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4913.656284] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4914.423844] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4915.073920] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4915.762790] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4916.356124] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4917.115761] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4917.778953] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4918.496635] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4919.329316] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4920.140730] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4920.866958] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4921.787952] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4922.685071] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4923.458868] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4924.281781] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4925.122542] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4925.799165] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4926.466539] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4927.325809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4928.073549] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4928.776831] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4929.554843] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4930.337234] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4931.217574] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4931.971889] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4932.696359] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4933.424640] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4934.150100] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4934.909762] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4935.637303] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4936.342029] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4937.047339] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4937.873298] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4938.603262] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4939.396237] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4940.095684] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4940.713244] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4941.385321] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4942.178310] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4942.867765] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4943.590382] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4944.331505] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4944.954224] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4945.569696] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4946.287533] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4947.059075] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4947.784410] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4948.532147] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4949.171180] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4949.849784] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4950.435216] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4951.081200] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4951.764463] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4952.380451] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4952.937854] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4953.602614] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4954.253335] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4955.008830] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4955.700113] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4956.468558] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4957.164816] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4957.912372] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4958.595634] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4959.269267] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4960.078800] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4960.838286] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4961.529622] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4962.256924] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4962.930072] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4963.543879] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4964.149110] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4964.751409] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4965.335338] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4965.922357] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4966.541901] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4967.195617] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4967.807001] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4968.373290] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4969.010458] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4969.641270] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4970.268134] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4970.895548] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4971.514649] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4972.201445] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4972.860089] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4973.533119] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4974.121886] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4974.803193] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4975.529990] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4976.319479] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4977.028101] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4977.909432] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4978.780099] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4979.874225] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4980.716891] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4981.587428] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4982.394099] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4983.245961] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4984.107084] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4985.081525] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4985.991890] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4986.746559] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4987.573791] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4988.235188] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4989.017321] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4989.825875] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4990.672364] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4991.440690] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4992.221445] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4993.029375] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4993.845345] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4994.641266] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4995.471819] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4996.288838] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4997.174413] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4997.967261] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4998.759762] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4999.750629] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5000.611465] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5001.622870] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5002.533899] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5003.558611] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5004.551589] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5005.426199] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5006.325974] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5007.089062] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5007.921346] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5008.758703] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5009.631127] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5010.324560] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5011.055809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5011.955502] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5012.776128] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5013.595688] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5014.386466] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5015.171909] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5016.014562] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5016.901968] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5017.652572] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5018.441797] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5019.163613] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5019.905163] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5020.581947] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5021.275572] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5021.991729] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5022.616987] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5023.226595] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5023.798414] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5024.512742] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5025.376484] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5026.335952] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5027.151958] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5028.060342] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5028.870331] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5029.621412] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5030.431684] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5031.110103] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5031.914281] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5032.717504] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5033.496135] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5034.348424] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5035.059940] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5035.802368] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5036.494698] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5037.303081] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5038.016715] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5038.727700] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5039.526730] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5040.235855] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5041.031519] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5041.897582] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5042.747922] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5043.604477] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5044.300783] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5045.036601] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5045.724044] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5046.609306] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5047.596013] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5048.502188] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5049.315996] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5050.247169] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5051.043692] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5051.960745] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5052.817228] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5053.719826] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5054.535757] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5055.313229] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5056.330567] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5057.270522] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5058.087652] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5059.004242] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5059.868940] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5060.722609] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5061.474633] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5062.358355] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5063.183077] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5063.971363] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5064.932742] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5065.862384] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5066.806280] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5067.672897] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5068.594574] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5069.307322] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5070.038253] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5070.886949] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5071.606718] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5072.248390] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5073.007972] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5073.695483] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5074.361096] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5075.197429] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5076.069426] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5076.857783] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5077.615219] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5078.298833] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5078.987777] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5079.770050] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5080.425343] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5081.065578] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5081.777478] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5082.528606] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5083.238067] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5083.987214] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5084.846677] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5085.532815] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5086.308608] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5087.233574] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5088.158791] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5088.960942] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5089.628669] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5090.420833] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5091.217479] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5092.070065] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5092.903546] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5093.925757] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5094.763476] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5095.639942] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5096.571370] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5097.332933] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5098.156071] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5098.966080] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5099.686306] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5100.470139] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5101.241400] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5101.891170] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5102.682963] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5103.521069] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5104.262844] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5105.054852] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5105.809908] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5106.602938] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5107.330536] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5108.004202] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5108.759682] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5109.585428] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5110.413751] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5111.153681] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5111.909683] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5112.671846] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5113.420794] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5114.275841] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5115.187741] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5116.013223] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5116.826599] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5117.781088] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5118.576257] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5119.507395] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5575.312948] LustreError: 164418:0:(ofd_dev.c:1780:ofd_create_hdl()) lustre-OST0000: unable to precreate: rc = -28 [ 5575.318529] LustreError: 162839:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -28 [ 6348.258191] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 6348.263576] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6348.275854] Lustre: Skipped 441 previous similar messages [ 6348.278589] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6348.771900] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 6348.782599] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6352.359154] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6352.362115] Lustre: Skipped 1 previous similar message [ 6354.313325] LustreError: 216801:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 6354.553956] Lustre: server umount lustre-OST0000 complete [ 6359.520786] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 6359.528296] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6367.714502] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6367.724725] Lustre: Skipped 3 previous similar messages [ 6372.321134] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 6372.452603] LustreError: 217003:0:(obd_class.h:479:obd_check_dev()) Device 9 not setup [ 6372.460906] LustreError: 217003:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 6372.717909] Lustre: server umount lustre-MDT0000 complete [ 6372.832317] LustreError: 162815:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6372.852852] LustreError: 162815:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 6376.393123] LustreError: 162799:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763348135 with bad export cookie 2170427989733449156 [ 6376.399595] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6376.410465] LustreError: 162799:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 6376.589609] LustreError: 217206:0:(obd_class.h:479:obd_check_dev()) Device 16 not setup [ 6376.603614] LustreError: 217206:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 6376.985822] Lustre: server umount lustre-MDT0001 complete [ 6386.366802] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing unload_modules_local [ 6389.072854] Key type lgssc unregistered [ 6389.321155] LNet: 217740:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6389.329242] LNetError: 217740:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6389.354623] LNet: Removed LNI 192.168.201.155@tcp [ 6390.021148] Key type .llcrypt unregistered [ 6390.029864] Key type ._llcrypt unregistered [ 6415.177651] Key type ._llcrypt registered [ 6415.179346] Key type .llcrypt registered [ 6415.287546] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [ 6416.712504] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6416.774869] alg: No test for adler32 (adler32-zlib) [ 6417.755360] Lustre: Lustre: Build Version: 2.16.61_48_ga3a4329 [ 6417.922494] LNet: Added LNI 192.168.201.155@tcp [8/256/0/180] [ 6419.575188] Key type lgssc registered [ 6420.614916] Lustre: Echo OBD driver; http://www.lustre.org/ [ 6427.310351] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 6427.336267] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6428.743849] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6431.690940] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 6438.886077] LustreError: 219135:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6438.906927] LustreError: 219135:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 6439.686390] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 6440.011942] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6443.400125] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 6448.190643] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 6451.924291] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 6458.360581] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 6458.753366] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6464.229125] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 6469.423605] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 6474.112099] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49666 to 0x280000401:49697) [ 6479.442451] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 6481.399604] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6481.407521] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 6481.412392] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6481.425558] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 6481.431089] LustreError: 219156:0:(osp_precreate.c:1263:osp_precreate_thread()) cfs_fail_timeout id 2107 sleeping for 20000ms [ 6484.452654] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6484.463087] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6484.465792] Lustre: Skipped 1 previous similar message [ 6486.388503] Lustre: lustre-OST0000: Not available for connect from 192.168.201.55@tcp (stopping) [ 6489.431198] LustreError: 221537:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 6489.640795] Lustre: server umount lustre-OST0000 complete [ 6501.455128] LustreError: 219156:0:(osp_precreate.c:1263:osp_precreate_thread()) cfs_fail_timeout id 2107 awake [ 6524.155655] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 6524.388378] Lustre: lustre-OST0000: Not available for connect from 0@lo (not set up) [ 6524.514677] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6529.513254] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6529.556630] LustreError: lustre-OST0000-osc-MDT0001: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6529.567243] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 6529.600749] Lustre: Skipped 1 previous similar message [ 6530.602179] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 6535.715145] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 6537.406500] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec [ 6540.754741] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff920cc36b9000.ost_server_uuid 50 [ 6542.315768] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff920cc36b9000.ost_server_uuid in FULL state after 0 sec [ 6547.936912] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 6547.961471] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6547.969458] Lustre: Skipped 1 previous similar message [ 6547.973214] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6547.976571] Lustre: Skipped 1 previous similar message [ 6549.987254] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6549.994943] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 6551.799293] LustreError: 222856:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 6551.808209] LustreError: 222856:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 6551.951403] Lustre: server umount lustre-OST0000 complete [ 6557.664215] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 6557.673198] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6557.701928] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6557.707263] Lustre: Skipped 2 previous similar messages [ 6561.991686] LustreError: 223057:0:(obd_class.h:479:obd_check_dev()) Device 9 not setup [ 6561.999035] LustreError: 223057:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 6562.116395] Lustre: server umount lustre-MDT0000 complete [ 6565.350083] LustreError: 219136:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6565.383113] LustreError: 219136:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 6565.921987] LustreError: 219117:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763348325 with bad export cookie 3362732753666058987 [ 6565.933636] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6565.937403] LustreError: 219117:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 1 previous similar message [ 6566.075275] LustreError: 223259:0:(obd_class.h:479:obd_check_dev()) Device 16 not setup [ 6566.080458] LustreError: 223259:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 6566.258684] Lustre: server umount lustre-MDT0001 complete [ 6577.161573] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing unload_modules_local [ 6580.069793] Key type lgssc unregistered [ 6580.407698] LNet: 223792:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6580.423198] LNetError: 223792:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6580.450075] LNet: Removed LNI 192.168.201.155@tcp [ 6581.245774] Key type .llcrypt unregistered [ 6581.247128] Key type ._llcrypt unregistered [ 6613.732517] Key type ._llcrypt registered [ 6613.735067] Key type .llcrypt registered [ 6613.808106] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [ 6614.866973] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6614.969805] alg: No test for adler32 (adler32-zlib) [ 6616.026677] Lustre: Lustre: Build Version: 2.16.61_48_ga3a4329 [ 6616.240299] LNet: Added LNI 192.168.201.155@tcp [8/256/0/180] [ 6617.919180] Key type lgssc registered [ 6618.925556] Lustre: Echo OBD driver; http://www.lustre.org/ [ 6627.854672] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 6627.891275] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6629.556578] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6633.831660] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 6639.093608] LustreError: 225502:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6639.134840] LustreError: 225502:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 6643.506510] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 6644.006498] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6647.051146] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 6649.533296] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 6655.784467] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 6656.257499] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6661.751183] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 6669.309805] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 6669.366496] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 6669.530210] Lustre: lustre-OST0001: new disk, initializing [ 6669.532632] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 6669.669369] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 6673.784289] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49699 to 0x280000401:49729) [ 6674.227559] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 6675.545557] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 6675.554445] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 6675.634423] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 6683.805537] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 6689.415222] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 6705.652491] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 6705.663568] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6705.685290] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6706.658248] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6706.659060] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6706.672282] Lustre: Skipped 2 previous similar messages [ 6706.676617] Lustre: Skipped 3 previous similar messages [ 6707.713000] LustreError: 228874:0:(obd_class.h:479:obd_check_dev()) Device 28 not setup [ 6707.811068] Lustre: server umount lustre-MDT0000 complete [ 6711.417897] LustreError: 225484:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763348470 with bad export cookie 12817109331435099824 [ 6711.420037] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6711.431670] LustreError: 225484:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 6711.642277] LustreError: 229076:0:(obd_class.h:479:obd_check_dev()) Device 27 not setup [ 6711.657960] LustreError: 229076:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 6711.777703] LustreError: 228283:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6711.784216] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6711.812728] LustreError: 228283:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 6711.921965] Lustre: server umount lustre-MDT0001 complete [ 6717.442162] LustreError: 229276:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 6717.445183] LustreError: 229276:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 6717.521648] Lustre: server umount lustre-OST0000 complete [ 6721.114074] LustreError: 229477:0:(obd_class.h:479:obd_check_dev()) Device 2 not setup [ 6721.129918] LustreError: 229477:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 6721.255129] Lustre: server umount lustre-OST0001 complete [ 6724.488858] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro [ 6724.589147] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 6725.770458] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro [ 6725.912805] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 6727.168410] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: ,errors=remount-ro [ 6727.267131] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 6728.365641] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: ,errors=remount-ro [ 6728.474327] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 6741.855822] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [ 6751.508849] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6752.015187] LustreError: 230887:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6752.044047] LustreError: 230887:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 6752.131137] Lustre: mylustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6755.713842] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 6757.347014] LustreError: 230887:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6762.480360] LustreError: 230887:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6764.233114] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 6764.538240] Lustre: mylustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6768.310730] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 6771.170913] Lustre: 231996:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 6778.527777] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 6784.550640] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 6789.097521] LustreError: 232352:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6792.815767] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 6793.063856] Lustre: mylustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 6793.072014] Lustre: Skipped 1 previous similar message [ 6797.178110] Lustre: mylustre-OST0000: new connection from mylustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49732 to 0x280000401:49761) [ 6799.453861] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 6807.731917] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 6811.160729] Lustre: 233841:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 6828.004139] Lustre: mylustre-MDT0000-lwp-OST0001: Connection to mylustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6828.011033] Lustre: mylustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6828.035765] Lustre: Skipped 3 previous similar messages [ 6828.082973] Lustre: Skipped 2 previous similar messages [ 6832.764469] LustreError: 234149:0:(obd_class.h:479:obd_check_dev()) Device 10 not setup [ 6832.774209] LustreError: 234149:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 6832.850977] Lustre: server umount mylustre-MDT0000 complete [ 6833.121347] LustreError: 230883:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6833.129891] LustreError: 230883:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 6835.728812] LustreError: 230862:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763348595 with bad export cookie 12817109331435102631 [ 6835.729651] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6835.736580] LustreError: 230862:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 6835.968746] Lustre: server umount mylustre-MDT0001 complete [ 6848.909125] LustreError: 234551:0:(obd_class.h:479:obd_check_dev()) Device 23 not setup [ 6848.916688] LustreError: 234551:0:(obd_class.h:479:obd_check_dev()) Skipped 15 previous similar messages [ 6848.973219] Lustre: server umount mylustre-OST0000 complete [ 6862.194478] Lustre: server umount mylustre-OST0001 complete [ 6864.713090] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro [ 6864.785805] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 6865.619186] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro [ 6865.721953] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 6866.606317] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: ,errors=remount-ro [ 6866.681817] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 6867.533801] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: ,errors=remount-ro [ 6867.622119] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 6880.734677] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [ 6892.185963] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6892.666523] LustreError: 236163:0:(ldlm_lib.c:1179:target_handle_connect()) tfs-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6892.782406] Lustre: tfs-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6896.608363] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 6904.752779] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 6907.916724] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 6910.526949] Lustre: 237271:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 6915.686571] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 6917.041675] Lustre: tfs-OST0000: new connection from tfs-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49732 to 0x280000401:49793) [ 6920.337341] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 6927.424815] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 6929.450052] Lustre: tfs-OST0001: new connection from tfs-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) [ 6932.446586] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 6939.466513] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 6942.951287] Lustre: 239118:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 6956.005399] Lustre: tfs-MDT0000-lwp-MDT0001: Connection to tfs-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6956.014908] Lustre: Skipped 2 previous similar messages [ 6956.016248] Lustre: tfs-MDT0000: Not available for connect from 0@lo (stopping) [ 6956.022395] Lustre: Skipped 1 previous similar message [ 6960.283523] LustreError: 239367:0:(obd_class.h:479:obd_check_dev()) Device 10 not setup [ 6960.286907] LustreError: 239367:0:(obd_class.h:479:obd_check_dev()) Skipped 9 previous similar messages [ 6960.352208] Lustre: server umount tfs-MDT0000 complete [ 6961.131869] LustreError: 237782:0:(ldlm_lib.c:1179:target_handle_connect()) tfs-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6961.145067] LustreError: 237782:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 8 previous similar messages [ 6963.417698] LustreError: 236138:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763348722 with bad export cookie 12817109331435104297 [ 6963.421516] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6963.423414] LustreError: 236138:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 6963.730254] Lustre: server umount tfs-MDT0001 complete [ 6975.923814] Lustre: server umount tfs-OST0000 complete [ 6989.626201] Lustre: server umount tfs-OST0001 complete [ 6992.062061] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro [ 6992.158697] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 6993.025745] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro [ 6993.081371] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 6993.955449] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: ,errors=remount-ro [ 6994.038221] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 6994.917996] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: ,errors=remount-ro [ 6995.002746] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7007.932118] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [ 7016.418890] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7016.824356] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7016.827636] Lustre: Skipped 3 previous similar messages [ 7020.018235] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 7026.850883] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 7030.199638] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 7032.557077] Lustre: 242495:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 7038.346098] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 7042.789235] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 7042.872548] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49732 to 0x280000401:49825) [ 7050.058030] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 7051.865050] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:97) [ 7055.986739] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 7063.066383] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 7066.670817] Lustre: 244344:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 7078.949543] Lustre: DEBUG MARKER: == conf-sanity test 104a: Make sure user defined options are reflected in mount ========================================================== 22:07:17 (1763348837) [ 7094.241690] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7094.252112] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7094.268862] Lustre: Skipped 4 previous similar messages [ 7094.276279] Lustre: Skipped 6 previous similar messages [ 7100.429554] LustreError: 244711:0:(obd_class.h:479:obd_check_dev()) Device 10 not setup [ 7100.436133] LustreError: 244711:0:(obd_class.h:479:obd_check_dev()) Skipped 25 previous similar messages [ 7100.553563] Lustre: server umount lustre-MDT0000 complete [ 7103.573573] LustreError: 241362:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763348862 with bad export cookie 12817109331435105956 [ 7103.577542] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7103.582797] LustreError: 241362:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 7104.479935] LustreError: 241380:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7104.481552] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 7104.486914] LustreError: 241380:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 5 previous similar messages [ 7104.497558] Lustre: Skipped 5 previous similar messages [ 7110.013542] Lustre: server umount lustre-MDT0001 complete [ 7119.618103] Lustre: server umount lustre-OST0000 complete [ 7129.308274] Lustre: server umount lustre-OST0001 complete [ 7135.365931] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_hostid [ 7143.480966] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [ 7152.049159] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7158.476825] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7164.630933] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7171.043663] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7178.008330] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7178.102822] LDISKFS-fs (dm-0): Mount option "noacl" will be removed by 3.5 [ 7178.102822] Contact linux-ldiskfs@vger.kernel.org if you think we should keep it. [ 7178.102822] [ 7178.124411] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: acl,user_xattr,errors=remount-ro,noacl,no_mbcache,nodelalloc [ 7178.336732] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 7178.364783] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 7178.436548] Lustre: lustre-MDT0000: new disk, initializing [ 7178.533537] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7178.536336] Lustre: Skipped 3 previous similar messages [ 7178.568622] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 7182.380996] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 7192.974653] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7193.057523] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 7193.214707] Lustre: 247507:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 7193.361449] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 7193.374743] Lustre: Skipped 1 previous similar message [ 7193.535266] Lustre: lustre-MDT0001: new disk, initializing [ 7193.667533] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 7193.681696] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 7197.465261] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 7206.406078] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7206.453545] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 7206.669260] Lustre: lustre-OST0000: new disk, initializing [ 7206.673748] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 7207.848538] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 7207.860070] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 7207.959564] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 7211.111418] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 7219.643447] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7219.693528] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 7219.808840] Lustre: lustre-OST0001: new disk, initializing [ 7219.816044] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 7221.430921] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 7221.437899] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 7221.510775] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 7225.296232] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 7236.787626] Lustre: DEBUG MARKER: == conf-sanity test 104b: Mount uses last flock argument ========================================================== 22:09:54 (1763348994) [ 7249.865887] Lustre: DEBUG MARKER: == conf-sanity test 105: check file creation for ro and rw bind mnt pt ========================================================== 22:10:08 (1763349008) [ 7264.225231] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 7264.227096] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7264.231117] LustreError: Skipped 1 previous similar message [ 7264.238546] Lustre: Skipped 3 previous similar messages [ 7264.245600] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7264.252733] Lustre: Skipped 3 previous similar messages [ 7269.258169] LustreError: 250929:0:(obd_class.h:479:obd_check_dev()) Device 19 not setup [ 7269.276716] LustreError: 250929:0:(obd_class.h:479:obd_check_dev()) Skipped 25 previous similar messages [ 7269.415287] Lustre: server umount lustre-OST0000 complete [ 7275.491301] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7279.782620] Lustre: server umount lustre-MDT0000 complete [ 7283.809057] LustreError: 249059:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763349043 with bad export cookie 12817109331435107517 [ 7283.813503] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7283.817697] LustreError: 249059:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 7290.196234] Lustre: server umount lustre-MDT0001 complete [ 7299.868576] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing unload_modules_local [ 7314.491547] Lustre: server umount lustre-OST0001 complete [ 7319.283433] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_hostid [ 7329.725081] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [ 7337.029603] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7342.210281] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7347.231428] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7352.808075] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7358.408273] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7358.471370] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7358.653175] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 7358.682994] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 7358.753924] Lustre: lustre-MDT0000: new disk, initializing [ 7358.845327] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 7361.921296] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 7371.303225] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7371.354760] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 7371.417647] Lustre: 254396:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 7371.679173] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 7375.191245] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 7382.329198] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 7385.632469] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 7392.468676] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7392.515942] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 7392.666725] Lustre: lustre-OST0000: new disk, initializing [ 7392.668925] Lustre: Skipped 1 previous similar message [ 7392.672406] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 7392.676561] Lustre: Skipped 2 previous similar messages [ 7394.487786] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 7394.506133] Lustre: Skipped 1 previous similar message [ 7394.508609] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 7394.758019] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 7398.671910] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 7405.342196] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7410.150073] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7410.157031] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7410.157140] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 7410.168721] Lustre: Skipped 6 previous similar messages [ 7410.176877] Lustre: Skipped 7 previous similar messages [ 7416.202113] LustreError: 256839:0:(obd_class.h:479:obd_check_dev()) Device 19 not setup [ 7416.204873] LustreError: 256839:0:(obd_class.h:479:obd_check_dev()) Skipped 25 previous similar messages [ 7416.319929] Lustre: server umount lustre-OST0000 complete [ 7425.750590] Lustre: server umount lustre-MDT0000 complete [ 7428.526163] LustreError: 254388:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763349187 with bad export cookie 12817109331435108987 [ 7428.527338] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7428.535314] LustreError: 254388:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 1 previous similar message [ 7428.775122] Lustre: server umount lustre-MDT0001 complete [ 7438.564470] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing unload_modules_local [ 7441.450831] Key type lgssc unregistered [ 7441.657957] LNet: 257777:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7441.663966] LNetError: 257777:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7441.672017] LNet: Removed LNI 192.168.201.155@tcp [ 7442.310600] Key type .llcrypt unregistered [ 7442.313687] Key type ._llcrypt unregistered [ 7467.015559] Key type ._llcrypt registered [ 7467.017312] Key type .llcrypt registered [ 7467.127272] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [ 7468.030688] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7468.103294] alg: No test for adler32 (adler32-zlib) [ 7469.312911] Lustre: Lustre: Build Version: 2.16.61_48_ga3a4329 [ 7469.536320] LNet: Added LNI 192.168.201.155@tcp [8/256/0/180] [ 7471.241539] Key type lgssc registered [ 7472.546804] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7479.988490] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7480.020490] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7481.630815] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7485.940920] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 7491.044122] LustreError: 259219:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7491.053183] LustreError: 259219:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 7494.423865] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 7494.788792] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7498.215890] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 7503.739534] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 7506.901362] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 7512.721428] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 7513.049126] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7518.145408] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 7523.081941] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7523.908703] Lustre: Setting parameter lustre-OST0000.ost.unknown_param=50 in log lustre-OST0000 [ 7526.370271] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7526.372690] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7527.410726] LustreError: 261513:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 7527.503382] Lustre: server umount lustre-OST0000 complete [ 7530.468575] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7530.476893] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7530.489364] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7530.494235] Lustre: Skipped 1 previous similar message [ 7531.489689] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7531.502311] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7531.506137] Lustre: Skipped 1 previous similar message [ 7536.498660] LustreError: 261715:0:(obd_class.h:479:obd_check_dev()) Device 9 not setup [ 7536.504105] LustreError: 261715:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 7536.551249] Lustre: server umount lustre-MDT0000 complete [ 7536.617804] LustreError: 259214:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7536.625071] LustreError: 259214:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 7540.052152] LustreError: 259200:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763349299 with bad export cookie 18406513126211881101 [ 7540.053500] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7540.069106] LustreError: 259200:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 7540.202577] LustreError: 261920:0:(obd_class.h:479:obd_check_dev()) Device 16 not setup [ 7540.204840] LustreError: 261920:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 7540.415729] Lustre: server umount lustre-MDT0001 complete [ 7549.017814] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing unload_modules_local [ 7551.476097] Key type lgssc unregistered [ 7551.770297] LNet: 262451:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7551.784232] LNetError: 262451:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7551.807933] LNet: Removed LNI 192.168.201.155@tcp [ 7552.487416] Key type .llcrypt unregistered [ 7552.489218] Key type ._llcrypt unregistered [ 7566.951970] Key type ._llcrypt registered [ 7566.953111] Key type .llcrypt registered [ 7567.040355] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [ 7567.838470] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7567.914774] alg: No test for adler32 (adler32-zlib) [ 7568.877364] Lustre: Lustre: Build Version: 2.16.61_48_ga3a4329 [ 7569.043315] LNet: Added LNI 192.168.201.155@tcp [8/256/0/180] [ 7570.711577] Key type lgssc registered [ 7571.544667] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7578.865350] Lustre: lustre-OST0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7578.892657] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 7594.479782] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 7599.583293] LustreError: 263626:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.201.155@tcp: failed processing log, type 4: rc = -110 [ 7626.335410] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7632.973532] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 7638.453134] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7640.405604] LustreError: 264291:0:(obd_class.h:479:obd_check_dev()) Device 1 not setup [ 7640.527935] Lustre: server umount lustre-OST0000 complete [ 7653.044268] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing unload_modules_local [ 7655.337707] Key type lgssc unregistered [ 7655.570777] LNet: 265126:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7655.581327] LNetError: 265126:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7655.593768] LNet: Removed LNI 192.168.201.155@tcp [ 7656.251634] Key type .llcrypt unregistered [ 7656.254245] Key type ._llcrypt unregistered [ 7694.865544] Key type ._llcrypt registered [ 7694.868260] Key type .llcrypt registered [ 7695.019453] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [ 7696.102108] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7696.180036] alg: No test for adler32 (adler32-zlib) [ 7697.446440] Lustre: Lustre: Build Version: 2.16.61_48_ga3a4329 [ 7697.716338] LNet: Added LNI 192.168.201.155@tcp [8/256/0/180] [ 7699.391368] Key type lgssc registered [ 7700.684630] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7713.710319] loop0: detected capacity change from 0 to 204800000 [ 7713.889864] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7713.898861] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7714.347698] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7714.421967] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7715.619047] loop0: detected capacity change from 0 to 204800000 [ 7715.899615] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7715.905962] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7716.216098] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7716.248407] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7717.319885] loop0: detected capacity change from 0 to 204800000 [ 7717.446938] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7717.453177] blk_update_request: operation not supported error, dev loop0, sector 8224 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7717.592976] blk_update_request: operation not supported error, dev loop0, sector 58264 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7717.709416] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7718.743612] loop0: detected capacity change from 0 to 204800000 [ 7718.935993] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7718.945800] blk_update_request: operation not supported error, dev loop0, sector 8224 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7719.069752] blk_update_request: operation not supported error, dev loop0, sector 58264 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7719.182488] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7720.189486] loop0: detected capacity change from 0 to 204800000 [ 7720.216548] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 7724.051977] loop0: detected capacity change from 0 to 204800000 [ 7724.079340] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 7727.726039] loop0: detected capacity change from 0 to 204800000 [ 7727.757902] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 7731.485560] loop0: detected capacity change from 0 to 204800000 [ 7731.506853] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 7734.838254] loop0: detected capacity change from 0 to 204800000 [ 7734.951215] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7735.007280] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7735.030421] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7735.154533] Lustre: 268548:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 7735.169898] Lustre: 268548:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0000: restore index '0x10000-MDT0000' with [0x200000005:0x1:0x0]: rc = 0 [ 7735.181189] Lustre: 268548:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0000: restore index '0x2010000-MDT0000' with [0x200000005:0x3:0x0]: rc = 0 [ 7735.189687] Lustre: 268548:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000003:0xa:0x0]: rc = 0 [ 7735.197152] Lustre: 268548:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000003:0xb:0x0]: rc = 0 [ 7735.202552] Lustre: 268548:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0000: restore index '0x1010000-MDT0000' with [0x200000005:0x2:0x0]: rc = 0 [ 7735.211104] Lustre: 268548:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000003:0xc:0x0]: rc = 0 [ 7735.219225] Lustre: 268548:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0000: restore index 'nodemap' with [0x200000003:0x3:0x0]: rc = 0 [ 7735.226730] Lustre: 268548:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0000: restore index '0x20000' with [0x200000006:0x20000:0x0]: rc = 0 [ 7735.241589] Lustre: 268548:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0000: restore index '0x2020000' with [0x200000006:0x2020000:0x0]: rc = 0 [ 7735.249300] Lustre: 268548:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0000: restore index '0x1020000' with [0x200000006:0x1020000:0x0]: rc = 0 [ 7735.256200] Lustre: 268548:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000006:0x10000:0x0]: rc = 0 [ 7735.265769] Lustre: 268548:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000006:0x1010000:0x0]: rc = 0 [ 7735.272668] Lustre: 268548:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000006:0x2010000:0x0]: rc = 0 [ 7740.702362] LustreError: 268815:0:(obd_class.h:479:obd_check_dev()) Device 2 not setup [ 7740.848942] Lustre: server umount MGS complete [ 7741.498381] loop0: detected capacity change from 0 to 204800000 [ 7741.622783] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7742.022073] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7742.100587] Lustre: lustre-MDT0000: Aborting client recovery [ 7742.997035] loop1: detected capacity change from 0 to 204800000 [ 7743.072579] LDISKFS-fs (loop1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7743.206046] LDISKFS-fs (loop1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 7743.273914] Lustre: 268984:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 7743.282072] Lustre: 268984:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0001: restore index '0x10000' with [0x200000003:0x4:0x0]: rc = 0 [ 7743.292704] Lustre: 268984:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0001: restore index '0x1010000-MDT0001' with [0x200000005:0x2:0x0]: rc = 0 [ 7743.303746] Lustre: 268984:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0001: restore index '0x2010000' with [0x200000003:0x6:0x0]: rc = 0 [ 7743.310468] Lustre: 268984:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0001: restore index '0x10000-MDT0001' with [0x200000005:0x1:0x0]: rc = 0 [ 7743.315945] Lustre: 268984:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0001: restore index '0x2010000-MDT0001' with [0x200000005:0x3:0x0]: rc = 0 [ 7743.323331] Lustre: 268984:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0001: restore index '0x1010000' with [0x200000003:0x5:0x0]: rc = 0 [ 7743.352240] Lustre: Found index 1 for lustre-MDT0001, updating log [ 7743.628450] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7743.675091] Lustre: lustre-MDT0001: Aborting client recovery [ 7744.582107] loop2: detected capacity change from 0 to 204800000 [ 7744.755761] LDISKFS-fs (loop2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7744.833429] LDISKFS-fs (loop2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 7744.859972] Lustre: 269066:0:(osd_scrub.c:1842:osd_index_restore()) lustre-OST0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 7744.864735] Lustre: 269066:0:(osd_scrub.c:1842:osd_index_restore()) lustre-OST0000: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 7744.873329] Lustre: 269066:0:(osd_scrub.c:1842:osd_index_restore()) lustre-OST0000: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 7744.879957] Lustre: 269066:0:(osd_scrub.c:1842:osd_index_restore()) lustre-OST0000: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 7744.886927] Lustre: 269066:0:(osd_scrub.c:1842:osd_index_restore()) lustre-OST0000: restore index '0x20000-OST0000' with [0x200000005:0x1:0x0]: rc = 0 [ 7744.897028] Lustre: 269066:0:(osd_scrub.c:1842:osd_index_restore()) lustre-OST0000: restore index '0x2020000-OST0000' with [0x200000005:0x3:0x0]: rc = 0 [ 7744.909927] Lustre: 269066:0:(osd_scrub.c:1842:osd_index_restore()) lustre-OST0000: restore index '0x1020000-OST0000' with [0x200000005:0x2:0x0]: rc = 0 [ 7745.123802] Lustre: Found index 0 for lustre-OST0000, updating log [ 7745.229760] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7745.270270] Lustre: lustre-OST0000: Aborting recovery [ 7746.241273] loop3: detected capacity change from 0 to 204800000 [ 7746.411275] LDISKFS-fs (loop3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7746.447736] LDISKFS-fs (loop3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 7746.519854] Lustre: 269153:0:(osd_scrub.c:1842:osd_index_restore()) lustre-OST0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 7746.524848] Lustre: 269153:0:(osd_scrub.c:1842:osd_index_restore()) lustre-OST0001: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 7746.534288] Lustre: 269153:0:(osd_scrub.c:1842:osd_index_restore()) lustre-OST0001: restore index '0x20000-OST0001' with [0x200000005:0x1:0x0]: rc = 0 [ 7746.541056] Lustre: 269153:0:(osd_scrub.c:1842:osd_index_restore()) lustre-OST0001: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 7746.547507] Lustre: 269153:0:(osd_scrub.c:1842:osd_index_restore()) lustre-OST0001: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 7746.555544] Lustre: 269153:0:(osd_scrub.c:1842:osd_index_restore()) lustre-OST0001: restore index '0x1020000-OST0001' with [0x200000005:0x2:0x0]: rc = 0 [ 7746.563680] Lustre: 269153:0:(osd_scrub.c:1842:osd_index_restore()) lustre-OST0001: restore index '0x2020000-OST0001' with [0x200000005:0x3:0x0]: rc = 0 [ 7746.584663] Lustre: Found index 1 for lustre-OST0001, updating log [ 7746.684267] Lustre: lustre-OST0001: Aborting recovery [ 7751.783448] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 7751.785279] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 7751.797641] LustreError: 268927:0:(lod_dev.c:510:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 10, retries 0, failed: rc = -108 [ 7751.812488] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000bd0 [ 7751.815929] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000bd0 [ 7752.809163] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:5 to 0x280000400:33) [ 7752.814298] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:5 to 0x2c0000400:33) [ 7756.069790] LustreError: 268895:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0000: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0000 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0000/identity_upcall, time 518us: rc = -2 [ 7756.580942] LustreError: 269402:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0000: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0000 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0000/identity_upcall, time 576us: rc = -2 [ 7756.597991] LustreError: 269402:0:(mdt_identity.c:115:mdt_identity_do_upcall()) Skipped 27 previous similar messages [ 7769.058865] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7769.069933] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7769.082273] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7773.670091] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7773.673878] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7773.680492] Lustre: Skipped 2 previous similar messages [ 7773.689188] Lustre: Skipped 3 previous similar messages [ 7774.816397] LustreError: 269510:0:(obd_class.h:479:obd_check_dev()) Device 10 not setup [ 7774.822934] LustreError: 269510:0:(obd_class.h:479:obd_check_dev()) Skipped 1 previous similar message [ 7774.939158] Lustre: server umount lustre-MDT0000 complete [ 7775.673216] LustreError: 268876:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763349534 with bad export cookie 6816430106964436581 [ 7775.686484] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7775.688187] LustreError: 268876:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 7778.787853] LustreError: 268891:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7778.788536] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7778.788922] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 7778.809462] LustreError: 268891:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 7778.850862] Lustre: Skipped 1 previous similar message [ 7780.832650] LustreError: 269402:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7780.832839] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 7780.856408] LustreError: 269402:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 7780.860642] Lustre: Skipped 2 previous similar messages [ 7781.863243] LustreError: 269561:0:(obd_class.h:479:obd_check_dev()) Device 18 not setup [ 7781.870027] LustreError: 269561:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 7782.099896] Lustre: server umount lustre-MDT0001 complete [ 7789.077171] LustreError: 269612:0:(obd_class.h:479:obd_check_dev()) Device 23 not setup [ 7789.096157] LustreError: 269612:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 7789.190264] Lustre: server umount lustre-OST0000 complete [ 7796.247736] LustreError: 269663:0:(obd_class.h:479:obd_check_dev()) Device 2 not setup [ 7796.272492] LustreError: 269663:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 7796.475574] Lustre: server umount lustre-OST0001 complete [ 7804.028442] Lustre: DEBUG MARKER: == conf-sanity test 109a: test lctl clear_conf fsname ==== 22:19:22 (1763349562) [ 7828.930494] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_hostid [ 7837.321737] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [ 7845.975307] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7852.202126] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7857.387324] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7863.522089] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7869.719514] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7869.770479] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7869.938604] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 7869.964402] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 7870.012851] Lustre: lustre-MDT0000: new disk, initializing [ 7870.126132] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7870.132734] Lustre: Skipped 1 previous similar message [ 7870.156305] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 7873.592983] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 7882.993439] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7883.040617] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 7883.136664] Lustre: 273232:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 7883.212919] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 7883.215524] Lustre: Skipped 1 previous similar message [ 7883.274551] Lustre: lustre-MDT0001: new disk, initializing [ 7883.377996] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7883.428955] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 7883.433076] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 7886.488856] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 7893.268169] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 7896.733365] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 7902.394522] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 7902.492177] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 7902.831945] Lustre: lustre-OST0000: new disk, initializing [ 7902.838670] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 7902.966702] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7908.051403] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 7912.483301] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 7912.498154] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 7912.593309] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 7913.928392] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7918.087876] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 7922.681731] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 7925.999168] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 7931.456483] Lustre: Modifying parameter lustre-client.llite.max_read_ahead_mb=64 in log lustre-client [ 7968.736093] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 7968.745821] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7968.751626] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7968.755878] Lustre: Skipped 1 previous similar message [ 7968.766787] Lustre: Skipped 1 previous similar message [ 7971.063154] LustreError: 276554:0:(obd_class.h:479:obd_check_dev()) Device 19 not setup [ 7971.072792] LustreError: 276554:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 7971.176330] Lustre: server umount lustre-OST0000 complete [ 7973.874383] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7973.879792] Lustre: Skipped 1 previous similar message [ 7978.978615] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7978.981464] Lustre: Skipped 2 previous similar messages [ 7988.194435] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 7988.290223] LustreError: 276755:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup [ 7988.299795] LustreError: 276755:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 7988.362547] Lustre: server umount lustre-MDT0000 complete [ 7989.217101] LustreError: 274138:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7989.235497] LustreError: 274138:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 7991.098482] LustreError: 275970:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763349750 with bad export cookie 6816430106964439290 [ 7991.103724] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7991.117806] LustreError: 275970:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 7991.340983] Lustre: server umount lustre-MDT0001 complete [ 7997.831839] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8000.533521] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 8004.190301] Lustre: server umount MGS complete [ 8012.827938] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8013.262912] LustreError: 278525:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8013.292913] LustreError: 278537:0:(qmt_pool.c:1523:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 8013.382771] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8017.045678] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 8018.400275] LustreError: 278525:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8024.947958] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 8028.839658] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 8033.055191] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8035.705973] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8041.415280] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 8046.384599] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 8051.587327] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8089.061960] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8089.063031] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 8089.080188] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8089.080195] Lustre: Skipped 2 previous similar messages [ 8093.082094] LustreError: 281207:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 8093.093644] LustreError: 281207:0:(obd_class.h:479:obd_check_dev()) Skipped 15 previous similar messages [ 8093.595882] Lustre: server umount lustre-OST0000 complete [ 8104.362169] Lustre: server umount lustre-MDT0000 complete [ 8104.418317] LustreError: 278524:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8104.429588] LustreError: 278524:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 8108.860441] LustreError: 278504:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763349868 with bad export cookie 6816430106964441103 [ 8108.861166] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8108.887659] LustreError: 278504:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 8109.332521] Lustre: server umount lustre-MDT0001 complete [ 8119.145328] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing unload_modules_local [ 8121.661403] Key type lgssc unregistered [ 8122.002622] LNet: 282142:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8122.018829] LNetError: 282142:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8122.043247] LNet: Removed LNI 192.168.201.155@tcp [ 8123.064634] Key type .llcrypt unregistered [ 8123.069068] Key type ._llcrypt unregistered [ 8157.631838] Key type ._llcrypt registered [ 8157.633522] Key type .llcrypt registered [ 8157.740524] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_hostid [ 8169.429187] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [ 8170.005172] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8170.016523] alg: No test for adler32 (adler32-zlib) [ 8171.026046] Lustre: Lustre: Build Version: 2.16.61_48_ga3a4329 [ 8171.211582] LNet: Added LNI 192.168.201.155@tcp [8/256/0/180] [ 8172.887253] Key type lgssc registered [ 8173.933561] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8181.942113] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 8187.663942] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 8193.627698] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 8199.866186] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 8205.660709] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 8205.702589] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 8205.718788] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8206.931945] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 8206.973791] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 8207.040552] Lustre: lustre-MDT0000: new disk, initializing [ 8207.131926] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8207.151029] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 8209.978965] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 8218.133551] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 8218.190663] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 8218.256323] Lustre: 286053:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8218.312213] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 8218.315193] Lustre: Skipped 1 previous similar message [ 8218.365730] Lustre: lustre-MDT0001: new disk, initializing [ 8218.430280] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8218.492439] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 8218.498701] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 8221.596869] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 8227.624285] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8230.647821] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8236.345913] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 8236.408021] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 8236.695984] Lustre: lustre-OST0000: new disk, initializing [ 8236.698559] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 8236.817833] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8241.900532] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 8244.276395] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 8244.281778] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 8244.356974] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 8248.261727] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8254.451614] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 8265.233179] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 8274.428215] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 8316.387873] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 8316.393451] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8316.396208] LustreError: Skipped 1 previous similar message [ 8316.398018] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8316.462393] Lustre: Skipped 1 previous similar message [ 8320.999103] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8321.016032] Lustre: Skipped 2 previous similar messages [ 8322.297776] LustreError: 289670:0:(obd_class.h:479:obd_check_dev()) Device 19 not setup [ 8322.386306] Lustre: server umount lustre-OST0000 complete [ 8326.113969] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8326.114913] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8326.130339] Lustre: Skipped 1 previous similar message [ 8326.130726] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8331.232271] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8331.237371] Lustre: Skipped 2 previous similar messages [ 8331.321200] LustreError: 289871:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup [ 8331.328438] LustreError: 289871:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 8331.418570] Lustre: server umount lustre-MDT0000 complete [ 8334.123779] LustreError: 286047:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763350093 with bad export cookie 2308406486672202647 [ 8334.134119] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8334.135304] LustreError: 286047:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 8334.286437] LustreError: 290072:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 8334.290795] LustreError: 290072:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 8334.425456] Lustre: server umount lustre-MDT0001 complete [ 8342.117566] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8345.877276] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 8350.384595] LustreError: 291015:0:(obd_class.h:479:obd_check_dev()) Device 2 not setup [ 8350.399425] LustreError: 291015:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 8350.490397] Lustre: server umount MGS complete [ 8360.405634] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8360.739408] LustreError: 291650:0:(qmt_pool.c:1523:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 8360.791063] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8363.566424] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 8366.049432] LustreError: 291637:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8366.075704] LustreError: 291637:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 8370.084110] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 8370.416972] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8373.636548] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 8377.703971] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8380.724552] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8386.909935] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 8387.299248] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8391.798559] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 8396.183712] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8427.489653] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 8427.499949] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8427.507897] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8427.518687] Lustre: Skipped 1 previous similar message [ 8433.400168] LustreError: 294317:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 8433.402657] LustreError: 294317:0:(obd_class.h:479:obd_check_dev()) Skipped 1 previous similar message [ 8433.578850] Lustre: server umount lustre-OST0000 complete [ 8437.217458] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8437.226440] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8437.252443] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8437.255171] Lustre: Skipped 3 previous similar messages [ 8443.446658] LustreError: 294519:0:(obd_class.h:479:obd_check_dev()) Device 9 not setup [ 8443.458558] LustreError: 294519:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 8443.602141] Lustre: server umount lustre-MDT0000 complete [ 8446.895685] LustreError: 291617:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763350206 with bad export cookie 2308406486672204488 [ 8446.906153] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8447.208647] Lustre: server umount lustre-MDT0001 complete [ 8455.670133] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing unload_modules_local [ 8457.856363] Key type lgssc unregistered [ 8458.110740] LNet: 295252:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8458.121467] LNetError: 295252:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8458.133253] LNet: Removed LNI 192.168.201.155@tcp [ 8458.942149] Key type .llcrypt unregistered [ 8458.946830] Key type ._llcrypt unregistered [ 8477.060045] Key type ._llcrypt registered [ 8477.061625] Key type .llcrypt registered [ 8477.163403] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_hostid [ 8487.990220] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [ 8488.471359] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8488.562402] alg: No test for adler32 (adler32-zlib) [ 8489.552994] Lustre: Lustre: Build Version: 2.16.61_48_ga3a4329 [ 8489.701689] LNet: Added LNI 192.168.201.155@tcp [8/256/0/180] [ 8491.344882] Key type lgssc registered [ 8492.253788] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8500.805504] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 8507.067812] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 8514.750635] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [ 8522.014262] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 8527.853163] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 8527.904456] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 8527.921396] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8529.175244] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 8529.204530] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 8529.259419] Lustre: lustre-MDT0000: new disk, initializing [ 8529.332140] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8529.359398] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 8533.057773] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 8545.268295] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 8545.358595] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 8545.625340] Lustre: lustre-OST0000: new disk, initializing [ 8545.628416] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 8545.637474] Lustre: Skipped 1 previous similar message [ 8545.735361] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8547.177892] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 8547.194418] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 8547.244945] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 8552.201826] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 9392.122335] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9392.130056] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9396.340859] LustreError: 300272:0:(obd_class.h:479:obd_check_dev()) Device 13 not setup [ 9396.666547] Lustre: server umount lustre-MDT0000 complete [ 9401.019286] LustreError: 298422:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763351160 with bad export cookie 572474841614344002 [ 9401.040451] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9401.089822] LustreError: 300473:0:(obd_class.h:479:obd_check_dev()) Device 2 not setup [ 9401.092617] LustreError: 300473:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 9401.263899] Lustre: server umount lustre-OST0000 complete [ 9429.226479] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_hostid [ 9438.881982] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [ 9448.291261] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 9453.670974] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 9459.476827] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 9465.551737] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 9472.609692] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 9472.727264] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9472.988362] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 9473.022465] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 9473.107621] Lustre: lustre-MDT0000: new disk, initializing [ 9473.237372] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9473.265827] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 9476.916285] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 9488.239053] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 9488.308398] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 9488.404549] Lustre: 303521:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 9488.478863] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 9488.481498] Lustre: Skipped 1 previous similar message [ 9488.544986] Lustre: lustre-MDT0001: new disk, initializing [ 9488.656930] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9488.710068] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 9488.723358] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 9493.480578] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 9503.731543] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9508.684774] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 9515.790684] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 9515.881773] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 9516.305690] Lustre: lustre-OST0000: new disk, initializing [ 9516.330237] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 9516.473784] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9522.455505] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 9525.334687] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 9525.338966] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 9525.481166] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 9530.125572] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 9535.191679] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 9535.548450] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 9539.753390] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 9540.113312] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 9546.211982] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9546.214968] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 9546.216558] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9546.220562] Lustre: Skipped 1 previous similar message [ 9546.247926] LustreError: Skipped 1 previous similar message [ 9548.094585] LustreError: 306457:0:(obd_class.h:479:obd_check_dev()) Device 19 not setup [ 9548.104320] LustreError: 306457:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 9548.280779] Lustre: server umount lustre-OST0000 complete [ 9555.431371] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 9555.440282] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9555.450775] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9555.456385] Lustre: Skipped 1 previous similar message [ 9558.508807] LustreError: 306658:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup [ 9558.514836] LustreError: 306658:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 9558.695227] Lustre: server umount lustre-MDT0000 complete [ 9562.512156] LustreError: 303513:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763351321 with bad export cookie 572474841617284849 [ 9562.529833] LustreError: 303513:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 9562.540633] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9562.674605] LustreError: 306860:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 9562.690825] LustreError: 306860:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 9562.896480] Lustre: server umount lustre-MDT0001 complete [ 9566.099195] Lustre: DEBUG MARKER: SKIP: conf-sanity test_111 skipping SLOW test 111 [ 9567.729900] Lustre: DEBUG MARKER: == conf-sanity test 112a: mount OST with no_create option ========================================================== 22:48:46 (1763351326) [ 9574.368424] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9574.858440] LustreError: 307432:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9574.892954] LustreError: 307432:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 9574.969360] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9579.048372] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 9580.002703] LustreError: 307432:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9585.122519] LustreError: 307432:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9586.569806] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 9586.842271] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9590.147971] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 9594.952253] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9598.635962] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 9604.363443] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 9604.679349] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9609.820803] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 9615.390351] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 9621.892654] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 9621.969166] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 9622.109774] Lustre: lustre-OST0001: new disk, initializing [ 9622.114434] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 9622.204954] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 9622.367192] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 9622.376536] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 9622.426608] LustreError: 309971:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [ 9622.436400] LustreError: 309971:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) Skipped 1 previous similar message [ 9623.462921] LustreError: 309964:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 9624.491434] LustreError: 309964:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 9624.517507] LustreError: 309964:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) Skipped 2 previous similar messages [ 9626.539543] LustreError: 309971:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [ 9626.547334] LustreError: 309971:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) Skipped 2 previous similar messages [ 9627.141410] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 9630.697317] LustreError: 309964:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 9630.710517] LustreError: 309964:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) Skipped 8 previous similar messages [ 9635.906520] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 9636.095983] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 9638.959229] LustreError: 309971:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [ 9638.971874] LustreError: 309971:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) Skipped 15 previous similar messages [ 9639.778589] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff920cc5291800.ost_server_uuid 50 [ 9641.332251] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff920cc5291800.ost_server_uuid in FULL state after 0 sec [ 9644.986811] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff920cc5291800.ost_server_uuid 50 [ 9646.653867] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-ffff920cc5291800.ost_server_uuid in FULL state after 0 sec [ 9648.325994] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 9663.354398] Lustre: lustre-OST0001: Not available for connect from 192.168.201.55@tcp (stopping) [ 9663.369183] Lustre: Skipped 2 previous similar messages [ 9663.462229] LustreError: lustre-OST0001-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 9663.463032] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9663.472739] Lustre: Skipped 2 previous similar messages [ 9667.780688] LustreError: 311241:0:(obd_class.h:479:obd_check_dev()) Device 25 not setup [ 9667.793670] LustreError: 311241:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 9667.866937] Lustre: server umount lustre-OST0001 complete [ 9668.444447] LustreError: 309029:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 192.168.201.55@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9673.184623] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 9673.195204] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9673.216421] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9673.219213] Lustre: Skipped 2 previous similar messages [ 9673.698948] LustreError: 309793:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9673.705620] LustreError: 309793:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 9679.148948] Lustre: server umount lustre-OST0000 complete [ 9683.936125] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9683.949427] Lustre: Skipped 1 previous similar message [ 9683.954960] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9683.967047] Lustre: Skipped 4 previous similar messages [ 9697.247651] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 9697.352336] LustreError: 311643:0:(obd_class.h:479:obd_check_dev()) Device 28 not setup [ 9697.355042] LustreError: 311643:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 9697.466578] Lustre: server umount lustre-MDT0000 complete [ 9699.298571] LustreError: 307426:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9699.326291] LustreError: 307426:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 9701.762819] LustreError: 307411:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763351461 with bad export cookie 572474841617285724 [ 9701.778453] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9701.798223] LustreError: 307411:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 8 previous similar messages [ 9702.217259] Lustre: server umount lustre-MDT0001 complete [ 9711.780735] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing unload_modules_local [ 9714.441456] Key type lgssc unregistered [ 9714.735314] LNet: 312380:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 9714.753477] LNetError: 312380:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 9714.774043] LNet: Removed LNI 192.168.201.155@tcp [ 9715.603369] Key type .llcrypt unregistered [ 9715.606326] Key type ._llcrypt unregistered [ 9736.641147] Key type ._llcrypt registered [ 9736.643399] Key type .llcrypt registered [ 9736.754598] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [ 9737.640154] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 9737.678595] alg: No test for adler32 (adler32-zlib) [ 9738.714746] Lustre: Lustre: Build Version: 2.16.61_48_ga3a4329 [ 9738.930071] LNet: Added LNI 192.168.201.155@tcp [8/256/0/180] [ 9740.623435] Key type lgssc registered [ 9741.420733] Lustre: Echo OBD driver; http://www.lustre.org/ [ 9747.646521] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 9747.659326] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9749.372761] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9753.166162] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 9754.594074] LustreError: 313766:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9754.614671] LustreError: 313766:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 9758.726697] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 9759.715745] LustreError: 313766:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9764.843861] LustreError: 313766:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9764.949725] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 9765.338282] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9769.479858] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 9778.589781] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 9778.928372] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9784.096346] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 9789.216206] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 9790.208856] LustreError: 315319:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9795.362783] LustreError: 315890:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9795.383132] LustreError: 315890:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 9795.391244] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:65) [ 9795.703649] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 9795.923596] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 9800.279785] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [ 9801.219268] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:33) [ 9805.729048] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 9811.115082] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing wait_import_state (FULL|IDLE) os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [ 9811.295481] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 9918.947388] LustreError: lustre-OST0001-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 9918.958794] Lustre: lustre-OST0001-osc-MDT0001: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9918.968737] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 9918.977828] Lustre: Skipped 1 previous similar message [ 9921.797137] LustreError: 317195:0:(obd_class.h:479:obd_check_dev()) Device 27 not setup [ 9921.856229] Lustre: server umount lustre-OST0001 complete [ 9924.072404] LustreError: 316186:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9924.084466] LustreError: 316186:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 9928.673876] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 9928.677536] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9928.678413] LustreError: Skipped 2 previous similar messages [ 9928.703067] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9928.710632] Lustre: Skipped 2 previous similar messages [ 9932.417423] LustreError: 317396:0:(obd_class.h:479:obd_check_dev()) Device 23 not setup [ 9932.424447] LustreError: 317396:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 9932.523184] Lustre: server umount lustre-OST0000 complete [ 9939.425087] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 9939.426323] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9939.444143] Lustre: Skipped 1 previous similar message [ 9939.447404] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9939.450396] Lustre: Skipped 2 previous similar messages [ 9944.544376] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9944.549488] Lustre: Skipped 1 previous similar message [ 9949.669949] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9949.673988] Lustre: Skipped 1 previous similar message [ 9950.176022] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 9950.294403] LustreError: 317598:0:(obd_class.h:479:obd_check_dev()) Device 10 not setup [ 9950.311648] LustreError: 317598:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 9950.442200] Lustre: server umount lustre-MDT0000 complete [ 9953.449251] LustreError: 313745:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763351712 with bad export cookie 9800750477826606342 [ 9953.453065] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9953.456239] LustreError: 313745:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 9953.676464] LustreError: 317801:0:(obd_class.h:479:obd_check_dev()) Device 18 not setup [ 9953.678895] LustreError: 317801:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 9953.808687] Lustre: server umount lustre-MDT0001 complete [ 9962.177964] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing unload_modules_local [ 9964.418298] Key type lgssc unregistered [ 9964.711875] LNet: 318332:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 9964.721597] LNetError: 318332:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 9964.736650] LNet: Removed LNI 192.168.201.155@tcp [ 9965.426847] Key type .llcrypt unregistered [ 9965.428600] Key type ._llcrypt unregistered [10000.747091] Key type ._llcrypt registered [10000.750562] Key type .llcrypt registered [10000.855306] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [10001.399357] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [10001.414235] alg: No test for adler32 (adler32-zlib) [10002.414291] Lustre: Lustre: Build Version: 2.16.61_48_ga3a4329 [10002.615349] LNet: Added LNI 192.168.201.155@tcp [8/256/0/180] [10004.280951] Key type lgssc registered [10005.005388] Lustre: Echo OBD driver; http://www.lustre.org/ [10012.115717] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [10012.130397] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10013.539297] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10016.847606] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [10022.884176] LustreError: 320582:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10022.894204] LustreError: 320582:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [10023.868829] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [10024.154799] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [10027.517439] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [10030.325523] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [10035.413263] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [10035.679825] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [10037.739146] LustreError: 322042:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10037.757622] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:97) [10040.638325] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [10042.858299] LustreError: 322042:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10047.676538] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [10047.917053] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [10048.958444] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:65) [10051.730697] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [10058.555393] Lustre: DEBUG MARKER: Using TIMEOUT=20 [10062.515222] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [10074.594883] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10074.600378] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10074.606246] Lustre: Skipped 2 previous similar messages [10074.616872] Lustre: Skipped 3 previous similar messages [10079.717949] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10079.723743] Lustre: Skipped 3 previous similar messages [10080.606261] LustreError: 323995:0:(obd_class.h:479:obd_check_dev()) Device 10 not setup [10080.672661] Lustre: server umount lustre-MDT0000 complete [10083.065679] LustreError: 320563:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763351842 with bad export cookie 3042941352190907249 [10083.068472] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [10083.082387] LustreError: 320563:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 3 previous similar messages [10083.192589] LustreError: 324196:0:(obd_class.h:479:obd_check_dev()) Device 18 not setup [10083.197496] LustreError: 324196:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [10083.305103] Lustre: server umount lustre-MDT0001 complete [10096.280633] LustreError: 324397:0:(obd_class.h:479:obd_check_dev()) Device 23 not setup [10096.292283] LustreError: 324397:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [10096.350730] Lustre: server umount lustre-OST0000 complete [10109.435990] LustreError: 324599:0:(obd_class.h:479:obd_check_dev()) Device 2 not setup [10109.439687] LustreError: 324599:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [10109.537589] Lustre: server umount lustre-OST0001 complete [10120.705347] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [10128.431399] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10128.816299] LustreError: 325777:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10128.889730] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10131.750152] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [10133.987100] LustreError: 325777:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10138.137266] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [10138.479022] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [10141.513719] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [10143.525886] Lustre: 326886:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [10147.869739] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [10149.157052] LustreError: 327240:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10151.652696] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [10154.285739] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:129) [10157.571741] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [10157.756372] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [10157.759448] Lustre: Skipped 1 previous similar message [10158.931094] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:97) [10161.580737] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [10166.927202] Lustre: DEBUG MARKER: Using TIMEOUT=20 [10169.109980] Lustre: 328733:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [10178.533392] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10178.535430] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10178.540798] Lustre: Skipped 3 previous similar messages [10178.544472] Lustre: Skipped 1 previous similar message [10182.478067] LustreError: 328836:0:(obd_class.h:479:obd_check_dev()) Device 10 not setup [10182.482308] LustreError: 328836:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [10182.533334] Lustre: server umount lustre-MDT0000 complete [10183.649442] LustreError: 326494:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10183.658442] LustreError: 326494:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 5 previous similar messages [10184.733636] LustreError: 327264:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763351944 with bad export cookie 3042941352190908950 [10184.739425] LustreError: 327264:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 3 previous similar messages [10184.739663] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [10185.015643] Lustre: server umount lustre-MDT0001 complete [10197.002113] LustreError: 329240:0:(obd_class.h:479:obd_check_dev()) Device 23 not setup [10197.007773] LustreError: 329240:0:(obd_class.h:479:obd_check_dev()) Skipped 15 previous similar messages [10197.039481] Lustre: server umount lustre-OST0000 complete [10209.564658] Lustre: server umount lustre-OST0001 complete [10211.932360] Lustre: DEBUG MARKER: SKIP: conf-sanity test_114 skipping SLOW test 114 [10212.969209] Lustre: DEBUG MARKER: SKIP: conf-sanity test_115 skipping excluded test 115 [10214.126248] Lustre: DEBUG MARKER: == conf-sanity test 116: big size MDT support ============ 22:59:32 (1763351972) [10226.343754] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [10230.605755] loop0: detected capacity change from 0 to 1099511627776 [10230.961056] SGI XFS with ACLs, security attributes, quota, no debug enabled [10230.967217] *** VALIDATE xfs *** [10230.974800] XFS (loop0): Mounting V5 Filesystem [10230.995633] XFS (loop0): Ending clean mount [10231.652681] loop1: detected capacity change from 0 to 18691697672192 [10264.448710] LDISKFS-fs (loop1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [10274.296818] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_hostid [10279.916435] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [10285.869701] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [10289.942427] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [10294.402454] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [10298.611230] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [10303.060741] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [10303.109272] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10303.260039] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [10303.288660] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [10303.337880] Lustre: lustre-MDT0000: new disk, initializing [10303.398776] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10303.413837] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [10305.921674] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [10313.221069] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [10313.275774] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [10313.347485] Lustre: 333827:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [10313.389690] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [10313.393443] Lustre: Skipped 1 previous similar message [10313.462728] Lustre: lustre-MDT0001: new disk, initializing [10313.565413] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [10313.571197] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [10315.919730] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [10320.465671] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [10322.627956] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [10326.258712] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [10326.304685] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [10326.507822] Lustre: lustre-OST0000: new disk, initializing [10326.511443] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [10328.230867] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [10328.237763] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [10328.293504] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [10329.598935] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [10333.931230] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [10336.231088] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [10336.344858] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [10338.662123] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [10338.781633] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [10343.907194] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [10343.908740] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10343.914871] LustreError: Skipped 1 previous similar message [10343.921469] Lustre: Skipped 1 previous similar message [10343.923390] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [10343.930648] Lustre: Skipped 1 previous similar message [10346.040662] LustreError: 336774:0:(obd_class.h:479:obd_check_dev()) Device 19 not setup [10346.049309] LustreError: 336774:0:(obd_class.h:479:obd_check_dev()) Skipped 9 previous similar messages [10346.155780] Lustre: server umount lustre-OST0000 complete [10349.025417] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10349.035969] Lustre: Skipped 1 previous similar message [10349.039907] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10349.042591] Lustre: Skipped 1 previous similar message [10354.580020] Lustre: server umount lustre-MDT0000 complete [10356.833760] LustreError: 334608:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763352116 with bad export cookie 3042941352190910504 [10356.836855] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [10356.840278] LustreError: 334608:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [10357.033612] Lustre: server umount lustre-MDT0001 complete [10361.683254] XFS (loop0): Unmounting Filesystem [10364.657119] Lustre: DEBUG MARKER: == conf-sanity test 117: lctl get_param return errors properly ========================================================== 23:02:03 (1763352123) [10369.166660] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10369.454269] LustreError: 337993:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10369.504994] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10369.507960] Lustre: Skipped 2 previous similar messages [10372.125668] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [10377.298097] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [10380.174482] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [10383.826424] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [10386.443750] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [10390.926684] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [10394.788392] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [10398.243795] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [10407.909238] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [10407.909687] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10407.911191] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [10407.911279] Lustre: Skipped 2 previous similar messages [10407.931045] Lustre: Skipped 2 previous similar messages [10409.143288] LustreError: 340333:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [10409.146364] LustreError: 340333:0:(obd_class.h:479:obd_check_dev()) Skipped 17 previous similar messages [10409.227750] Lustre: server umount lustre-OST0000 complete [10426.335443] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [10426.430982] Lustre: server umount lustre-MDT0000 complete [10428.301524] LustreError: 340535:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763352187 with bad export cookie 3042941352190911386 [10428.307662] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [10428.308595] LustreError: 340535:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [10428.451256] Lustre: server umount lustre-MDT0001 complete [10433.571218] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing unload_modules_local [10435.137782] Key type lgssc unregistered [10435.316821] LNet: 341268:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [10435.321578] LNetError: 341268:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [10435.336247] LNet: Removed LNI 192.168.201.155@tcp [10435.783176] Key type .llcrypt unregistered [10435.784906] Key type ._llcrypt unregistered [10452.057183] Key type ._llcrypt registered [10452.059502] Key type .llcrypt registered [10452.135952] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [10452.649058] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [10452.689032] alg: No test for adler32 (adler32-zlib) [10453.620477] Lustre: Lustre: Build Version: 2.16.61_48_ga3a4329 [10453.753195] LNet: Added LNI 192.168.201.155@tcp [8/256/0/180] [10455.367197] Key type lgssc registered [10455.988577] Lustre: Echo OBD driver; http://www.lustre.org/ [10460.392863] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [10460.404538] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10461.692419] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10463.755638] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [10468.771915] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [10469.006570] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [10471.369797] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [10475.292548] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [10477.436879] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [10481.848269] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [10482.067186] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [10485.630174] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [10489.034839] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [10499.555858] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10499.569664] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [10499.576723] Lustre: Skipped 1 previous similar message [10501.988944] Lustre: lustre-MDT0001: Not available for connect from 192.168.201.55@tcp (stopping) [10504.677367] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [10504.682759] Lustre: Skipped 1 previous similar message [10505.166169] LustreError: 345092:0:(obd_class.h:479:obd_check_dev()) Device 16 not setup [10505.227613] Lustre: server umount lustre-MDT0001 complete [10506.960110] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [10507.088281] LustreError: 342792:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.201.55@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [10507.098374] LustreError: 342792:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [10509.792032] LustreError: 342796:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10511.727847] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [10511.779750] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [10511.782586] Lustre: Found index 1 for lustre-MDT0001, updating log [10511.829387] Lustre: 342785:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [10512.005422] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [10514.117825] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [10517.487832] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [10519.018440] LustreError: 346120:0:(obd_mount.c:188:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [10519.023648] LustreError: 346120:0:(tgt_mount.c:669:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [10519.028826] LustreError: 342787:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [10519.060802] LustreError: 346123:0:(obd_config.c:1997:class_config_llog_handler()) MGC192.168.201.155@tcp: cfg command failed: rc = -17 [10519.066240] Lustre: cmd=cf001 0:lustre-MDT0001-osp-MDT0000 1:osp 2:lustre-MDT0000-mdtlov_UUID [10519.066240] [10819.424513] Lustre: lustre-MDT0001: Not available for connect from 192.168.201.55@tcp (stopping) [10819.552599] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [10819.554472] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10819.562287] Lustre: Skipped 2 previous similar messages [10823.565885] LustreError: 355862:0:(obd_class.h:479:obd_check_dev()) Device 16 not setup [10823.567930] LustreError: 355862:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [10823.605951] Lustre: server umount lustre-MDT0001 complete [10824.525085] LustreError: 348436:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.201.55@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [10824.537361] LustreError: 348436:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [10825.185557] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [10829.490331] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [10829.551563] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [10829.555384] Lustre: Found index 1 for lustre-MDT0001, updating log [10829.577101] Lustre: 342784:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [10829.647637] Lustre: lustre-MDT0001: Not available for connect from 192.168.201.55@tcp (not set up) [10829.652400] Lustre: Skipped 2 previous similar messages [10829.748465] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [10831.812516] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [10834.923740] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [10836.969090] LustreError: 356938:0:(obd_mount.c:188:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [10836.974762] LustreError: 356938:0:(tgt_mount.c:669:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [10836.978914] LustreError: 342787:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [10836.982926] LustreError: 342787:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [10837.012456] LustreError: 356941:0:(obd_config.c:689:class_setup()) Device 8 already setup (type osp) [10837.016215] LustreError: 356941:0:(obd_config.c:1997:class_config_llog_handler()) MGC192.168.201.155@tcp: cfg command failed: rc = -17 [10837.020613] Lustre: cmd=cf003 0:lustre-MDT0001-osp-MDT0000 1:lustre-MDT0001_UUID 2:192.168.201.155@tcp [10837.020613] [11136.869145] Lustre: lustre-MDT0001: Not available for connect from 192.168.201.55@tcp (stopping) [11136.992194] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [11136.996195] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11141.766274] LustreError: 366777:0:(obd_class.h:479:obd_check_dev()) Device 16 not setup [11141.768683] LustreError: 366777:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [11141.803596] Lustre: server umount lustre-MDT0001 complete [11141.967142] LustreError: 348436:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.201.55@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [11141.980453] LustreError: 348436:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [11143.360609] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [11147.090456] LustreError: 342792:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.201.55@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [11147.099571] LustreError: 342792:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [11147.958157] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [11148.021553] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [11148.026138] Lustre: Found index 1 for lustre-MDT0001, updating log [11148.051533] Lustre: 342785:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [11148.268863] Lustre: lustre-MDT0001: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [11151.094882] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [11153.386348] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [11153.404820] LustreError: 367743:0:(obd_mount.c:188:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [11153.411287] LustreError: 367743:0:(tgt_mount.c:669:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [11153.422463] LustreError: 342787:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [11153.424760] LustreError: 342787:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [11153.468866] LustreError: 367746:0:(lod_lov.c:207:lod_add_device()) lustre-MDT0001-osp-MDT0000: cannot connect to next dev lustre-MDT0001_UUID (-114) [11153.475933] LustreError: 367746:0:(obd_config.c:1997:class_config_llog_handler()) MGC192.168.201.155@tcp: cfg command failed: rc = -114 [11153.480972] Lustre: cmd=cf014 0:lustre-MDT0000-mdtlov 1:lustre-MDT0001_UUID 2:1 3:1 [11153.480972] [11470.817375] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11470.818141] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [11470.822333] Lustre: Skipped 3 previous similar messages [11470.823342] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [11470.831692] Lustre: Skipped 4 previous similar messages [11473.290365] LustreError: 378360:0:(obd_class.h:479:obd_check_dev()) Device 9 not setup [11473.292444] LustreError: 378360:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [11473.330681] Lustre: server umount lustre-MDT0000 complete [11475.241372] LustreError: 342775:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763353234 with bad export cookie 18223836729753592900 [11475.244277] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [11475.246940] LustreError: 342775:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [11475.937052] LustreError: 342791:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11475.938715] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11475.942729] LustreError: 342791:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [11481.430242] LustreError: 378562:0:(obd_class.h:479:obd_check_dev()) Device 16 not setup [11481.434391] LustreError: 378562:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [11481.549204] Lustre: server umount lustre-MDT0001 complete [11483.799858] Lustre: server umount lustre-OST0000 complete [11488.336348] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_hostid [11492.552163] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [11497.020732] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [11499.927056] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [11502.821170] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [11505.762928] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [11508.871330] Lustre: DEBUG MARKER: == conf-sanity test 120: cross-target rename should not create bad symlinks ========================================================== 23:21:07 (1763353267) [11511.972493] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [11512.017144] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11512.165614] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [11512.194753] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [11512.244569] Lustre: lustre-MDT0000: new disk, initializing [11512.309754] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [11512.321401] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [11514.132677] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [11519.483833] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [11519.510918] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [11519.552310] Lustre: 381293:0:(mgs_llog.c:1346:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [11519.585721] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [11519.588133] Lustre: Skipped 1 previous similar message [11519.634260] Lustre: lustre-MDT0001: new disk, initializing [11519.686305] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [11519.703704] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [11519.708030] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [11521.425426] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [11525.352586] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [11526.990378] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [11529.936033] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [11529.968228] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [11530.078509] Lustre: lustre-OST0000: new disk, initializing [11530.081261] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [11530.116073] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [11531.334899] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [11531.340445] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [11531.389903] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [11532.587970] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_default_debug -1 all [11536.252570] Lustre: DEBUG MARKER: oleg155-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [11540.448259] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [11540.453552] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11540.461380] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [11540.465475] Lustre: Skipped 2 previous similar messages [11545.475057] LustreError: 383735:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup [11545.477085] LustreError: 383735:0:(obd_class.h:479:obd_check_dev()) Skipped 11 previous similar messages [11545.512587] Lustre: server umount lustre-MDT0000 complete [11547.104374] LustreError: 382586:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11547.112253] LustreError: 382586:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [11547.205398] LustreError: 382076:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1763353306 with bad export cookie 18223836729753594867 [11547.209636] LustreError: MGC192.168.201.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [11547.210535] LustreError: 382088:0:(osp_object.c:617:osp_attr_get()) lustre-MDT0000-osp-MDT0001: osp_attr_get update error [0x200000401:0x2:0x0]: rc = -5 [11547.212502] LustreError: 382076:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [11547.350719] Lustre: server umount lustre-MDT0001 complete [11559.409119] Lustre: server umount lustre-OST0000 complete [11571.218455] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing set_hostid [11575.516109] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing load_modules_local [11579.621064] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [11582.606748] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [11585.515726] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [11588.435514] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [11589.156523] Lustre: DEBUG MARKER: == conf-sanity test complete, duration 11370 sec ========= 23:22:28 (1763353348) [11589.878400] Lustre: DEBUG MARKER: === conf-sanity: start cleanup 23:22:28 (1763353348) === [11591.357252] Lustre: DEBUG MARKER: === conf-sanity: finish cleanup 23:22:30 (1763353350) === [11609.151948] Lustre: DEBUG MARKER: oleg155-server.virtnet: executing unload_modules_local [11610.412637] Key type lgssc unregistered [11610.566686] LNet: 389242:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [11610.571391] LNetError: 389242:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [11610.585526] LNet: Removed LNI 192.168.201.155@tcp [11610.946734] Key type .llcrypt unregistered [11610.948445] Key type ._llcrypt unregistered