[ 0.000000] Linux version 4.18.0rh8.10-debug (green@maintenance) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-26) (GCC)) #2 SMP Mon Jul 14 01:24:22 EDT 2025 [ 0.000000] Command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffcdfff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffce000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x0000000146dfffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.8 present. [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 [ 0.000000] Hypervisor detected: KVM [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 498068820 cycles [ 0.000000] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns [ 0.000000] tsc: Detected 2399.998 MHz processor [ 0.000000] last_pfn = 0x146e00 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0xbffce max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000f54b0-0x000f54bf] [ 0.000000] RAMDISK: [mem 0xbcc54000-0xbffbffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F52D0 000014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 0x00000000BFFE247C 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 0x00000000BFFE2318 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 0x00000000BFFE0040 0022D8 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 0x00000000BFFE0000 000040 [ 0.000000] ACPI: APIC 0x00000000BFFE238C 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: HPET 0x00000000BFFE241C 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: WAET 0x00000000BFFE2454 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0xbffe2318-0xbffe238b] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe2317] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0xbffe238c-0xbffe241b] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0xbffe241c-0xbffe2453] [ 0.000000] ACPI: Reserving WAET table memory at [mem 0xbffe2454-0xbffe247b] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x0000000146dfffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x1465a3000-0x1465cdfff] [ 0.000000] Reserving 256MB of memory at 2752MB for crashkernel (System RAM: 4205MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009efff] [ 0.000000] node 0: [mem 0x0000000000100000-0x00000000bffcdfff] [ 0.000000] node 0: [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Zeroed struct page in unavailable ranges: 4756 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x0000000146dfffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] TSC deadline timer available [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] kvm-guest: KVM setup pv remote TLB flush [ 0.000000] kvm-guest: setup PV sched yield [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbffce000-0xbfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.000000] [mem 0xc0000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u524288 [ 0.000000] kvm-guest: PV spinlocks enabled [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1059606 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] audit: disabled (until reboot) [ 0.000000] software IO TLB: area num 4. [ 0.000000] Memory: 2829652K/4306352K available (18435K kernel code, 11221K rwdata, 7248K rodata, 2908K init, 18040K bss, 524580K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] ftrace: allocating 41240 entries in 162 pages [ 0.000000] ftrace: allocated 162 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU event tracing is enabled. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=4. [ 0.000000] rcu: RCU callback double-/use-after-free debug enabled. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 [ 0.000000] NR_IRQS: 524544, nr_irqs: 456, preallocated irqs: 16 [ 0.000000] random: get_random_bytes called from start_kernel+0x622/0x9a8 with crng_init=0 [ 0.001000] Console: colour *CGA 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns [ 0.001012] APIC: Switch to symmetric I/O mode setup [ 0.002375] x2apic enabled [ 0.003009] Switched APIC routing to physical x2apic. [ 0.004009] kvm-guest: setup PV IPIs [ 0.006824] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.007000] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 0.007021] Calibrating delay loop (skipped) preset value.. 4799.99 BogoMIPS (lpj=2399998) [ 0.008011] pid_max: default: 32768 minimum: 301 [ 0.009138] LSM: Security Framework initializing [ 0.010043] Yama: becoming mindful. [ 0.011024] SELinux: Initializing. [ 0.012045] *** VALIDATE selinux *** [ 0.020025] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, vmalloc) [ 0.025078] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc) [ 0.026151] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.028090] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.029103] *** VALIDATE tmpfs *** [ 0.031104] *** VALIDATE proc *** [ 0.032011] *** VALIDATE cgroup *** [ 0.032849] *** VALIDATE cgroup2 *** [ 0.033268] x86/cpu: User Mode Instruction Prevention (UMIP) activated [ 0.034178] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.035010] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 [ 0.036027] Spectre V2 : User space: Vulnerable [ 0.037010] Speculative Store Bypass: Vulnerable [ 0.040051] debug: unmapping init [mem 0xffffffffb7059000-0xffffffffb7060fff] [ 0.042751] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (family: 0x6, model: 0x3e, stepping: 0x4) [ 0.043707] Performance Events: IvyBridge events, full-width counters, Intel PMU driver. [ 0.044023] ... version: 2 [ 0.045020] ... bit width: 48 [ 0.045892] ... generic registers: 4 [ 0.046014] ... value mask: 0000ffffffffffff [ 0.047018] ... max period: 00007fffffffffff [ 0.048018] ... fixed-purpose events: 3 [ 0.049012] ... event mask: 000000070000000f [ 0.050300] rcu: Hierarchical SRCU implementation. [ 0.052598] smp: Bringing up secondary CPUs ... [ 0.053637] x86: Booting SMP configuration: [ 0.054033] .... node #0, CPUs: #1 #2 #3 [ 0.059233] smp: Brought up 1 node, 4 CPUs [ 0.061013] smpboot: Max logical packages: 1 [ 0.062015] smpboot: Total of 4 processors activated (19199.98 BogoMIPS) [ 0.113056] node 0 deferred pages initialised in 49ms [ 0.116112] devtmpfs: initialized [ 0.117373] x86/mm: Memory block size: 128MB [ 0.120000] gcov: version magic: 0x41383552 [ 0.123337] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.127082] futex hash table entries: 1024 (order: 4, 65536 bytes, vmalloc) [ 0.129400] pinctrl core: initialized pinctrl subsystem [ 0.132901] [ 0.134009] ************************************************************* [ 0.138017] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.142016] ** ** [ 0.144012] ** IOMMU DebugFS SUPPORT HAS BEEN ENABLED IN THIS KERNEL ** [ 0.146011] ** ** [ 0.148013] ** This means that this kernel is built to expose internal ** [ 0.150013] ** IOMMU data structures, which may compromise security on ** [ 0.152011] ** your system. ** [ 0.154013] ** ** [ 0.156013] ** If you see this message and you are not debugging the ** [ 0.159014] ** kernel, report this immediately to your vendor! ** [ 0.161012] ** ** [ 0.163015] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.165014] ************************************************************* [ 0.167669] NET: Registered protocol family 16 [ 0.169454] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations [ 0.172058] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.175069] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.178103] cpuidle: using governor menu [ 0.179649] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.182457] PCI: Using configuration type 1 for base access [ 0.341009] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.354102] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.356039] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.360032] cryptd: max_cpu_qlen set to 1000 [ 0.362216] ACPI: Added _OSI(Module Device) [ 0.364014] ACPI: Added _OSI(Processor Device) [ 0.365013] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.367015] ACPI: Added _OSI(Processor Aggregator Device) [ 0.372835] ACPI: 1 ACPI AML tables successfully acquired and loaded [ 0.381333] ACPI: Interpreter enabled [ 0.383053] ACPI: PM: (supports S0 S3 S4 S5) [ 0.384018] ACPI: Using IOAPIC for interrupt routing [ 0.386137] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.390536] ACPI: Enabled 2 GPEs in block 00 to 0F [ 0.405966] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.408048] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3] [ 0.411020] acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI] [ 0.414099] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.420585] acpiphp: Slot [2] registered [ 0.422127] acpiphp: Slot [5] registered [ 0.424206] acpiphp: Slot [6] registered [ 0.426152] acpiphp: Slot [7] registered [ 0.428109] acpiphp: Slot [8] registered [ 0.429125] acpiphp: Slot [9] registered [ 0.431120] acpiphp: Slot [10] registered [ 0.432114] acpiphp: Slot [3] registered [ 0.434110] acpiphp: Slot [4] registered [ 0.435130] acpiphp: Slot [11] registered [ 0.437116] acpiphp: Slot [12] registered [ 0.439107] acpiphp: Slot [13] registered [ 0.441170] acpiphp: Slot [14] registered [ 0.442096] acpiphp: Slot [15] registered [ 0.444082] acpiphp: Slot [16] registered [ 0.445120] acpiphp: Slot [17] registered [ 0.446124] acpiphp: Slot [18] registered [ 0.448111] acpiphp: Slot [19] registered [ 0.450183] acpiphp: Slot [20] registered [ 0.451106] acpiphp: Slot [21] registered [ 0.453107] acpiphp: Slot [22] registered [ 0.455108] acpiphp: Slot [23] registered [ 0.456150] acpiphp: Slot [24] registered [ 0.458107] acpiphp: Slot [25] registered [ 0.459097] acpiphp: Slot [26] registered [ 0.460083] acpiphp: Slot [27] registered [ 0.461015] acpiphp: Slot [28] registered [ 0.463090] acpiphp: Slot [29] registered [ 0.464112] acpiphp: Slot [30] registered [ 0.465097] acpiphp: Slot [31] registered [ 0.467064] PCI host bridge to bus 0000:00 [ 0.468018] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.470022] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.472023] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.475022] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 0.477024] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] [ 0.478016] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.479151] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.480678] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.482850] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 0.490012] pci 0000:00:01.1: reg 0x20: [io 0xc320-0xc32f] [ 0.493039] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.494011] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.497016] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.499014] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.501533] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 0.503777] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 0.506041] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 0.509784] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 [ 0.514013] pci 0000:00:02.0: reg 0x10: [io 0xc300-0xc31f] [ 0.526018] pci 0000:00:02.0: reg 0x20: [mem 0xe0000000000-0xe0000003fff 64bit pref] [ 0.534015] pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 0.538872] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 [ 0.547020] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] [ 0.553015] pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] [ 0.567018] pci 0000:00:05.0: reg 0x20: [mem 0xe0000004000-0xe0000007fff 64bit pref] [ 0.576628] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 [ 0.588016] pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] [ 0.599015] pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 0.632022] pci 0000:00:06.0: reg 0x20: [mem 0xe0000008000-0xe000000bfff 64bit pref] [ 0.646374] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 [ 0.653017] pci 0000:00:07.0: reg 0x10: [io 0xc100-0xc17f] [ 0.659017] pci 0000:00:07.0: reg 0x14: [mem 0xfebc2000-0xfebc2fff] [ 0.701019] pci 0000:00:07.0: reg 0x20: [mem 0xe000000c000-0xe000000ffff 64bit pref] [ 0.715749] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 [ 0.729018] pci 0000:00:08.0: reg 0x10: [io 0xc180-0xc1ff] [ 0.744026] pci 0000:00:08.0: reg 0x14: [mem 0xfebc3000-0xfebc3fff] [ 0.774018] pci 0000:00:08.0: reg 0x20: [mem 0xe0000010000-0xe0000013fff 64bit pref] [ 0.793000] pci 0000:00:09.0: [1af4:1001] type 00 class 0x010000 [ 0.809017] pci 0000:00:09.0: reg 0x10: [io 0xc200-0xc27f] [ 0.820017] pci 0000:00:09.0: reg 0x14: [mem 0xfebc4000-0xfebc4fff] [ 0.844020] pci 0000:00:09.0: reg 0x20: [mem 0xe0000014000-0xe0000017fff 64bit pref] [ 0.859761] pci 0000:00:0a.0: [1af4:1001] type 00 class 0x010000 [ 0.875017] pci 0000:00:0a.0: reg 0x10: [io 0xc280-0xc2ff] [ 0.886017] pci 0000:00:0a.0: reg 0x14: [mem 0xfebc5000-0xfebc5fff] [ 0.912019] pci 0000:00:0a.0: reg 0x20: [mem 0xe0000018000-0xe000001bfff 64bit pref] [ 0.923666] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 [ 0.926369] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 0.930469] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 [ 0.933381] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 0.936320] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 [ 0.941098] iommu: Default domain type: Passthrough [ 0.944553] SCSI subsystem initialized [ 0.945249] ACPI: bus type USB registered [ 0.946228] usbcore: registered new interface driver usbfs [ 0.948085] usbcore: registered new interface driver hub [ 0.949069] usbcore: registered new device driver usb [ 0.950279] pps_core: LinuxPPS API ver. 1 registered [ 0.952010] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 0.954069] PTP clock support registered [ 0.956132] EDAC MC: Ver: 3.0.0 [ 0.957355] PCI: Using ACPI for IRQ routing [ 0.958893] NetLabel: Initializing [ 0.959009] NetLabel: domain hash size = 128 [ 0.960010] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 0.961108] NetLabel: unlabeled traffic allowed by default [ 0.962121] vgaarb: loaded [ 0.963274] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 0.965015] hpet0: 3 comparators, 64-bit 100.000000 MHz counter [ 0.972004] clocksource: Switched to clocksource kvm-clock [ 1.080192] VFS: Disk quotas dquot_6.6.0 [ 1.081575] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 1.083231] *** VALIDATE ramfs *** [ 1.084076] *** VALIDATE hugetlbfs *** [ 1.085102] pnp: PnP ACPI init [ 1.086662] pnp: PnP ACPI: found 6 devices [ 1.100358] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 1.102559] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 1.103967] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 1.105295] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 1.106822] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 1.108174] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] [ 1.109927] NET: Registered protocol family 2 [ 1.111580] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, vmalloc) [ 1.114807] tcp_listen_portaddr_hash hash table entries: 4096 (order: 5, 163840 bytes, vmalloc) [ 1.117413] TCP established hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 1.123696] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc) [ 1.128034] TCP: Hash tables configured (established 65536 bind 65536) [ 1.131473] MPTCP token hash table entries: 8192 (order: 6, 393216 bytes, vmalloc) [ 1.135156] UDP hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 1.138504] UDP-Lite hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 1.142030] NET: Registered protocol family 1 [ 1.146190] RPC: Registered named UNIX socket transport module. [ 1.149474] RPC: Registered udp transport module. [ 1.151446] RPC: Registered tcp transport module. [ 1.153243] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 1.156196] NET: Registered protocol family 44 [ 1.158082] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 1.160642] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 1.162784] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 1.164759] PCI: CLS 0 bytes, default 64 [ 1.167194] Unpacking initramfs... [ 2.565340] debug: unmapping init [mem 0xffff9695fcc54000-0xffff9695fffbffff] [ 2.569497] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 2.571800] software IO TLB: mapped [mem 0x00000000a8000000-0x00000000ac000000] (64MB) [ 2.574846] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 3.056609] Initialise system trusted keyrings [ 3.057873] Key type blacklist registered [ 3.059379] workingset: timestamp_bits=36 max_order=20 bucket_order=0 [ 3.065474] zbud: loaded [ 3.067556] *** VALIDATE nfs *** [ 3.068520] *** VALIDATE nfs4 *** [ 3.070091] pstore: using deflate compression [ 3.073025] Platform Keyring initialized [ 3.180340] NET: Registered protocol family 38 [ 3.182260] Key type asymmetric registered [ 3.184139] Asymmetric key parser 'x509' registered [ 3.185951] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 3.189457] io scheduler mq-deadline registered [ 3.191350] io scheduler kyber registered [ 3.192953] io scheduler bfq registered [ 3.194838] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 3.197416] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.199894] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 3.203107] ACPI: Power Button [PWRF] [ 3.209490] ACPI: \_SB_.LNKB: Enabled at IRQ 10 [ 3.217117] ACPI: \_SB_.LNKA: Enabled at IRQ 11 [ 3.268810] ACPI: \_SB_.LNKC: Enabled at IRQ 11 [ 3.279581] ACPI: \_SB_.LNKD: Enabled at IRQ 10 [ 3.308895] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 3.338996] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.368364] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.374495] Non-volatile memory driver v1.3 [ 3.376847] Linux agpgart interface v0.103 [ 3.411314] virtio_blk virtio1: [vda] 146200 512-byte logical blocks (74.9 MB/71.4 MiB) [ 3.414444] vda: detected capacity change from 0 to 74854400 [ 3.434651] virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) [ 3.437927] vdb: detected capacity change from 0 to 1073741824 [ 3.460785] virtio_blk virtio3: [vdc] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 3.463714] vdc: detected capacity change from 0 to 2621440000 [ 3.478245] virtio_blk virtio4: [vdd] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 3.481200] vdd: detected capacity change from 0 to 2621440000 [ 3.508085] virtio_blk virtio5: [vde] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 3.511722] vde: detected capacity change from 0 to 4294967296 [ 3.529721] virtio_blk virtio6: [vdf] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 3.532940] vdf: detected capacity change from 0 to 4294967296 [ 3.540278] libphy: Fixed MDIO Bus: probed [ 3.547019] usbcore: registered new interface driver usbserial_generic [ 3.550071] usbserial: USB Serial support registered for generic [ 3.552817] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 3.557903] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 3.560204] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 3.563227] mousedev: PS/2 mouse device common for all mice [ 3.566582] rtc_cmos 00:05: RTC can wake from S4 [ 3.566602] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 3.570833] rtc_cmos 00:05: registered as rtc0 [ 3.575394] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 3.577819] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 [ 3.579359] intel_pstate: CPU model not supported [ 3.583829] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 [ 3.588481] hid: raw HID events driver (C) Jiri Kosina [ 3.591374] usbcore: registered new interface driver usbhid [ 3.594136] usbhid: USB HID core driver [ 3.595904] drop_monitor: Initializing network drop monitor service [ 3.599254] Initializing XFRM netlink socket [ 3.601965] NET: Registered protocol family 10 [ 3.605784] Segment Routing with IPv6 [ 3.607615] NET: Registered protocol family 17 [ 3.610022] mpls_gso: MPLS GSO support [ 3.615457] RAS: Correctable Errors collector initialized. [ 3.617851] AVX version of gcm_enc/dec engaged. [ 3.619802] AES CTR mode by8 optimization enabled [ 3.703630] sched_clock: Marking stable (3703597365, 0)->(4603065483, -899468118) [ 3.707643] registered taskstats version 1 [ 3.710140] Loading compiled-in X.509 certificates [ 3.712485] zswap: loaded using pool lzo/zbud [ 3.740635] Key type big_key registered [ 3.758645] Key type encrypted registered [ 3.760682] ima: No TPM chip found, activating TPM-bypass! [ 3.763604] ima: Allocated hash algorithm: sha1 [ 3.765589] ima: No architecture policies found [ 3.767521] evm: Initialising EVM extended attributes: [ 3.769504] evm: security.selinux [ 3.770776] evm: security.ima [ 3.771928] evm: security.capability [ 3.773251] evm: HMAC attrs: 0x1 [ 3.776136] rtc_cmos 00:05: setting system clock to 2026-08-26 12:21:47 UTC (1787746907) [ 3.782585] debug: unmapping init [mem 0xffffffffb8003000-0xffffffffb81fffff] [ 3.785676] debug: unmapping init [mem 0xffffffffb6d82000-0xffffffffb7058fff] [ 3.794249] Write protecting the kernel read-only data: 28672k [ 3.797854] debug: unmapping init [mem 0xffffffffb5403000-0xffffffffb55fffff] [ 3.801204] debug: unmapping init [mem 0xffffffffb5d14000-0xffffffffb5dfffff] [ 3.842163] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 3.851603] systemd[1]: Detected virtualization kvm. [ 3.853552] systemd[1]: Detected architecture x86-64. [ 3.855252] systemd[1]: Running in initial RAM disk. Welcome to Rocky Linux 8.10 (Green Obsidian) dracut-049-233.git20240115.el8 (Initramfs)! [ 3.882026] systemd[1]: No hostname configured. [ 3.883784] systemd[1]: Set hostname to . [ 3.886179] random: systemd: uninitialized urandom read (16 bytes read) [ 3.888787] systemd[1]: Initializing machine ID from random generator. [ 3.952332] random: ln: uninitialized urandom read (6 bytes read) [ 4.052399] random: systemd: uninitialized urandom read (16 bytes read) [ 4.054801] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 4.065359] systemd[1]: Starting Setup Virtual Console... Starting Setup Virtual Console... [ 4.072829] systemd[1]: Started Memstrack Anylazing Service. [ OK ] Started Memstrack Anylazing Service. [ OK ] Reached target Initrd Root Device. Starting Create list of required st…ce nodes for the current kernel... [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Timers. [ OK ] Listening on udev Kernel Socket. [ OK ] Reached target Local File Systems. Starting Create Volatile Files and Directories... [ OK ] Listening on udev Control Socket. [ OK ] Listening on Journal Socket (/dev/log). [ OK ] Reached target Sockets. Starting Journal Service... [ OK ] Reached target Paths. [ OK ] Reached target Slices. [ OK ] Reached target Swap. Starting Apply Kernel Variables... [ OK ] Started Setup Virtual Console. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Create Volatile Files and Directories. [ OK ] Started Apply Kernel Variables. Starting Create Static Device Nodes in /dev... Starting dracut cmdline hook... [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started Journal Service. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ 4.827606] device-mapper: uevent: version 1.0.3 [ 4.829579] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting dracut pre-trigger hook... [ OK ] Started dracut pre-trigger hook. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. Starting dracut initqueue hook... [ OK ] Reached target System Initialization. [ OK ] Reached target Basic System. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. [ 5.721103] random: fast init done [ 5.730726] virtio_net virtio0 ens2: renamed from eth0 [ 5.857178] scsi host0: ata_piix [ 5.886354] scsi host1: ata_piix [ 5.914111] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc320 irq 14 [ 5.917434] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc328 irq 15 [ 9.460477] dracut-initqueue[583]: RTNETLINK answers: File exists [ 10.278903] random: crng init done [ 10.280497] random: 7 urandom warning(s) missed due to ratelimiting Starting nbd nbd0... [ OK ] Started nbd nbd0. [ OK ] Started dracut initqueue hook. Mounting /sysroot... [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. [ 10.931654] EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Timers. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped dracut initqueue hook. Stopping Hardware RNG Entropy Gatherer Daemon... [ OK ] Stopped Hardware RNG Entropy Gatherer Daemon. [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped target Basic System. [ OK ] Stopped target Paths. [ OK ] Stopped target Slices. [ OK ] Stopped target Sockets. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Local Encrypted Volumes. [ OK ] Stopped Dispatch Password Requests to Console Directory Watch. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped dracut pre-trigger hook. Stopping udev Kernel Device Manager... [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Swap. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Reached target Switch Root. Starting Switch Root... [ 12.162256] printk: systemd: 26 output lines suppressed due to ratelimiting [ 12.432652] SELinux: Disabled at runtime. [ 12.578803] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 12.588871] systemd[1]: Detected virtualization kvm. [ 12.590911] systemd[1]: Detected architecture x86-64. Welcome to Rocky Linux 8.10 (Green Obsidian)! [ 13.193310] systemd[1]: initrd-switch-root.service: Succeeded. [ 13.196876] systemd[1]: Stopped Switch Root. [ OK ] Stopped Switch Root. [ 13.201704] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. [ 13.205602] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 13.209316] systemd[1]: Stopped Journal Service. [ OK ] Stopped Journal Service. [ 13.217182] systemd[1]: Starting Journal Service... Starting Journal Service... [ 13.223857] systemd[1]: Starting Remount Root and Kernel File Systems... Starting Remount Root and Kernel File Systems... [ OK ] Created slice system-getty.slice. [ OK ] Stopped target Switch Root. Mounting POSIX Message Queue File System... [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Created slice User and Session Slice. Starting Apply Kernel Variables... [ OK ] Listening on udev Control Socket. [ OK ] Reached target Slices. [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Paths. [ OK ] Created slice system-serial\x2dgetty.slice. Mounting Huge Pages File System... Mounting Kernel Debug File System... [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Listening on Process Core Dump Socket. [ OK ] Reached target rpc_pipefs.target. Activating swap /dev/disk/by-label/SWAP... [FAILED] Failed to set up automount Arbitrar…rmats File System Automount Point. See 'systemctl status proc-sys-fs-binfmt_misc.automount' for details. [ OK ] Stopped target Initrd File Systems. Starting Create list of required st…ce nodes for the current kernel... [ 13.422151] Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS [ OK ] Listening on udev Kernel Socket. Starting udev Coldplug all Devices... [ OK ] Created slice system-sshd\x2dkeygen.slice. [ OK ] Stopped target Initrd Root File System. [ OK ] Started Journal Service. [FAILED] Failed to start Remount Root and Kernel File Systems. See 'systemctl status systemd-remount-fs.service' for details. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Started Apply Kernel Variables. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Activated swap /dev/disk/by-label/SWAP. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Reached target Swap. Starting Configure read-only root support... Starting Create Static Device Nodes in /dev... Starting Flush Journal to Persistent Storage... [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Reached target Local File Systems (Pre). Mounting /home/green/git/lustre-release... Mounting /mnt... Starting udev Kernel Device Manager... [ OK ] Started udev Coldplug all Devices. [ OK ] Mounted /mnt. [ 13.718232] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ OK ] Mounted /home/green/git/lustre-release. [ OK ] Started udev Kernel Device Manager. [ 14.011575] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 14.045818] input: PC Speaker as /devices/platform/pcspkr/input/input5 [ 14.270154] RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer [ 14.281800] EDAC sbridge: Ver: 1.1.2 [ 15.730192] Key type dns_resolver registered [ 16.055312] NFS: Registering the id_resolver key type [ 16.058409] Key type id_resolver registered [ 16.060236] Key type id_legacy registered [ OK ] Started Configure read-only root support. Starting Load/Save Random Seed... [ OK ] Reached target Local File Systems. Starting Create Volatile Files and Directories... Starting Rebuild Dynamic Linker Cache... Starting Mark the need to relabel after reboot... [ OK ] Started Load/Save Random Seed. [ OK ] Started Create Volatile Files and Directories. [ OK ] Started Mark the need to relabel after reboot. Starting RPC Bind... Starting Update UTMP about System Boot/Shutdown... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Started RPC Bind. [ OK ] Started Rebuild Dynamic Linker Cache. Starting Update is Completed... [ OK ] Started Update is Completed. [ OK ] Reached target System Initialization. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. Starting Restore /run/initramfs on shutdown... Starting Login Service... [ OK ] Started irqbalance daemon. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Reached target sshd-keygen.target. [ OK ] Started dnf makecache --timer. [ OK ] Reached target Timers. [ OK ] Started D-Bus System Message Bus. Starting Network Manager... [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Network Manager. Starting Network Manager Wait Online... [ OK ] Reached target Network. Starting GSSAPI Proxy Daemon... Starting Dynamic System Tuning Daemon... Starting OpenSSH server daemon... [ OK ] Started OpenSSH server daemon. [ OK ] Started Login Service. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... Starting Hostname Service... [ OK ] Started Permit User Sessions. [ OK ] Started Getty on tty1. [ OK ] Started Serial Getty on ttyS1. [ OK ] Started Serial Getty on ttyS0. [ OK ] Reached target Login Prompts. [ OK ] Started Command Scheduler. [ OK ] Started Hostname Service. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... Starting Notify NFS peers of a restart... Starting System Logging Service... [ OK ] Started Notify NFS peers of a restart. [ OK ] Started System Logging Service. Starting Authorization Manager... [ OK ] Started Authorization Manager. [ OK ] Started Dynamic System Tuning Daemon. [ OK ] Reached target Multi-User System. [ OK ] Reached target Graphical Interface. Starting Update UTMP about System Runlevel Changes... [ OK ] Started Update UTMP about System Runlevel Changes. Rocky Linux 8.10 (Green Obsidian) Kernel 4.18.0rh8.10-debug on an x86_64 oleg105-server login: [ 44.761890] libcfs: loading out-of-tree module taints kernel. [ 44.781955] Key type ._llcrypt registered [ 44.783218] Key type .llcrypt registered [ 44.829075] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_hostid [ 54.701843] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing load_modules_local [ 56.951458] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 56.982082] alg: No test for adler32 (adler32-zlib) [ 58.722513] Lustre: Lustre: Build Version: 2.17.57_81_g37bf112 [ 59.972289] LNet: Added LNI 192.168.201.105@tcp [8/256/0/180] [ 61.887196] Key type lgssc registered [ 64.847571] Lustre: Echo OBD driver; http://www.lustre.org/ [ 82.004636] hrtimer: interrupt took 3172712 ns [ 84.175857] ZFS: Loaded module v2.3.2-1, ZFS pool version 5000, ZFS filesystem version 5 [ 130.144844] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing load_modules_local [ 144.479148] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 144.559887] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 145.952432] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 145.990561] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 146.153783] Lustre: lustre-MDT0000: new disk, initializing [ 146.288900] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 146.320166] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 151.544192] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 166.959888] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 167.102648] Lustre: 6486:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 167.163861] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 167.169684] Lustre: Skipped 1 previous similar message [ 167.286180] Lustre: lustre-MDT0001: new disk, initializing [ 167.351784] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 167.398380] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 167.411869] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 171.928971] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 178.114121] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 189.293412] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 189.639665] Lustre: lustre-OST0000: new disk, initializing [ 189.643773] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 189.652828] Lustre: 8424:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 189.785111] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 191.190595] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 191.208383] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 191.372216] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 198.567266] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 215.125864] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 215.280082] Lustre: lustre-OST0001: new disk, initializing [ 215.284552] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 215.293330] Lustre: 9496:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 215.365445] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 222.295113] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 222.311202] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 222.446854] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 222.731444] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 235.735477] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 245.919132] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 252.883342] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing check_logdir /tmp/testlogs/ [ 258.642931] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing yml_node [ 263.637320] Lustre: DEBUG MARKER: Client: 2.17.57.81 [ 266.538241] Lustre: DEBUG MARKER: MDS: 2.17.57.81 [ 269.565529] Lustre: DEBUG MARKER: OSS: 2.17.57.81 [ 271.316527] Lustre: DEBUG MARKER: -----============= acceptance-small: conf-sanity ============----- Wed Aug 26 08:26:12 EDT 2026 [ 293.922950] Lustre: DEBUG MARKER: excepting tests: 102 106 115 32newtarball [ 295.679174] Lustre: DEBUG MARKER: skipping tests SLOW=no: 45 69 106 111 114 [ 314.851939] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 314.856952] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 314.868146] Lustre: Skipped 3 previous similar messages [ 314.877250] Lustre: Skipped 3 previous similar messages [ 319.995671] Lustre: server umount lustre-MDT0000 complete [ 324.088709] LustreError: 6478:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787747227 with bad export cookie 9609633469305965330 [ 324.092554] LustreError: MGC192.168.201.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 324.099510] LustreError: 6478:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 325.093644] LustreError: 6493:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 325.097835] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 325.122149] LustreError: 6493:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 6 previous similar messages [ 325.174969] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 325.183625] Lustre: Skipped 1 previous similar message [ 329.121357] LustreError: 6492:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 329.124429] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 329.189863] Lustre: Skipped 1 previous similar message [ 331.320094] Lustre: server umount lustre-MDT0001 complete [ 337.522520] Lustre: server umount lustre-OST0000 complete [ 343.326460] Lustre: server umount lustre-OST0001 complete [ 351.587973] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_hostid [ 363.741151] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing load_modules_local [ 407.117048] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 407.453988] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 407.485351] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 407.580419] Lustre: lustre-MDT0000: new disk, initializing [ 407.672663] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 407.692355] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 413.395142] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 426.383436] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 426.561236] Lustre: 15051:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 426.653944] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 426.664932] Lustre: Skipped 1 previous similar message [ 426.740923] Lustre: lustre-MDT0001: new disk, initializing [ 426.870975] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 426.921419] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 426.945229] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 432.517536] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 442.929438] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 450.025687] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 458.490200] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 458.979596] Lustre: lustre-OST0000: new disk, initializing [ 458.987478] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 458.995343] Lustre: 17022:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 459.121225] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 460.444384] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 460.469616] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 460.672778] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 466.395918] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 478.774225] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 485.144250] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 485.582610] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 493.485441] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 493.859918] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 501.742378] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 501.747272] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 501.793445] Lustre: Skipped 1 previous similar message [ 501.818799] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 503.074671] Lustre: server umount lustre-OST0000 complete [ 508.896597] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 508.910390] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 508.934269] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 508.943558] Lustre: Skipped 1 previous similar message [ 514.845860] Lustre: server umount lustre-MDT0000 complete [ 517.088372] LustreError: 15924:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 517.095196] LustreError: 15924:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 518.989653] LustreError: 15043:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787747422 with bad export cookie 9609633469305966863 [ 519.005223] LustreError: MGC192.168.201.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 519.017659] LustreError: 15043:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 519.394556] Lustre: server umount lustre-MDT0001 complete [ 526.069846] Lustre: DEBUG MARKER: == conf-sanity test 76a: set permanent params with lctl across mounts ========================================================== 08:30:27 (1787747427) [ 533.004960] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 533.377478] LustreError: 19289:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 533.387095] LustreError: 19289:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 533.433742] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 538.300471] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 538.600219] LustreError: 19290:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 547.903237] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 553.840889] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 562.953788] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 570.628471] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 580.459976] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 587.636496] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 596.914549] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 612.553503] Lustre: Modifying parameter general.osc.*.max_dirty_mb=452 in log params [ 620.001263] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 620.023407] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 620.049605] Lustre: Skipped 1 previous similar message [ 620.060564] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 620.065346] Lustre: Skipped 2 previous similar messages [ 626.033289] Lustre: server umount lustre-MDT0000 complete [ 629.219750] LustreError: 20403:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 629.252276] LustreError: 20403:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [ 630.979625] LustreError: 19270:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787747534 with bad export cookie 9609633469305967738 [ 630.990649] LustreError: MGC192.168.201.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 630.994839] LustreError: 19270:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 5 previous similar messages [ 631.474828] Lustre: server umount lustre-MDT0001 complete [ 647.251551] Lustre: server umount lustre-OST0000 complete [ 671.500240] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing load_modules_local [ 682.468767] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 682.942945] LustreError: 23694:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 683.008953] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 683.019964] Lustre: Skipped 2 previous similar messages [ 688.168649] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 697.560177] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 703.637914] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 707.954436] Lustre: Setting parameter general.debug_raw_pointers=Y in log params [ 717.407486] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 726.524484] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 735.680840] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 735.941248] Lustre: lustre-OST0001: new disk, initializing [ 735.943955] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 735.975094] Lustre: 26011:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 737.664739] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 737.676100] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 737.861065] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 743.666441] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 753.304533] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 757.325528] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 773.607159] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 773.612630] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 773.630195] Lustre: Skipped 5 previous similar messages [ 773.640140] Lustre: Skipped 6 previous similar messages [ 778.563925] Lustre: server umount lustre-MDT0000 complete [ 778.725253] LustreError: 23694:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 778.743767] LustreError: 23694:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 5 previous similar messages [ 782.365478] LustreError: 24835:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787747686 with bad export cookie 9609633469305968592 [ 782.381468] LustreError: 24835:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 782.384642] LustreError: MGC192.168.201.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 782.736285] Lustre: server umount lustre-MDT0001 complete [ 796.854538] Lustre: server umount lustre-OST0000 complete [ 800.224089] Lustre: 3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787747687/real 1787747687] req@ffff969544ea9880 x1874588559735936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787747703 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 800.280402] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 801.998248] Lustre: server umount lustre-OST0001 complete [ 820.878879] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing load_modules_local [ 831.327145] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 831.999795] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 832.004871] Lustre: Skipped 3 previous similar messages [ 837.147969] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 847.333203] LustreError: 29033:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 847.368777] LustreError: 29033:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [ 847.556393] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 852.591352] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 856.014657] Lustre: 30179:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 863.436312] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 870.233688] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 879.631036] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 887.568926] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 895.971810] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 900.654170] Lustre: 32061:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 909.285217] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 909.291143] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 909.304910] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 913.383181] Lustre: server umount lustre-MDT0000 complete [ 917.670187] LustreError: 29012:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787747821 with bad export cookie 9609633469305969887 [ 917.681262] LustreError: 29012:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 917.685427] LustreError: MGC192.168.201.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 918.091969] Lustre: server umount lustre-MDT0001 complete [ 932.940546] Lustre: server umount lustre-OST0000 complete [ 936.415196] Lustre: 3620:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787747824/real 1787747824] req@ffff9695437eaa00 x1874588559788288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787747840 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 936.891580] Lustre: server umount lustre-OST0001 complete [ 946.268873] Lustre: DEBUG MARKER: == conf-sanity test 76b: verify params log setup correctly ========================================================== 08:37:27 (1787747847) [ 977.200110] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing load_modules_local [ 987.557749] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 987.976364] LustreError: 34864:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 988.008655] LustreError: 34864:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 7 previous similar messages [ 992.772412] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 1001.426858] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1006.267234] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 1009.031458] Lustre: 36011:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 1016.636241] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1024.608808] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 1033.598895] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1039.919825] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 1049.001925] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1053.415985] Lustre: 37891:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 1059.813197] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1059.818752] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1059.846636] Lustre: Skipped 6 previous similar messages [ 1059.866102] Lustre: Skipped 7 previous similar messages [ 1065.746515] Lustre: server umount lustre-MDT0000 complete [ 1071.676036] LustreError: 34845:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787747975 with bad export cookie 9609633469305970986 [ 1071.693453] LustreError: 34845:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 1071.698558] LustreError: MGC192.168.201.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1072.058960] Lustre: server umount lustre-MDT0001 complete [ 1086.972499] Lustre: server umount lustre-OST0000 complete [ 1091.040570] Lustre: 3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787747978/real 1787747978] req@ffff9695432cce00 x1874588559838848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787747994 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 1092.395740] Lustre: server umount lustre-OST0001 complete [ 1102.751946] Lustre: DEBUG MARKER: == conf-sanity test 76c: verify changelog_mask is applied with lctl set_param -P ========================================================== 08:40:04 (1787748004) [ 1121.188704] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing load_modules_local [ 1135.034677] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1135.699955] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1135.714185] Lustre: Skipped 7 previous similar messages [ 1140.924562] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 1150.464423] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1156.029899] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 1159.756783] Lustre: 41183:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 1168.223244] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1178.551809] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 1189.282272] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1196.561325] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 1204.691956] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1208.404032] Lustre: 43060:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 1209.452931] Lustre: Setting parameter general.mdd.*.changelog_mask=-CLOSE in log params [ 1209.458491] Lustre: Skipped 1 previous similar message [ 1215.298985] Lustre: server umount lustre-MDT0000 complete [ 1215.478553] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1215.493519] Lustre: Skipped 2 previous similar messages [ 1219.996909] LustreError: 40015:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787748123 with bad export cookie 9609633469305972099 [ 1219.998383] LustreError: MGC192.168.201.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1220.011856] LustreError: 40015:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 6 previous similar messages [ 1220.429397] Lustre: lustre-MDT0001: Not available for connect from 192.168.201.5@tcp (stopping) [ 1220.454525] Lustre: Skipped 4 previous similar messages [ 1226.994863] Lustre: server umount lustre-MDT0001 complete [ 1241.806737] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1245.710659] LustreError: 41547:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1245.751706] LustreError: 41547:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 30 previous similar messages [ 1252.291191] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 1255.252537] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 1263.574649] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1269.762778] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 1269.773531] Lustre: Skipped 1 previous similar message [ 1269.896850] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 1278.694407] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1280.773563] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 1287.713175] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 1290.040777] Lustre: DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec [ 1299.937503] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1304.180676] Lustre: server umount lustre-MDT0000 complete [ 1308.423124] LustreError: 40015:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787748212 with bad export cookie 9609633469305973191 [ 1308.430764] LustreError: MGC192.168.201.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1308.431651] LustreError: 40015:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 1309.185833] Lustre: server umount lustre-MDT0001 complete [ 1324.953297] Lustre: server umount lustre-OST0000 complete [ 1326.879256] Lustre: 3618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787748214/real 1787748214] req@ffff96966dbb9500 x1874588559931136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787748230 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 1326.947359] Lustre: 3618:0:(client.c:2503:ptlrpc_expire_one_request()) Skipped 1 previous similar message [ 1330.226285] Lustre: server umount lustre-OST0001 complete [ 1340.834105] Lustre: DEBUG MARKER: == conf-sanity test 76d: verify llite.*.xattr_cache can be set by 'lctl set_param -P' correctly ========================================================== 08:44:01 (1787748241) [ 1360.807459] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing load_modules_local [ 1372.322142] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1377.653768] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 1387.850683] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1394.477404] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 1398.776611] Lustre: 48828:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 1407.715377] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1417.499615] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 1428.867730] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1436.695440] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 1447.507788] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1453.602518] Lustre: Setting parameter general.llite.*.xattr_cache=0 in log params [ 1465.329611] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1467.552926] Lustre: server umount lustre-MDT0000 complete [ 1472.321671] LustreError: 47657:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787748376 with bad export cookie 9609633469305974017 [ 1472.323622] LustreError: MGC192.168.201.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1472.350914] LustreError: 47657:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 1473.331567] Lustre: server umount lustre-MDT0001 complete [ 1488.804567] Lustre: server umount lustre-OST0000 complete [ 1491.616043] Lustre: 3619:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787748379/real 1787748379] req@ffff969675dcd880 x1874588559990528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787748395 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 1491.654400] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1491.672655] Lustre: Skipped 14 previous similar messages [ 1493.692611] Lustre: server umount lustre-OST0001 complete [ 1505.294240] Lustre: DEBUG MARKER: == conf-sanity test 77: comma-separated MGS NIDs and failover node NIDs ========================================================== 08:46:46 (1787748406) [ 1509.541080] Lustre: DEBUG MARKER: SKIP: conf-sanity test_77 mixed loopback and real device not working [ 1512.282871] Lustre: DEBUG MARKER: == conf-sanity test 78: run resize2fs on MDT and OST filesystems ========================================================== 08:46:53 (1787748413) [ 1524.956816] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_hostid [ 1535.812851] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing load_modules_local [ 1561.847872] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1562.279733] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1562.427830] Lustre: lustre-MDT0000: new disk, initializing [ 1562.678261] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1568.095956] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 1579.211550] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1587.442800] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1587.721796] Lustre: lustre-OST0000: new disk, initializing [ 1587.726348] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1587.733246] Lustre: Skipped 1 previous similar message [ 1587.737720] Lustre: 54905:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1589.187970] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 1589.206701] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 1589.249670] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 1596.422160] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 1609.552025] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1612.867532] Lustre: DEBUG MARKER: create test files [ 1650.663410] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1650.697849] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1650.714962] Lustre: Skipped 14 previous similar messages [ 1655.752237] Lustre: server umount lustre-OST0000 complete [ 1660.672936] Lustre: server umount lustre-MDT0000 complete [ 1674.882513] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing unload_modules_local [ 1679.193284] Key type lgssc unregistered [ 1679.680908] LNet: 56541:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1679.692371] LNetError: 56541:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1679.728323] LNet: Removed LNI 192.168.201.105@tcp [ 1681.120200] Key type .llcrypt unregistered [ 1681.123429] Key type ._llcrypt unregistered [ 1716.531976] Key type ._llcrypt registered [ 1716.536596] Key type .llcrypt registered [ 1716.654789] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing load_modules_local [ 1717.906001] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1717.929422] alg: No test for adler32 (adler32-zlib) [ 1719.219702] Lustre: Lustre: Build Version: 2.17.57_81_g37bf112 [ 1719.491994] LNet: Added LNI 192.168.201.105@tcp [8/256/0/180] [ 1721.151174] Key type lgssc registered [ 1722.941217] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1731.682215] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1731.709289] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1733.156659] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1739.143876] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 1748.625526] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1756.462843] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1756.785800] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1757.839281] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:102 to 0x240000400:129) [ 1758.005527] Lustre: 59281:0:(osd_internal.h:1460:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 510 < left 544, rollback = 9 [ 1758.013698] Lustre: 59281:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 32/128/5, destroy: 0/0/0 [ 1758.026879] Lustre: 59281:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 1758.042527] Lustre: 59281:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/18/1, punch: 0/0/0, quota 1/3/0 [ 1758.055890] Lustre: 59281:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 1758.066363] Lustre: 59281:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 1765.128213] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 1773.745776] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1779.978874] Lustre: DEBUG MARKER: check files after expanding the MDT and OST filesystems [ 1785.717674] Lustre: DEBUG MARKER: create more files after expanding the MDT and OST filesystems [ 1819.617707] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1819.630075] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1819.650521] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1820.667685] Lustre: server umount lustre-OST0000 complete [ 1825.293274] Lustre: server umount lustre-MDT0000 complete [ 1840.156316] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing unload_modules_local [ 1843.868218] Key type lgssc unregistered [ 1844.253699] LNet: 60915:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1844.264869] LNetError: 60915:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1844.337389] LNet: Removed LNI 192.168.201.105@tcp [ 1845.560434] Key type .llcrypt unregistered [ 1845.563200] Key type ._llcrypt unregistered [ 1881.065891] Key type ._llcrypt registered [ 1881.067854] Key type .llcrypt registered [ 1881.202690] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing load_modules_local [ 1882.781840] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1882.808468] alg: No test for adler32 (adler32-zlib) [ 1883.904351] Lustre: Lustre: Build Version: 2.17.57_81_g37bf112 [ 1884.173374] LNet: Added LNI 192.168.201.105@tcp [8/256/0/180] [ 1885.888137] Key type lgssc registered [ 1887.604824] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1897.476467] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1897.494208] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1899.029902] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1905.230870] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 1914.971653] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1923.188765] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1923.556854] Lustre: lustre-OST0000: Not available for connect from 0@lo (not set up) [ 1923.730932] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1929.204034] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:140 to 0x240000400:161) [ 1929.362321] Lustre: 63754:0:(osd_internal.h:1460:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 509 < left 544, rollback = 9 [ 1929.384292] Lustre: 63754:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 32/128/6, destroy: 0/0/0 [ 1929.393542] Lustre: 63754:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 1929.414672] Lustre: 63754:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/18/1, punch: 0/0/0, quota 1/3/0 [ 1929.419485] Lustre: 63754:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 1929.434107] Lustre: 63754:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 1930.275184] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 1940.367922] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1946.577341] Lustre: DEBUG MARKER: check files after shrinking the MDT and OST filesystems [ 1959.909231] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1959.910285] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1959.928667] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1963.356851] Lustre: server umount lustre-OST0000 complete [ 1968.845543] Lustre: server umount lustre-MDT0000 complete [ 1981.722062] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing unload_modules_local [ 1985.431494] Key type lgssc unregistered [ 1985.871800] LNet: 65315:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1985.885103] LNetError: 65315:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1985.910186] LNet: Removed LNI 192.168.201.105@tcp [ 1987.083599] Key type .llcrypt unregistered [ 1987.088275] Key type ._llcrypt unregistered [ 2010.261362] Key type ._llcrypt registered [ 2010.263211] Key type .llcrypt registered [ 2010.376309] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_hostid [ 2029.376422] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing load_modules_local [ 2030.897869] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2031.073843] alg: No test for adler32 (adler32-zlib) [ 2032.501219] Lustre: Lustre: Build Version: 2.17.57_81_g37bf112 [ 2032.815121] LNet: Added LNI 192.168.201.105@tcp [8/256/0/180] [ 2034.583181] Key type lgssc registered [ 2036.558889] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2085.217976] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2085.244433] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2086.490517] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2086.515490] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2086.607717] Lustre: lustre-MDT0000: new disk, initializing [ 2086.709946] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2086.728774] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2092.336894] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 2105.792602] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2105.974557] Lustre: 68474:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2106.082343] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 2106.096139] Lustre: Skipped 1 previous similar message [ 2106.242529] Lustre: lustre-MDT0001: new disk, initializing [ 2106.408228] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2106.453375] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 2106.459967] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2112.372983] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 2125.094334] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2131.674686] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2140.319445] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2140.599813] Lustre: lustre-OST0000: new disk, initializing [ 2140.613660] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 2140.633465] Lustre: 70444:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2140.804546] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2147.871620] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 2149.465852] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 2149.477948] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2149.596299] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2157.877383] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2162.940846] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2163.202265] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2168.182216] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2168.437487] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2175.463435] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2175.465037] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2175.486382] Lustre: Skipped 1 previous similar message [ 2175.508402] Lustre: Skipped 1 previous similar message [ 2176.973492] Lustre: server umount lustre-OST0000 complete [ 2183.153271] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2183.168684] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2183.214755] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2185.697544] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2185.698670] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2185.747395] Lustre: Skipped 1 previous similar message [ 2188.379770] Lustre: server umount lustre-MDT0000 complete [ 2192.807788] LustreError: 68467:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787749096 with bad export cookie 16958014591090951264 [ 2192.826165] LustreError: MGC192.168.201.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2192.834629] LustreError: 68467:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2193.325362] Lustre: server umount lustre-MDT0001 complete [ 2202.608647] Lustre: DEBUG MARKER: == conf-sanity test 79: format MDT/OST without mgs option (should return errors) ========================================================== 08:58:23 (1787749103) [ 2214.206537] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing load_modules_local [ 2259.370196] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_hostid [ 2271.464486] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing load_modules_local [ 2313.921819] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2314.307290] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2314.353059] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2314.513431] Lustre: lustre-MDT0000: new disk, initializing [ 2314.630342] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2314.654732] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2320.245430] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 2333.217635] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2333.405462] Lustre: 76471:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2333.453758] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 2333.459525] Lustre: Skipped 1 previous similar message [ 2333.575587] Lustre: lustre-MDT0001: new disk, initializing [ 2333.685108] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2333.758136] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 2333.775647] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2339.276847] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 2350.323259] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2356.858254] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2365.743565] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2366.107213] Lustre: lustre-OST0000: new disk, initializing [ 2366.121524] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 2366.135741] Lustre: 78454:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2366.291383] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2372.689129] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 2372.707303] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2372.844406] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2374.153621] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 2384.252803] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2389.959600] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2390.219199] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2395.737290] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2396.074687] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2398.691556] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2398.696596] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2398.710670] LustreError: Skipped 1 previous similar message [ 2398.730076] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2403.829488] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2403.843462] Lustre: Skipped 2 previous similar messages [ 2404.763556] Lustre: server umount lustre-OST0000 complete [ 2410.468543] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2410.479522] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2410.510144] Lustre: Skipped 1 previous similar message [ 2414.052607] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2414.073101] Lustre: Skipped 2 previous similar messages [ 2415.761798] Lustre: server umount lustre-MDT0000 complete [ 2419.173195] LustreError: 76482:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2419.220603] LustreError: 76482:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 4 previous similar messages [ 2420.314690] LustreError: 76461:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787749324 with bad export cookie 16958014591090952146 [ 2420.315809] LustreError: MGC192.168.201.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2420.324661] LustreError: 76461:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 2420.761942] Lustre: server umount lustre-MDT0001 complete [ 2431.889424] Lustre: DEBUG MARKER: == conf-sanity test 80: mgc import reconnect race ======== 09:02:12 (1787749332) [ 2440.573734] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2441.325919] LustreError: 80867:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2441.442743] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2446.822420] LustreError: 80868:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2446.890705] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 2451.951997] LustreError: 80867:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2457.056981] LustreError: 80868:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2458.537620] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2464.323940] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 2473.882437] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2481.233229] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2489.270815] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2489.583750] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2489.596050] Lustre: Skipped 1 previous similar message [ 2496.989877] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 2507.789472] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2512.777636] Lustre: 83538:0:(genops.c:1774:obd_export_evict_by_uuid()) MGS: evicting dc2f7ac0-eba8-45d6-9878-d8aa5acc5a8d at adminstrative request [ 2513.192560] LustreError: MGC192.168.201.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2513.223495] Lustre: *** cfs_fail_loc=906, val=2147483648*** [ 2522.613435] Lustre: MGS: Client dc2f7ac0-eba8-45d6-9878-d8aa5acc5a8d (at 0@lo) reconnecting [ 2522.627748] Lustre: Evicted from MGS (at 0@lo) after server handle changed from 0xeb56f86c55de0b3d to 0xeb56f86c55de0de4 [ 2522.643231] Lustre: MGC192.168.201.105@tcp: Connection restored to 0@lo (at 0@lo) [ 2552.094545] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2552.304919] Lustre: lustre-OST0001: new disk, initializing [ 2552.309227] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 2552.327387] Lustre: 83936:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2558.590132] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 2558.607489] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 2558.820350] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 2560.931874] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 2572.105917] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2579.425205] Lustre: lustre-OST0001-osc-MDT0001: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2579.448539] Lustre: Skipped 2 previous similar messages [ 2579.449285] LustreError: lustre-OST0001-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2579.449342] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 2581.680167] Lustre: server umount lustre-OST0001 complete [ 2584.547670] LustreError: 83550:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2584.579791] LustreError: 83550:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 2593.939899] Lustre: server umount lustre-OST0000 complete [ 2599.929081] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2599.975054] Lustre: Skipped 2 previous similar messages [ 2604.783987] Lustre: server umount lustre-MDT0000 complete [ 2605.035327] LustreError: 80868:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2605.068972] LustreError: 80868:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 2610.347328] LustreError: 80847:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787749514 with bad export cookie 16958014591090953700 [ 2610.362809] LustreError: MGC192.168.201.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2610.363038] LustreError: 80847:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 2610.808775] Lustre: server umount lustre-MDT0001 complete [ 2622.008980] Lustre: DEBUG MARKER: == conf-sanity test 81: sparse OST indexing ============== 09:05:23 (1787749523) [ 2624.279616] Lustre: DEBUG MARKER: SKIP: conf-sanity test_81 needs >= 3 OSTs [ 2626.931511] Lustre: DEBUG MARKER: == conf-sanity test 82a: specify OSTs for file (succeed) or directory (succeed) ========================================================== 09:05:27 (1787749527) [ 2629.222696] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82a needs >= 3 OSTs [ 2630.973595] Lustre: DEBUG MARKER: == conf-sanity test 82b: specify OSTs for file with --pool and --ost-list options ========================================================== 09:05:32 (1787749532) [ 2633.261875] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82b needs >= 4 OSTs [ 2635.029610] Lustre: DEBUG MARKER: == conf-sanity test 82c: specify sparse OSTs for setstripe (should not crash) ========================================================== 09:05:36 (1787749536) [ 2637.139403] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82c needs >= 4 OSTs [ 2640.471692] Lustre: DEBUG MARKER: == conf-sanity test 83: ENOSPACE on OST doesn't cause message VFS: Busy inodes after unmount ... ========================================================== 09:05:40 (1787749540) [ 2642.448821] Lustre: DEBUG MARKER: mount the OST /dev/mapper/ost1_flakey as a ldiskfs filesystem [ 2648.702960] loop: module loaded [ 2648.720304] loop0: detected capacity change from 0 to 4294967296 [ 2648.793046] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 2650.265594] Lustre: DEBUG MARKER: run llverfs in partial mode on the OST ldiskfs /mnt/lustre-ost1 [ 2654.925145] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing run_llverfs /mnt/lustre-ost1 -vpl no [ 2659.852806] Lustre: DEBUG MARKER: unmount the OST /dev/mapper/ost1_flakey [ 2691.815740] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2691.894160] LustreError: 88063:0:(obd_config.c:845:class_setup()) setup lustre-OST0000-osd failed (-28) [ 2691.903809] LustreError: 88063:0:(obd_mount.c:259:lustre_start_simple()) lustre-OST0000-osd setup error -28 [ 2691.908782] LustreError: 88063:0:(tgt_mount.c:2582:server_fill_super()) Unable to start osd on /dev/mapper/ost1_flakey: -28 [ 2691.921409] LustreError: 88063:0:(super25.c:179:lustre_fill_super()) llite: Unable to mount : rc = -28 [ 2713.963785] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_hostid [ 2723.938447] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing load_modules_local [ 2770.352096] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2770.814808] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2770.848237] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2770.934587] Lustre: lustre-MDT0000: new disk, initializing [ 2771.069485] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2771.079303] Lustre: Skipped 1 previous similar message [ 2771.100675] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2776.573168] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 2789.202542] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2789.356674] Lustre: 90931:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2789.562738] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2795.055469] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 2808.188750] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2816.773788] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2825.983286] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2826.355396] Lustre: 92900:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2833.048612] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2833.306454] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2836.509025] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 2849.367682] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2853.787300] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2853.963553] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2860.631895] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2861.039485] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2864.109971] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2864.123799] Lustre: Skipped 1 previous similar message [ 2864.133977] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2864.156056] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2864.169609] Lustre: Skipped 5 previous similar messages [ 2870.012719] Lustre: server umount lustre-OST0000 complete [ 2876.902311] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2876.927491] LustreError: Skipped 1 previous similar message [ 2881.616199] Lustre: server umount lustre-MDT0000 complete [ 2884.590802] LustreError: 90943:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2884.631479] LustreError: 90943:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [ 2887.603742] LustreError: 90924:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787749791 with bad export cookie 16958014591090954316 [ 2887.609025] LustreError: MGC192.168.201.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2887.612209] LustreError: 90924:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 6 previous similar messages [ 2888.398989] Lustre: server umount lustre-MDT0001 complete [ 2900.234663] Lustre: DEBUG MARKER: == conf-sanity test 84: check recovery_hard_time ========= 09:10:01 (1787749801) [ 2910.243850] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2911.072097] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-60 [ 2911.076241] Lustre: Skipped 2 previous similar messages [ 2916.456547] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 2926.597959] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2932.546348] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 2941.002367] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2948.071810] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2956.562093] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2956.775417] LustreError: 97137:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2956.805290] LustreError: 97137:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 5 previous similar messages [ 2964.616931] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 2973.053553] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2977.792378] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2978.006287] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2984.603454] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2984.877663] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2994.579752] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2994.906726] Lustre: lustre-OST0001: new disk, initializing [ 2994.914136] Lustre: Skipped 2 previous similar messages [ 2994.929229] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 2994.937129] Lustre: Skipped 3 previous similar messages [ 2994.966314] Lustre: 98689:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3002.332346] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 3005.024814] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 3005.030815] Lustre: Skipped 2 previous similar messages [ 3005.041255] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 3005.222847] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 3012.953389] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3018.582894] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid 50 [ 3018.810712] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 3024.313384] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [ 3024.648923] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 3048.095280] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 3076.358439] Lustre: Failing over lustre-MDT0000 [ 3077.128755] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3077.174949] Lustre: Skipped 5 previous similar messages [ 3077.177916] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3077.201781] Lustre: Skipped 7 previous similar messages [ 3077.713791] Lustre: server umount lustre-MDT0000 complete [ 3087.331333] LustreError: 95316:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3087.354400] LustreError: 95316:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 11 previous similar messages [ 3097.379689] Lustre: 66696:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787749985/real 1787749985] req@00000000c2fc0597 x1874590628613376/t0(0) o400->MGC192.168.201.105@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1787750001 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 3097.420805] LustreError: MGC192.168.201.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3108.858444] LDISKFS-fs (dm-0): 4 truncates cleaned up [ 3108.860507] LDISKFS-fs (dm-0): recovery complete [ 3108.865808] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3124.791643] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 3125.535588] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 3125.538164] Lustre: 95311:0:(ldlm_lib.c:2110:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 3129.832041] Lustre: lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 3129.839128] Lustre: 96259:0:(ldlm_lib.c:2110:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 3129.861793] Lustre: 96259:0:(ldlm_lib.c:2110:extend_recovery_timer()) Skipped 1 previous similar message [ 3129.980032] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 3130.284909] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 3130.304784] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 3130.640869] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 3130.651229] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 1 previous similar message [ 3130.984494] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 3130.989532] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 1 previous similar message [ 3131.003604] Lustre: 101543:0:(ldlm_lib.c:2110:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 3131.026550] Lustre: 101543:0:(ldlm_lib.c:2110:extend_recovery_timer()) Skipped 7 previous similar messages [ 3131.692421] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 3131.701585] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 2 previous similar messages [ 3132.039248] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 3132.050393] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 2 previous similar messages [ 3133.073412] Lustre: 101543:0:(ldlm_lib.c:2110:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 3133.086118] Lustre: 101543:0:(ldlm_lib.c:2110:extend_recovery_timer()) Skipped 5 previous similar messages [ 3133.744326] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 3133.765481] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 5 previous similar messages [ 3134.089152] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 3134.102050] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 5 previous similar messages [ 3137.349626] Lustre: 101543:0:(ldlm_lib.c:2110:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 3137.368488] Lustre: 101543:0:(ldlm_lib.c:2110:extend_recovery_timer()) Skipped 12 previous similar messages [ 3138.013536] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 3138.035577] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 12 previous similar messages [ 3138.359217] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 3138.361644] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 12 previous similar messages [ 3145.425214] Lustre: 101543:0:(ldlm_lib.c:2110:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 3145.450990] Lustre: 101543:0:(ldlm_lib.c:2110:extend_recovery_timer()) Skipped 24 previous similar messages [ 3146.097344] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 3146.108536] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 24 previous similar messages [ 3146.449880] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 3146.465804] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 24 previous similar messages [ 3161.480751] Lustre: 101543:0:(ldlm_lib.c:2110:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 3161.495230] Lustre: 101543:0:(ldlm_lib.c:2110:extend_recovery_timer()) Skipped 49 previous similar messages [ 3162.154473] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 3162.164158] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 49 previous similar messages [ 3162.487648] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 3162.495850] LustreError: 101543:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 49 previous similar messages [ 3185.159377] Lustre: 101543:0:(ldlm_lib.c:2419:target_recovery_overseer()) lustre-MDT0000 recovery is aborted by hard timeout [ 3185.163767] Lustre: 101543:0:(ldlm_lib.c:2429:target_recovery_overseer()) recovery is aborted, evict exports in recovery [ 3185.171180] Lustre: 101543:0:(genops.c:1601:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client 06b9ed60-87d8-4992-b3be-607f7860870c@192.168.201.5@tcp [ 3185.180420] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 3185.186824] Lustre: 101543:0:(ldlm_lib.c:1939:abort_req_replay_queue()) @@@ aborted: req@000000006fda872e x1874590607411968/t0(8589934768) o35->06b9ed60-87d8-4992-b3be-607f7860870c@192.168.201.5@tcp:699/0 lens 392/0 e 0 to 0 dl 1787750099 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:0 [ 3185.206698] Lustre: lustre-MDT0000-osd: cancel update llog [0x200000400:0x1:0x0] [ 3185.217864] Lustre: lustre-MDT0000: Denying connection for new client 06b9ed60-87d8-4992-b3be-607f7860870c (at 192.168.201.5@tcp), waiting for 3 known clients (2 recovered, 0 in progress, and 1 evicted) to recover in 0:00 [ 3185.230519] Lustre: lustre-MDT0001-osp-MDT0000: cancel update llog [0x240000401:0x1:0x0] [ 3185.254215] Lustre: lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 3185.260830] Lustre: Skipped 2 previous similar messages [ 3185.264871] Lustre: lustre-MDT0000: Recovery over after 1:00, of 3 clients 2 recovered and 1 was evicted. [ 3185.311707] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:45 to 0x2c0000401:545) [ 3185.313554] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:77 to 0x280000401:577) [ 3201.513291] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3206.578963] Lustre: server umount lustre-OST0000 complete [ 3211.758030] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3211.769863] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 3211.772807] Lustre: Skipped 4 previous similar messages [ 3211.790243] Lustre: Skipped 5 previous similar messages [ 3218.036560] Lustre: server umount lustre-OST0001 complete [ 3237.343831] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 3237.695536] Lustre: server umount lustre-MDT0000 complete [ 3243.331771] LustreError: 97160:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787750147 with bad export cookie 16958014591091005535 [ 3243.334169] LustreError: MGC192.168.201.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3243.367965] LustreError: 97160:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 3244.138756] Lustre: server umount lustre-MDT0001 complete [ 3258.228862] Lustre: DEBUG MARKER: == conf-sanity test 85: osd_ost init: fail ea_fid_set ==== 09:15:59 (1787750159) [ 3268.346178] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3268.359116] Lustre: *** cfs_fail_loc=197, val=0*** [ 3284.255728] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 3289.441523] LustreError: 103520:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.201.105@tcp: failed processing log, type 4: rc = -110 [ 3294.767262] Lustre: *** cfs_fail_loc=197, val=0*** [ 3294.780473] Lustre: Skipped 65 previous similar messages [ 3315.359569] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3315.365757] Lustre: Skipped 4 previous similar messages [ 3324.137680] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 3333.229400] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3335.403355] Lustre: server umount lustre-OST0000 complete [ 3344.460997] Lustre: DEBUG MARKER: == conf-sanity test 86: Replacing mkfs.lustre -G option == 09:17:25 (1787750245) [ 3367.180662] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3367.826969] LustreError: 105142:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3367.851685] LustreError: 105142:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 56 previous similar messages [ 3372.475323] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 3384.248098] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3389.010854] LustreError: 105173:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x200000009:0x1:0x0]: rc = -5 [ 3389.024608] LustreError: 105173:0:(lod_sub_object.c:917:lod_sub_prep_llog()) lustre-MDT0000-mdtlov: can't get id from catalogs: rc = -5 [ 3389.034932] LustreError: 105173:0:(lod_dev.c:511:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 21, retries 0, failed: rc = -5 [ 3389.540880] Lustre: server umount lustre-MDT0000 complete [ 3429.801940] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_hostid [ 3442.689893] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing load_modules_local [ 3488.826802] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3489.141572] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3489.212724] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3489.323981] Lustre: lustre-MDT0000: new disk, initializing [ 3489.508410] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3496.228414] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 3510.867777] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3511.029494] Lustre: 109359:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 3511.320337] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 3517.695729] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 3529.111481] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3536.809532] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3546.872730] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3547.164514] Lustre: 111331:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3553.279791] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 3553.442070] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 3564.935326] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3570.606918] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 3570.784128] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 3577.069392] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 3577.344557] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 3583.978714] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3583.984335] LustreError: Skipped 2 previous similar messages [ 3583.993017] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3584.012857] Lustre: Skipped 2 previous similar messages [ 3584.035163] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3584.049150] Lustre: Skipped 9 previous similar messages [ 3594.207462] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 3594.588543] Lustre: server umount lustre-OST0000 complete [ 3607.048140] Lustre: server umount lustre-MDT0000 complete [ 3613.006592] LustreError: 109352:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787750516 with bad export cookie 16958014591091016105 [ 3613.009587] LustreError: MGC192.168.201.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3613.037772] LustreError: 109352:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 3614.171214] Lustre: server umount lustre-MDT0001 complete [ 3626.312927] Lustre: DEBUG MARKER: == conf-sanity test 87: check if MDT inode can hold EAs with N stripes properly ========================================================== 09:22:07 (1787750527) [ 3637.382815] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing unload_modules_local [ 3641.110449] Key type lgssc unregistered [ 3641.606350] LNet: 113823:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3641.609541] LNetError: 113823:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3641.618771] LNet: Removed LNI 192.168.201.105@tcp [ 3642.728623] Key type .llcrypt unregistered [ 3642.730473] Key type ._llcrypt unregistered [ 3667.112072] Key type ._llcrypt registered [ 3667.114573] Key type .llcrypt registered [ 3667.215721] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_hostid [ 3690.068863] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing load_modules_local [ 3691.224837] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3691.446762] alg: No test for adler32 (adler32-zlib) [ 3692.724857] Lustre: Lustre: Build Version: 2.17.57_81_g37bf112 [ 3693.055517] LNet: Added LNI 192.168.201.105@tcp [8/256/0/180] [ 3694.831320] Key type lgssc registered [ 3695.814853] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3741.704620] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3741.755910] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3743.090110] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3743.133908] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3743.237931] Lustre: lustre-MDT0000: new disk, initializing [ 3743.303798] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3743.343158] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3748.188688] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 3761.199685] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3761.509795] Lustre: lustre-OST0000: new disk, initializing [ 3761.518333] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3761.523721] Lustre: Skipped 1 previous similar message [ 3761.529119] Lustre: 118003:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3761.625941] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3769.109699] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 3769.507850] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 3769.519364] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 3769.571709] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 3782.098811] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3782.354562] Lustre: lustre-OST0001: new disk, initializing [ 3782.358737] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 3782.365306] Lustre: 118867:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3782.464381] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 3789.520125] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost [ 3789.524728] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] [ 3789.549841] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 [ 3790.739068] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 3800.033500] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3800.038911] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3800.044594] Lustre: Skipped 1 previous similar message [ 3800.054637] Lustre: Skipped 1 previous similar message [ 3805.154916] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3805.166088] Lustre: Skipped 1 previous similar message [ 3805.680646] Lustre: server umount lustre-MDT0000 complete [ 3813.342937] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null) [ 3818.123895] LustreError: 117191:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787750721 with bad export cookie 10198691950412651246 [ 3818.137135] LustreError: MGC192.168.201.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3818.138273] LustreError: 117191:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 3818.204622] Lustre: server umount lustre-OST0000 complete [ 3822.612958] Lustre: server umount lustre-OST0001 complete [ 3832.989133] Lustre: DEBUG MARKER: == conf-sanity test 88a: tunefs.lustre persists a --mountfsoptions-only change ========================================================== 09:25:34 (1787750734) [ 3858.111455] Lustre: DEBUG MARKER: == conf-sanity test 88b: check the default mount options can be overridden ========================================================== 09:25:59 (1787750759) [ 3869.059601] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing load_modules_local [ 3896.485464] Lustre: DEBUG MARKER: == conf-sanity test 89: check tunefs --param and --erase-param{s} options ========================================================== 09:26:37 (1787750797) [ 3939.787181] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_hostid [ 3951.603524] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing load_modules_local [ 3998.722864] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3999.075728] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3999.124975] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3999.244370] Lustre: lustre-MDT0000: new disk, initializing [ 3999.374360] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3999.433498] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 4004.553090] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 4017.409243] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4017.581426] Lustre: 126624:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 4017.698586] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 4017.719748] Lustre: Skipped 1 previous similar message [ 4017.922241] Lustre: lustre-MDT0001: new disk, initializing [ 4018.045929] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4018.100268] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 4018.109569] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 4023.019386] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 4032.657632] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 4040.236130] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 4048.316192] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4048.827203] Lustre: lustre-OST0000: new disk, initializing [ 4048.829918] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 4048.834980] Lustre: 128596:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 4048.911529] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4056.032370] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 4058.230210] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 4058.244671] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 4058.380514] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 4067.497480] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount (FULL|IDLE) failover.node=192.0.2.254@tcp0,osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 4073.119688] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 4073.421170] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 4078.828825] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 4079.098261] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 4084.193659] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4084.199740] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4084.219341] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4084.248022] Lustre: Skipped 1 previous similar message [ 4087.489675] Lustre: server umount lustre-OST0000 complete [ 4094.452898] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4094.458080] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4094.474162] Lustre: Skipped 2 previous similar messages [ 4094.506170] Lustre: Skipped 1 previous similar message [ 4098.538409] Lustre: server umount lustre-MDT0000 complete [ 4103.350940] LustreError: 126618:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787751007 with bad export cookie 10198691950412652471 [ 4103.355417] LustreError: MGC192.168.201.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4103.373982] LustreError: 126618:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4103.988228] Lustre: server umount lustre-MDT0001 complete [ 4114.638323] Lustre: DEBUG MARKER: == conf-sanity test 90a: check max_mod_rpcs_in_flight is enforced ========================================================== 09:30:16 (1787751016) [ 4121.968602] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4122.589170] LustreError: 131007:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4122.614455] LustreError: 131007:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [ 4122.679946] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4127.706671] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 4127.726253] LustreError: 131008:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4132.839731] LustreError: 131007:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4136.564849] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4142.712827] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 4151.484431] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 4160.083406] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 4169.114952] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4169.843418] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4169.852083] Lustre: Skipped 1 previous similar message [ 4177.893531] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 4187.849886] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 4198.200925] Lustre: *** cfs_fail_loc=159, val=0*** [ 4214.601418] Lustre: lustre-MDT0000: Client 6153d13d-a7ac-4772-b186-3dbce512b8a9 (at 192.168.201.5@tcp) reconnecting [ 4216.500193] Lustre: *** cfs_fail_loc=159, val=0*** [ 4216.521734] Lustre: Skipped 5 previous similar messages [ 4233.067269] Lustre: lustre-MDT0000: Client 6153d13d-a7ac-4772-b186-3dbce512b8a9 (at 192.168.201.5@tcp) reconnecting [ 4238.830344] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4238.836932] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4238.852921] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4238.862230] Lustre: Skipped 1 previous similar message [ 4238.912928] LustreError: Skipped 1 previous similar message [ 4239.713554] Lustre: server umount lustre-OST0000 complete [ 4249.059627] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4249.078326] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4249.080958] Lustre: Skipped 1 previous similar message [ 4259.295217] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 4260.001510] Lustre: server umount lustre-MDT0000 complete [ 4264.423047] LustreError: 133740:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4264.502774] LustreError: 133740:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 4265.571408] LustreError: 130987:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787751169 with bad export cookie 10198691950412653353 [ 4265.590818] LustreError: MGC192.168.201.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4265.611451] LustreError: 130987:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 4266.598751] Lustre: server umount lustre-MDT0001 complete [ 4281.273810] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing unload_modules_local [ 4285.634372] Key type lgssc unregistered [ 4286.132728] LNet: 134799:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4286.149620] LNetError: 134799:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4286.174735] LNet: Removed LNI 192.168.201.105@tcp [ 4287.715246] Key type .llcrypt unregistered [ 4287.721900] Key type ._llcrypt unregistered [ 4314.716310] Key type ._llcrypt registered [ 4314.717754] Key type .llcrypt registered [ 4314.824856] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing load_modules_local [ 4315.630249] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4315.674736] alg: No test for adler32 (adler32-zlib) [ 4316.842631] Lustre: Lustre: Build Version: 2.17.57_81_g37bf112 [ 4317.122360] LNet: Added LNI 192.168.201.105@tcp [8/256/0/180] [ 4318.807320] Key type lgssc registered [ 4320.018071] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4327.788611] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4327.811393] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4329.368195] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4334.191037] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 4339.688261] LustreError: 136213:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4339.711696] LustreError: 136213:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 4343.490060] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4344.029994] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4349.020365] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 4357.597605] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 4363.792438] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 4370.859773] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4371.273659] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4374.320048] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:42 to 0x280000401:65) [ 4378.190691] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 4387.409539] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 4397.315464] Lustre: *** cfs_fail_loc=159, val=0*** [ 4413.821624] Lustre: lustre-MDT0000: Client 6799a373-3eed-4656-b0b7-36351c93ca9b (at 192.168.201.5@tcp) reconnecting [ 4417.188496] Lustre: *** cfs_fail_loc=159, val=0*** [ 4417.198406] Lustre: Skipped 1 previous similar message [ 4433.783089] Lustre: lustre-MDT0001: Client 6799a373-3eed-4656-b0b7-36351c93ca9b (at 192.168.201.5@tcp) reconnecting [ 4435.582397] Lustre: *** cfs_fail_loc=159, val=0*** [ 4435.593874] Lustre: Skipped 3 previous similar messages [ 4451.224137] Lustre: lustre-MDT0001: Client 6799a373-3eed-4656-b0b7-36351c93ca9b (at 192.168.201.5@tcp) reconnecting [ 4467.932900] Lustre: 139272:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 4470.318297] Lustre: *** cfs_fail_loc=159, val=0*** [ 4470.320800] Lustre: Skipped 3 previous similar messages [ 4487.062021] Lustre: lustre-MDT0000: Client c86e4939-8a7e-41d0-9c1c-6445ec75e255 (at 192.168.201.5@tcp) reconnecting [ 4489.759859] Lustre: *** cfs_fail_loc=159, val=0*** [ 4489.761788] Lustre: Skipped 14 previous similar messages [ 4505.448422] Lustre: lustre-MDT0000: Client c86e4939-8a7e-41d0-9c1c-6445ec75e255 (at 192.168.201.5@tcp) reconnecting [ 4506.937432] Lustre: 139566:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 4516.837759] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4516.844217] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4516.844522] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4516.858363] Lustre: Skipped 1 previous similar message [ 4516.905747] Lustre: Skipped 1 previous similar message [ 4519.452685] Lustre: server umount lustre-OST0000 complete [ 4524.990884] Lustre: server umount lustre-MDT0000 complete [ 4527.081209] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4527.090714] LustreError: 139391:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4527.100896] Lustre: Skipped 1 previous similar message [ 4529.289884] LustreError: 136195:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787751433 with bad export cookie 6789526769119000908 [ 4529.292143] LustreError: MGC192.168.201.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4529.305082] LustreError: 136195:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 4531.926439] Lustre: server umount lustre-MDT0001 complete [ 4543.216685] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing unload_modules_local [ 4546.547461] Key type lgssc unregistered [ 4546.842362] LNet: 140619:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4546.855917] LNetError: 140619:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4546.889956] LNet: Removed LNI 192.168.201.105@tcp [ 4548.077486] Key type .llcrypt unregistered [ 4548.088190] Key type ._llcrypt unregistered [ 4576.855817] Key type ._llcrypt registered [ 4576.861857] Key type .llcrypt registered [ 4577.031310] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing load_modules_local [ 4578.604699] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4578.822175] alg: No test for adler32 (adler32-zlib) [ 4579.967952] Lustre: Lustre: Build Version: 2.17.57_81_g37bf112 [ 4580.303445] LNet: Added LNI 192.168.201.105@tcp [8/256/0/180] [ 4582.079162] Key type lgssc registered [ 4584.011763] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4592.897332] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4592.938315] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4594.479246] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4600.087498] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 4604.900120] LustreError: 142042:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4604.926832] LustreError: 142042:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 4609.481713] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4609.977130] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4616.321945] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 4626.081491] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 4634.353276] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 4642.535263] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4642.895518] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4651.367115] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 4655.221629] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:97) [ 4660.601343] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 4664.474958] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:129) [ 4672.959580] Lustre: 144630:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 4675.329556] Lustre: 144679:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 4677.085770] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 in log params [ 4678.555237] Lustre: Setting parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=8 in log params [ 4684.683389] Lustre: 144836:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre/mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 (mode = 0) failed: rc = -17 [ 4685.801935] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=7 in log params [ 4686.925389] Lustre: 144934:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 4695.520572] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4695.533751] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4695.551931] Lustre: Skipped 1 previous similar message [ 4695.571575] Lustre: Skipped 1 previous similar message [ 4698.847894] Lustre: server umount lustre-OST0000 complete [ 4705.765285] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4705.769306] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4705.804418] Lustre: Skipped 1 previous similar message [ 4710.108831] Lustre: server umount lustre-MDT0000 complete [ 4710.885194] LustreError: 142042:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4710.897552] LustreError: 142042:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 4714.020130] LustreError: 144642:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787751617 with bad export cookie 10159251117563472304 [ 4714.025931] LustreError: MGC192.168.201.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4714.030502] LustreError: 144642:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 4714.563937] Lustre: server umount lustre-MDT0001 complete [ 4727.102525] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing unload_modules_local [ 4730.634233] Key type lgssc unregistered [ 4731.044439] LNet: 145994:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4731.064058] LNetError: 145994:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4731.086933] LNet: Removed LNI 192.168.201.105@tcp [ 4732.124319] Key type .llcrypt unregistered [ 4732.125806] Key type ._llcrypt unregistered [ 4765.911381] Key type ._llcrypt registered [ 4765.918334] Key type .llcrypt registered [ 4766.186403] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing load_modules_local [ 4766.966798] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4767.022083] alg: No test for adler32 (adler32-zlib) [ 4768.171165] Lustre: Lustre: Build Version: 2.17.57_81_g37bf112 [ 4768.439911] LNet: Added LNI 192.168.201.105@tcp [8/256/0/180] [ 4770.201454] Key type lgssc registered [ 4772.383909] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4781.639742] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4781.663041] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4783.342219] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4788.848200] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 4792.801852] LustreError: 147415:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4792.825972] LustreError: 147415:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 4797.935410] LustreError: 147414:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4798.499629] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4799.044916] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4804.558789] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 4813.675312] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 4820.559774] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 4829.169509] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4829.785217] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4837.035745] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 4844.159130] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:129) [ 4845.060653] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 4852.403622] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:161) [ 4862.524926] Lustre: *** cfs_fail_loc=159, val=0*** [ 4878.203843] Lustre: lustre-MDT0000: Client e8d04856-69b9-4a78-b754-477d0693b21a (at 192.168.201.5@tcp) reconnecting [ 4898.793805] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4898.795190] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4898.795705] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4898.815680] Lustre: Skipped 1 previous similar message [ 4902.725923] Lustre: server umount lustre-OST0000 complete [ 4909.032040] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4909.033540] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4909.049922] Lustre: Skipped 1 previous similar message [ 4909.057918] Lustre: Skipped 1 previous similar message [ 4912.987053] Lustre: server umount lustre-MDT0000 complete [ 4914.146330] LustreError: 148147:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4914.163248] LustreError: 148147:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 4917.517868] LustreError: 147395:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787751821 with bad export cookie 12845080183799281297 [ 4917.520549] LustreError: MGC192.168.201.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4917.527100] LustreError: 147395:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 4917.983512] Lustre: server umount lustre-MDT0001 complete [ 4930.835537] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing unload_modules_local [ 4934.263335] Key type lgssc unregistered [ 4934.722596] LNet: 151112:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4934.751497] LNetError: 151112:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4934.783935] LNet: Removed LNI 192.168.201.105@tcp [ 4936.101099] Key type .llcrypt unregistered [ 4936.102341] Key type ._llcrypt unregistered [ 4966.403331] Key type ._llcrypt registered [ 4966.404892] Key type .llcrypt registered [ 4966.503529] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing load_modules_local [ 4967.640986] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4967.973342] alg: No test for adler32 (adler32-zlib) [ 4969.032275] Lustre: Lustre: Build Version: 2.17.57_81_g37bf112 [ 4969.322219] LNet: Added LNI 192.168.201.105@tcp [8/256/0/180] [ 4971.111225] Key type lgssc registered [ 4972.513875] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4980.964484] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4980.985155] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4982.514587] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4987.062177] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 4992.994549] LustreError: 152528:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4993.004805] LustreError: 152528:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 4998.117717] LustreError: 152528:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4998.484797] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4999.236636] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5005.211826] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 5015.129676] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 5021.670178] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 5031.746452] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5032.709278] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5042.487706] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 5043.953966] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:161) [ 5053.185593] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:170 to 0x280000401:193) [ 5053.429631] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 5077.176370] Lustre: lustre-OST0000: evicting f453c2ac-2324-4351-aaea-b56a2e7b9fdd (at 192.168.201.5@tcp) by administrative request [ 5077.185496] Lustre: Skipped 1 previous similar message [ 5109.729319] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5109.744081] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 5109.762217] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5109.790842] Lustre: Skipped 1 previous similar message [ 5113.546215] Lustre: server umount lustre-OST0000 complete [ 5119.974651] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5120.002366] Lustre: Skipped 2 previous similar messages [ 5120.010278] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5125.089746] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5125.102899] Lustre: Skipped 2 previous similar messages [ 5130.214173] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5130.219897] Lustre: Skipped 1 previous similar message [ 5133.279966] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 5133.828164] Lustre: server umount lustre-MDT0000 complete [ 5135.340183] LustreError: 152528:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5135.372823] LustreError: 152528:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 5139.218881] LustreError: 152507:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787752042 with bad export cookie 5325411042225181733 [ 5139.223116] LustreError: MGC192.168.201.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5139.247377] LustreError: 152507:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 5139.649278] Lustre: server umount lustre-MDT0001 complete [ 5153.785407] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing unload_modules_local [ 5156.780320] Key type lgssc unregistered [ 5157.115778] LNet: 156602:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5157.121668] LNetError: 156602:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5158.185989] LNet: Removed LNI 192.168.201.105@tcp [ 5159.275289] Key type .llcrypt unregistered [ 5159.278137] Key type ._llcrypt unregistered [ 5245.994938] Key type ._llcrypt registered [ 5246.003750] Key type .llcrypt registered [ 5246.158484] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing load_modules_local [ 5248.177390] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5248.315193] alg: No test for adler32 (adler32-zlib) [ 5249.625509] Lustre: Lustre: Build Version: 2.17.57_81_g37bf112 [ 5249.995571] LNet: Added LNI 192.168.201.105@tcp [8/256/0/180] [ 5251.711179] Key type lgssc registered [ 5254.174629] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5264.222525] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5264.247600] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5265.887347] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5271.903942] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 5276.140947] LustreError: 159095:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5276.175590] LustreError: 159095:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 5281.259662] LustreError: 159096:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5284.375254] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5284.960751] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5290.820720] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 5300.373620] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 5308.407813] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 5317.350593] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5317.884305] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5325.531341] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 5330.171719] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:193) [ 5333.808363] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 5336.303505] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:195 to 0x280000401:225) [ 5350.881882] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 5350.894428] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5350.916155] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5351.907611] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5351.916978] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5356.010848] Lustre: server umount lustre-OST0000 complete [ 5361.637965] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5361.653974] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5361.677460] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5361.684214] Lustre: Skipped 1 previous similar message [ 5367.265425] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5367.274824] Lustre: Skipped 3 previous similar messages [ 5367.896128] Lustre: server umount lustre-MDT0000 complete [ 5372.388347] LustreError: 159090:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5372.398133] LustreError: 159090:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 5373.381577] LustreError: 159076:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787752277 with bad export cookie 13273213971305270252 [ 5373.393097] LustreError: MGC192.168.201.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5373.401091] LustreError: 159076:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 5373.822657] Lustre: server umount lustre-MDT0001 complete [ 5387.822804] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing unload_modules_local [ 5392.060883] Key type lgssc unregistered [ 5392.570541] LNet: 162667:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5392.582921] LNetError: 162667:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5392.600204] LNet: Removed LNI 192.168.201.105@tcp [ 5393.657121] Key type .llcrypt unregistered [ 5393.659799] Key type ._llcrypt unregistered [ 5426.920652] Key type ._llcrypt registered [ 5426.924911] Key type .llcrypt registered [ 5427.105959] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing load_modules_local [ 5428.578986] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5428.897916] alg: No test for adler32 (adler32-zlib) [ 5429.993089] Lustre: Lustre: Build Version: 2.17.57_81_g37bf112 [ 5430.435990] LNet: Added LNI 192.168.201.105@tcp [8/256/0/180] [ 5432.233889] Key type lgssc registered [ 5433.782273] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5450.651702] Lustre: DEBUG MARKER: == conf-sanity test 100: check lshowmount lists MGS, MDT, OST and 0@lo ========================================================== 09:52:31 (1787752351) [ 5470.401202] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_hostid [ 5480.854930] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing load_modules_local [ 5523.399383] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5523.440550] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5524.759378] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 5524.780420] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 5524.871905] Lustre: lustre-MDT0000: new disk, initializing [ 5524.971676] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5524.993393] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 5530.418393] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 5541.864761] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5542.002315] Lustre: 166936:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 5542.082759] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 5542.085533] Lustre: Skipped 1 previous similar message [ 5542.160559] Lustre: lustre-MDT0001: new disk, initializing [ 5542.311975] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5542.350671] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 5542.361850] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 5547.339878] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 5558.120072] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 5564.726339] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 5573.492799] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5573.916738] Lustre: lustre-OST0000: new disk, initializing [ 5573.920637] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 5573.944439] Lustre: 168907:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 5574.102077] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5580.867379] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 5580.878057] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 5581.081943] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 5582.235774] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 5593.700295] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 5606.882837] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 5606.884584] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5606.906294] LustreError: Skipped 1 previous similar message [ 5606.912934] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5606.977577] Lustre: Skipped 1 previous similar message [ 5610.627684] Lustre: server umount lustre-OST0000 complete [ 5617.121817] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5617.131866] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5617.141272] Lustre: Skipped 1 previous similar message [ 5617.161238] Lustre: Skipped 2 previous similar messages [ 5622.253320] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5622.270901] Lustre: Skipped 1 previous similar message [ 5623.142825] Lustre: server umount lustre-MDT0000 complete [ 5627.316663] LustreError: 166929:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787752531 with bad export cookie 14003030904820770918 [ 5627.318895] LustreError: MGC192.168.201.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5627.332156] LustreError: 166929:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 5627.942663] Lustre: server umount lustre-MDT0001 complete [ 5640.200691] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing unload_modules_local [ 5643.152670] Key type lgssc unregistered [ 5643.504465] LNet: 170815:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5643.527925] LNetError: 170815:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5644.582518] LNet: Removed LNI 192.168.201.105@tcp [ 5645.696790] Key type .llcrypt unregistered [ 5645.699345] Key type ._llcrypt unregistered [ 5671.937810] Key type ._llcrypt registered [ 5671.941653] Key type .llcrypt registered [ 5672.048451] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing load_modules_local [ 5673.622187] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5674.047178] alg: No test for adler32 (adler32-zlib) [ 5675.342132] Lustre: Lustre: Build Version: 2.17.57_81_g37bf112 [ 5675.664875] LNet: Added LNI 192.168.201.105@tcp [8/256/0/180] [ 5677.311179] Key type lgssc registered [ 5678.686299] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5686.915265] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5686.936983] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5688.475753] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5694.633636] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 5699.041826] LustreError: 172230:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5699.064268] LustreError: 172230:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 5704.162378] LustreError: 172231:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5705.849399] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5706.278673] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5711.466721] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 5721.045764] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 5727.353546] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 5735.200452] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5735.777607] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5743.513434] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 5753.850500] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 5758.340906] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:33) [ 5768.900574] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5768.951242] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5768.989657] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5768.996987] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5769.011238] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5770.739793] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5770.814364] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5770.885161] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5770.909726] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5770.952649] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5772.099624] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5772.114475] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5772.124782] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5772.132205] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5772.145182] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5773.552993] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5774.704576] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5774.718280] Lustre: Skipped 1 previous similar message [ 5774.744253] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5774.770587] Lustre: Skipped 1 previous similar message [ 5774.778348] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5774.787868] Lustre: Skipped 1 previous similar message [ 5774.799104] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5774.822857] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5774.841243] Lustre: Skipped 1 previous similar message [ 5776.299435] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5777.574380] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5778.990459] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5778.996927] Lustre: Skipped 2 previous similar messages [ 5779.017308] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5779.028580] Lustre: Skipped 2 previous similar messages [ 5779.039321] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5779.041766] Lustre: Skipped 2 previous similar messages [ 5779.050223] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5779.063864] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5779.078457] Lustre: Skipped 2 previous similar messages [ 5780.621073] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5782.082770] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5783.774266] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5785.059863] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5786.336111] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5787.619061] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5787.644723] Lustre: Skipped 5 previous similar messages [ 5787.680416] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5787.700342] Lustre: Skipped 5 previous similar messages [ 5787.708980] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5787.711280] Lustre: Skipped 5 previous similar messages [ 5787.729086] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5787.777311] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5787.798680] Lustre: Skipped 5 previous similar messages [ 5788.795791] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5789.756346] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5791.454646] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5793.204072] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5794.831509] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5796.322270] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5798.233751] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5799.718405] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5800.484482] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5801.520657] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5802.855411] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5804.035141] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5804.040382] Lustre: Skipped 11 previous similar messages [ 5804.060582] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5804.077807] Lustre: Skipped 11 previous similar messages [ 5804.081653] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5804.090404] Lustre: Skipped 11 previous similar messages [ 5804.095086] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5804.104631] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5804.122553] Lustre: Skipped 11 previous similar messages [ 5805.222073] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5806.607361] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5807.820128] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5808.765423] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5809.783135] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5810.785081] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5811.805866] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5812.817843] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5813.501692] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5814.525727] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5815.692187] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5816.851755] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5817.771914] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5818.906795] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5819.974244] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5821.044576] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5821.903854] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5822.948964] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5823.793248] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5824.716901] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5825.702629] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5826.897887] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5828.064148] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5828.986948] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5830.046514] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5830.917716] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5831.898153] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5832.796153] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5834.347710] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5836.071301] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5836.078845] Lustre: Skipped 29 previous similar messages [ 5836.113990] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5836.124732] Lustre: Skipped 29 previous similar messages [ 5836.129124] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5836.131276] Lustre: Skipped 29 previous similar messages [ 5836.137768] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5836.151419] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5836.159856] Lustre: Skipped 29 previous similar messages [ 5837.644135] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5839.687764] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5841.519197] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5842.686823] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5843.775261] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5844.899262] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5845.833396] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5846.952309] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5847.823191] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5848.962472] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5849.766322] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5850.852128] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5852.134899] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5853.356981] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5854.708499] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5855.982692] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5857.046649] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5858.530619] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5859.800950] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5860.745913] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5861.813828] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5862.748978] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5863.665561] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5864.693128] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5865.922079] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5866.878273] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5868.203209] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5868.972962] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5870.108222] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5870.843540] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5871.654419] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5872.582656] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5873.704085] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5874.532210] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5875.950370] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5877.074412] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5878.081884] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5879.237803] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5880.491145] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5881.580306] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5882.638617] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5883.762058] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5885.247806] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5886.718415] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5887.869848] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5888.986161] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5889.947482] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5890.987511] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5892.028227] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5893.119082] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5894.134798] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5895.174480] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5895.941297] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5896.839170] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5897.978440] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5898.865518] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5899.939436] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5900.854240] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5900.858598] Lustre: Skipped 57 previous similar messages [ 5900.870691] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5900.878198] Lustre: Skipped 57 previous similar messages [ 5900.882108] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5900.885926] Lustre: Skipped 57 previous similar messages [ 5900.889156] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5900.897789] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5900.903795] Lustre: Skipped 57 previous similar messages [ 5901.866179] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5902.934125] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5904.051623] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5905.140912] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5906.169347] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5907.261284] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5908.243981] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5909.005803] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5910.033777] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5911.054629] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5912.082497] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5913.316548] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5914.815680] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5916.064309] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5917.410767] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5918.906381] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5919.968992] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5921.329804] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5922.554627] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5923.695820] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5924.794666] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5925.961666] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5927.040291] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5928.202690] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5929.161226] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5930.125205] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5931.002350] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5932.205174] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5933.301114] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5934.281396] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5935.534214] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5936.417580] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5937.493565] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5938.464186] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5939.674646] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5940.749129] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5941.835597] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5942.791929] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5943.901227] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5944.901879] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5945.930527] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5946.777093] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5947.936443] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5948.973086] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5950.175310] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5951.287362] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5952.326750] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5953.394798] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5954.292670] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5955.371185] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5956.555814] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5957.476206] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5958.676907] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5959.900113] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5961.201700] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5962.146772] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5963.604901] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5964.620991] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5965.725877] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5966.731285] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5967.810788] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5968.804991] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5969.946705] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5970.884697] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5971.771906] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5973.057206] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5974.205922] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5975.147958] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5976.103060] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5977.107417] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5978.227516] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5979.358189] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5980.312668] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5981.179629] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5981.970234] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5982.800574] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5983.872218] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5984.798162] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5985.968882] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5987.204645] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5988.320078] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5989.712337] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5990.876413] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5992.100060] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5993.471993] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5994.423078] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5995.381023] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5996.285535] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5997.285640] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5998.123571] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5999.092995] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6000.094130] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6001.094915] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6001.970755] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6003.205629] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6004.288194] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6005.641058] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6006.782386] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6007.944523] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6009.090608] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6010.066130] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6011.039490] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6012.043038] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6012.933751] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6013.708708] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6014.600569] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6015.577528] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6016.566150] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6017.464911] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6018.404640] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6019.490700] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6020.526577] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6021.584746] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6022.470037] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6023.495570] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6024.370525] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6025.559896] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6026.676354] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6027.687584] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6028.598457] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6029.627633] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 6029.631945] Lustre: Skipped 120 previous similar messages [ 6029.645347] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6029.652506] Lustre: Skipped 120 previous similar messages [ 6029.658499] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 6029.673487] Lustre: Skipped 120 previous similar messages [ 6029.675919] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6029.705959] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 6029.714681] Lustre: Skipped 120 previous similar messages [ 6030.721256] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6032.106139] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6033.088487] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6034.295302] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6035.297933] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6036.622942] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6037.866798] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6039.226054] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6040.444644] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6041.532844] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6042.886584] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6043.845082] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6044.810861] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6045.912477] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6047.029841] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6048.073050] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6049.086722] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6050.314040] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6051.716977] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6053.160072] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6054.250503] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6055.602589] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6057.119611] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6058.128277] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6059.078555] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6060.195827] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6061.130916] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6062.189849] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6063.120182] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6064.285667] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6065.317995] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6066.575129] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6067.459030] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6068.451717] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6069.633795] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6070.705867] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6071.569501] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6072.606184] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6073.709805] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6074.708576] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6075.770606] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6076.774838] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6077.705114] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6078.705713] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6080.056098] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6081.352736] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6082.354797] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6083.753212] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6085.098462] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6086.441433] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6087.598219] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6088.775225] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6090.059567] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6091.373824] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6092.840130] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6094.497264] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6095.858385] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6096.962452] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6098.120177] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6099.154380] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6100.351600] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6101.670338] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6102.962570] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6104.055945] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6105.163093] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6106.110658] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6107.097106] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6108.374765] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6109.514180] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6110.740815] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6111.759705] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6112.875186] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6113.815133] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6114.834379] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6115.811334] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6117.029506] LustreError: 172250:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 6117.054722] LustreError: 172250:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 6117.075774] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6118.339869] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6119.470197] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6120.717056] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6121.658159] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6122.587567] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6123.757984] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6124.888035] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6125.841487] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6127.024972] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6128.377762] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6129.100186] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6130.164909] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6131.477139] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6132.670122] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6133.603198] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6134.798157] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6136.131712] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6137.733449] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6139.068682] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6140.447945] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6141.568173] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6143.104965] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6144.502223] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6145.908261] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6146.891584] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6148.528491] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6149.874423] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6151.019293] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6152.211841] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6153.354839] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6154.565956] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6155.945328] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6157.251837] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6158.615762] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6159.705822] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6160.855943] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6162.003357] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6163.068632] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6163.952881] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6164.934319] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6165.854580] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6166.749050] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6167.588496] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6168.447735] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6169.265118] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6170.294438] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6171.164744] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6172.173483] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6173.174970] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6174.137368] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6175.032659] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6176.115993] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6177.030806] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6177.952236] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6178.852693] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6179.904597] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6181.114965] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6182.054820] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6183.219646] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6184.320898] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6185.279410] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6186.167625] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6186.970600] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6188.097259] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6188.953259] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6190.029629] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6191.299151] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6192.362559] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6193.701316] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6195.094523] LustreError: 172250:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 6195.102935] LustreError: 172250:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 6195.122440] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6196.158833] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6197.407194] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6198.691404] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6199.896298] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6201.013195] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6202.303385] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6203.611359] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6204.940378] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6206.203579] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6207.308549] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6208.529308] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6209.696200] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6210.652182] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6211.960628] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6213.015409] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6214.005120] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6215.335272] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6216.703189] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6218.255564] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6219.698557] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6221.002466] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6222.307356] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6223.510093] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6224.725115] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6225.950586] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6226.843436] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6227.906400] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6228.664118] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6229.949287] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6231.282740] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6232.299889] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6233.528349] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6234.498709] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6236.102509] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6236.991232] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6238.368855] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6239.504985] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6240.491754] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6241.527479] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6242.388613] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6243.392668] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6244.669760] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6245.837432] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6247.228505] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6248.342580] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6249.819434] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6251.057594] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6251.788661] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6253.014409] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6254.310781] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6255.535567] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6256.771278] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6258.098124] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6259.543414] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6260.947625] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6262.672984] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6264.110780] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6265.346068] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6266.175250] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6267.056680] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6267.667390] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6268.395341] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6269.224461] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6270.475472] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6271.694070] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6272.715730] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6273.775272] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6274.696312] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6275.814482] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6277.517207] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6278.469766] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6279.876491] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6281.096672] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6282.246957] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6283.428586] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6284.783236] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6285.626895] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 6285.631117] Lustre: Skipped 222 previous similar messages [ 6285.642573] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6286.750967] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6286.756929] Lustre: Skipped 223 previous similar messages [ 6286.758966] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 6286.761843] Lustre: Skipped 223 previous similar messages [ 6286.763859] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6286.770650] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 6286.773890] Lustre: Skipped 223 previous similar messages [ 6287.986961] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6289.044867] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6290.188974] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6291.030774] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6292.404602] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6293.408043] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6294.572568] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6295.775502] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6296.779321] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6297.785302] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6298.872582] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6300.121144] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6301.338834] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6302.619498] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6304.116771] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6305.481906] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6306.458020] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6307.828536] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6309.046120] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6310.356223] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6311.582418] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6312.951875] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6314.198618] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6315.660539] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6317.084450] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6318.552066] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6319.999101] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6321.332133] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6322.856801] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6324.120841] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6325.682413] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6327.715712] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6329.706190] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6331.099822] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6333.230090] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6334.908562] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6336.992472] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6338.681324] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6340.056993] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6341.300399] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6343.441328] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6344.947565] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6345.793550] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6346.778663] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6347.848283] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6349.123699] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6350.041867] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6351.039334] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6351.949890] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6353.222916] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6354.090576] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6355.453443] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6356.631710] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6357.971483] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6359.335805] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6360.536400] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6361.728651] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6362.929907] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6364.177347] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6364.965693] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6365.954898] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6366.945707] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6368.118065] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6368.982104] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6370.072396] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6371.134432] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6372.313125] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6373.934208] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6375.275587] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6376.341444] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6377.899800] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6379.252768] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6380.594798] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6382.326757] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6383.759586] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6385.446714] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6386.901798] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6388.674429] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6390.446593] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6392.303055] LustreError: 172250:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 6392.324940] LustreError: 172250:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 6392.340106] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6393.768861] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6395.374786] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6396.653065] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6398.492621] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6400.224129] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6401.613540] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6402.810160] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6403.764854] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6405.081162] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6406.554438] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6407.630752] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6408.868581] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6410.087727] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6411.250911] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6412.547934] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6413.745311] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6414.855679] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6415.948390] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6416.891873] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6417.736955] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6418.947479] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6419.815956] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6420.872273] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6421.846952] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6423.076299] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6423.954589] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6425.213168] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6426.116673] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6427.147941] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6428.148279] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6429.282613] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6430.282959] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6431.337484] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6432.587897] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6433.959067] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6435.364454] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6436.478361] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6437.651680] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6438.744236] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6440.098202] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6441.345407] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6442.646686] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6443.571599] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6444.755770] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6445.566951] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6446.619298] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6447.546632] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6448.645387] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6449.827623] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6450.977591] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6452.020520] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6453.488455] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6454.628977] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6455.733445] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6456.931496] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6457.911270] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6459.111761] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6460.106766] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6461.047574] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6462.260041] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6463.347160] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6464.393545] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6465.641819] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6466.780324] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6467.848393] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6468.844983] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6469.792555] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6470.684846] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6471.727313] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6472.945137] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6474.174583] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6475.424828] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6476.767575] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6478.074125] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6478.975223] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6480.223595] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6481.296209] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6482.299574] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6483.538623] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6484.550548] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6485.607232] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6486.729282] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6487.891918] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6488.818665] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6489.811215] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6490.821819] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6491.696546] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6492.719845] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6493.521328] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6494.558879] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6495.572079] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6496.694142] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6498.183444] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6499.191743] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6500.297484] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6501.558633] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6503.017524] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6503.865287] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6504.955824] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6505.863469] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6506.870649] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6507.781505] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6508.825478] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6509.857062] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6510.915289] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6511.923478] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6513.039057] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6514.043966] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6515.264414] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6516.078707] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6516.973711] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6518.175893] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6519.433175] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6520.974970] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6522.131708] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6523.223985] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6524.526146] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6525.816045] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6527.078814] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6528.357782] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6529.451811] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6530.745204] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6532.176921] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6533.562289] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6534.661756] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6535.524408] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6536.549466] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6537.548168] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6538.652551] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6539.581195] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6540.677500] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6541.757620] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6542.776376] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6543.918411] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6544.942767] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6546.134635] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6547.223207] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6548.141042] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6549.238483] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6550.272981] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6551.416881] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6552.722131] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6553.829533] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6555.086722] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6556.576247] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6557.607695] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6558.572414] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6559.760569] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6560.941448] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6561.875969] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6562.814234] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6563.895310] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6565.236495] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6566.357603] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6567.344333] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6568.370508] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6569.518613] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6570.648632] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6571.860089] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6572.810226] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6573.793952] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6574.868124] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6576.080316] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6577.164143] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6578.349621] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6579.387078] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6580.320837] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6581.189291] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6582.362526] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6583.379733] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6584.347430] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6585.445692] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6586.680581] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6587.681457] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6588.735805] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6589.843790] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6590.992278] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6591.985116] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6593.082745] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6594.036448] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6595.299068] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6596.909970] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6598.204900] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6599.641421] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6600.837918] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6601.955719] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6603.131464] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6604.440135] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6605.700563] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6606.917383] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6608.074710] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6609.575488] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6611.213578] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6612.376725] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6613.764579] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6614.931626] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6616.266450] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6617.465066] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6618.925521] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6620.653382] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6622.402624] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6623.657184] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6625.258738] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6626.734311] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6627.973873] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6629.266099] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6630.294833] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6631.066410] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6633.024901] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6634.995675] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6637.443971] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6639.297882] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6641.467796] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6643.265566] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6644.606249] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6646.192222] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6647.697342] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6649.018071] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6650.384416] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6651.619134] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6653.190726] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6654.633249] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6656.120307] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6657.223258] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6658.602337] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6659.970447] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6660.944911] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6662.060671] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6663.191798] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6664.164799] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6665.200865] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6666.637212] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6667.679072] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6669.034356] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6670.339136] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6671.130868] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6672.528487] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6673.535697] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6674.587365] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6675.701030] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6677.189984] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6678.605925] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6680.215995] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6681.485630] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6682.814262] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6684.228416] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6685.445772] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6686.727042] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6688.044456] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6689.214843] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6690.475216] LustreError: 172250:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 6690.489572] LustreError: 172250:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 6690.505111] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6691.667330] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6692.891577] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6694.222126] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6695.650674] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6696.819642] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6697.831554] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6698.919287] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6699.987466] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6701.324391] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6702.296701] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6703.655667] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6705.097554] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6706.340084] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6708.015560] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6709.397585] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6710.689442] LustreError: 172250:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 6710.707615] LustreError: 172250:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 6710.725072] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6712.318820] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6714.053101] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6715.531155] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6716.948370] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6718.360518] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6719.680849] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6720.937915] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6722.247600] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6723.952611] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6725.641069] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6727.319630] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6728.898141] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6730.659147] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6732.011045] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6733.792127] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6735.369975] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6737.159823] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6738.956724] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6740.367679] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6742.056984] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6743.967728] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6745.055700] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6746.858134] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6748.099475] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6749.477626] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6750.902159] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6752.196814] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6753.641092] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6754.878178] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6756.414981] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6757.658571] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6759.045442] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6760.118878] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6761.589292] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6763.246901] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6764.393428] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6766.188527] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6767.513106] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6769.098481] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6770.557979] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6771.812881] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6773.556452] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6775.393824] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6777.006614] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6778.530693] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6780.131639] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6781.790772] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6783.657648] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6785.398800] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6787.210153] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6788.936562] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6790.368684] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6791.989828] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6793.547755] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6795.091832] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6796.992260] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6798.629689] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 6798.634468] Lustre: Skipped 404 previous similar messages [ 6798.695266] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6800.440513] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6800.457421] Lustre: Skipped 404 previous similar messages [ 6800.468352] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 6800.483584] Lustre: Skipped 404 previous similar messages [ 6800.502456] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6800.532267] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 6800.543576] Lustre: Skipped 404 previous similar messages [ 6802.405081] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6803.625859] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6804.731856] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6806.445641] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6807.860038] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6809.667940] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6811.330782] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6813.014542] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6814.560802] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6816.848625] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6818.785120] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6821.002728] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6823.490307] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6825.681161] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6827.017488] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6828.334167] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6830.074460] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6831.734330] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6832.822766] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6834.176946] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6835.400259] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6836.555648] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6837.783850] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6839.525842] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6840.813394] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6842.500892] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6844.002897] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6845.302108] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6846.588910] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6847.957597] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6849.170478] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6850.986806] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6852.754673] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6854.731178] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6856.326687] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6857.929650] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6859.562584] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6861.354974] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6863.124401] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6865.021120] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6866.333602] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6867.274468] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6869.057162] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6870.929491] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6873.140243] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6874.979055] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6876.687088] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6878.118695] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6879.625558] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6881.188648] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6882.717486] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6884.555511] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6886.158191] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6887.229637] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6888.886428] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6890.579160] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6892.489168] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6893.791324] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6895.204938] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6896.426291] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6897.856431] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6899.183777] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6901.050568] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6902.586877] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6903.771248] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6905.496954] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6907.060497] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6908.296355] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6910.057673] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6911.678514] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6913.146563] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6914.676037] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6916.193277] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6917.551339] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6919.280868] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6920.719711] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6922.885890] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6924.416544] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6926.255984] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6927.985500] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6929.454472] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6931.139239] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6933.190372] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6935.443789] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6937.845835] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6940.066751] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6941.506118] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6944.031131] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6945.697167] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6947.607497] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6949.464638] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6951.450202] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6953.031498] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6955.140478] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6956.793703] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6958.354161] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6960.596137] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6962.305364] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6963.949222] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6965.899387] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6967.811129] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6969.858700] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6972.126406] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6973.615321] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6975.238942] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6976.656388] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6978.190787] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6979.124413] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6980.215902] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6981.370855] LustreError: 172250:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 6981.379739] LustreError: 172250:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 6981.385362] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6982.253137] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6983.679400] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6985.347700] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6986.797433] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6988.170750] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6990.096510] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6991.924921] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6993.313957] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6994.781495] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6996.188792] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6997.758350] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6998.941727] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7000.190611] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7001.421823] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7002.785720] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7004.284305] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7005.174230] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7006.506895] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7007.860679] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7009.138652] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7010.542539] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7011.773897] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7012.984865] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7014.140651] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7015.577737] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7017.118549] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7397.539120] LustreError: 174723:0:(ofd_dev.c:1780:ofd_create_hdl()) lustre-OST0000: unable to precreate: rc = -28 [ 7397.547593] LustreError: 172250:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -28 [ 7819.755200] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 7819.772344] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7819.787356] Lustre: Skipped 136 previous similar messages [ 7819.798188] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7820.785360] LustreError: lustre-OST0000-osc-MDT0000: operation ost_destroy to node 0@lo failed: rc = -107 [ 7820.786877] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7820.800884] LustreError: Skipped 6 previous similar messages [ 7821.819832] Lustre: server umount lustre-OST0000 complete [ 7826.598440] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7826.613903] Lustre: Skipped 1 previous similar message [ 7832.035922] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7832.057236] Lustre: Skipped 1 previous similar message [ 7833.256089] Lustre: server umount lustre-MDT0000 complete [ 7837.153434] LustreError: 172958:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7837.196786] LustreError: 172958:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 7837.624222] LustreError: 172212:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787754741 with bad export cookie 9868662727371345219 [ 7837.657403] LustreError: 172212:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 7837.659225] LustreError: MGC192.168.201.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7838.545421] Lustre: server umount lustre-MDT0001 complete [ 7855.982462] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing unload_modules_local [ 7859.409688] Key type lgssc unregistered [ 7859.705819] LNet: 227535:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7859.719139] LNetError: 227535:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7859.734279] LNet: Removed LNI 192.168.201.105@tcp [ 7860.881531] Key type .llcrypt unregistered [ 7860.883489] Key type ._llcrypt unregistered [ 7892.150696] Key type ._llcrypt registered [ 7892.153585] Key type .llcrypt registered [ 7892.272232] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing load_modules_local [ 7893.767696] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7893.902350] alg: No test for adler32 (adler32-zlib) [ 7895.076481] Lustre: Lustre: Build Version: 2.17.57_81_g37bf112 [ 7895.443568] LNet: Added LNI 192.168.201.105@tcp [8/256/0/180] [ 7897.111970] Key type lgssc registered [ 7898.553360] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7906.786508] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7906.818521] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7908.555534] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7913.843355] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 7919.072799] LustreError: 228951:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7919.091268] LustreError: 228951:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 7923.112847] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7923.457601] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7928.908521] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 7938.096089] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 7946.394869] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 7954.062407] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7954.541197] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7962.109609] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 7970.992099] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 7979.149520] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49665 to 0x280000401:49696) [ 7986.213741] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 7988.422920] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7988.441075] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 7988.450411] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7988.483425] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 7988.487787] LustreError: 228971:0:(osp_precreate.c:1268:osp_precreate_thread()) cfs_fail_timeout id 2107 sleeping for 20000ms [ 7992.166782] Lustre: lustre-OST0000: Not available for connect from 192.168.201.5@tcp (stopping) [ 7994.856621] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7994.860407] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7994.870608] Lustre: Skipped 1 previous similar message [ 7994.882445] Lustre: Skipped 1 previous similar message [ 7997.218251] Lustre: lustre-OST0000: Not available for connect from 192.168.201.5@tcp (stopping) [ 7997.751145] Lustre: server umount lustre-OST0000 complete [ 8008.559543] LustreError: 228971:0:(osp_precreate.c:1268:osp_precreate_thread()) cfs_fail_timeout id 2107 awake [ 8033.805383] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8034.298706] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8035.298076] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 8035.321171] LustreError: lustre-OST0000-osc-MDT0001: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 8035.331752] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 8042.629491] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 8051.649733] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 8053.406570] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec [ 8059.983937] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff889d850b2000.ost_server_uuid 50 [ 8061.835251] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff889d850b2000.ost_server_uuid in FULL state after 0 sec [ 8071.136724] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 8071.145172] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8071.147656] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8071.155097] Lustre: Skipped 1 previous similar message [ 8074.031276] Lustre: server umount lustre-OST0000 complete [ 8081.401507] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8081.403551] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8081.444223] Lustre: Skipped 1 previous similar message [ 8081.447843] Lustre: Skipped 1 previous similar message [ 8087.447053] Lustre: server umount lustre-MDT0000 complete [ 8090.604197] LustreError: 230104:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8090.629263] LustreError: 230104:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 8091.688195] LustreError: 228933:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787754995 with bad export cookie 4934890812209397210 [ 8091.700574] LustreError: MGC192.168.201.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8091.703699] LustreError: 228933:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 8092.145772] Lustre: server umount lustre-MDT0001 complete [ 8104.671708] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing unload_modules_local [ 8108.705504] Key type lgssc unregistered [ 8108.955657] LNet: 234191:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8108.984728] LNetError: 234191:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8109.012332] LNet: Removed LNI 192.168.201.105@tcp [ 8110.064795] Key type .llcrypt unregistered [ 8110.069819] Key type ._llcrypt unregistered [ 8151.337714] Key type ._llcrypt registered [ 8151.344851] Key type .llcrypt registered [ 8151.562545] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing load_modules_local [ 8152.783520] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8152.930614] alg: No test for adler32 (adler32-zlib) [ 8154.289554] Lustre: Lustre: Build Version: 2.17.57_81_g37bf112 [ 8154.810230] LNet: Added LNI 192.168.201.105@tcp [8/256/0/180] [ 8156.647168] Key type lgssc registered [ 8158.383940] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8169.621572] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 8169.647880] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8171.265928] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8176.639828] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 8180.708736] LustreError: 235924:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8180.737015] LustreError: 235924:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 8185.837356] LustreError: 235925:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8186.673658] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8187.286984] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8192.109553] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 8196.445610] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 8206.275847] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8207.075680] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8215.235996] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 8216.296489] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49728) [ 8226.514180] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8226.944832] Lustre: lustre-OST0001: new disk, initializing [ 8226.953425] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 8226.963035] Lustre: 238239:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8227.139395] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 8235.180408] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 8235.660739] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 8235.683645] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 8235.839515] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 8248.774600] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 8257.808338] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 8276.961654] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8276.987622] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8276.990813] Lustre: Skipped 1 previous similar message [ 8277.009110] Lustre: Skipped 3 previous similar messages [ 8282.091773] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8282.099649] Lustre: Skipped 1 previous similar message [ 8282.949873] Lustre: server umount lustre-MDT0000 complete [ 8287.208034] LustreError: 235924:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8287.233162] LustreError: 235924:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [ 8287.507082] LustreError: 235904:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787755191 with bad export cookie 2824806351800843449 [ 8287.546264] LustreError: MGC192.168.201.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8287.890887] Lustre: server umount lustre-MDT0001 complete [ 8303.096675] Lustre: server umount lustre-OST0000 complete [ 8308.693869] Lustre: 235186:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787755196/real 1787755196] req@ffff969541f02d80 x1874597047806848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787755212 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 8308.787694] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8308.819463] Lustre: Skipped 2 previous similar messages [ 8309.400667] Lustre: server umount lustre-OST0001 complete [ 8340.559655] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing load_modules_local [ 8353.049459] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8353.590783] LustreError: 241346:0:(ldlm_lib.c:1190:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8353.719748] Lustre: mylustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8358.892817] LustreError: 241347:0:(ldlm_lib.c:1190:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8359.507231] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 8369.127411] LustreError: 241346:0:(ldlm_lib.c:1190:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8369.170325] LustreError: 241346:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 8369.678535] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8370.012821] Lustre: mylustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8375.008376] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 8378.198576] Lustre: 242489:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 8385.645965] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8386.020738] Lustre: mylustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8393.584954] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 8395.244750] LustreError: 242843:0:(ldlm_lib.c:1190:target_handle_connect()) mylustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8395.286291] Lustre: mylustre-OST0000: new connection from mylustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:99 to 0x280000400:129) [ 8398.342647] Lustre: mylustre-OST0000: new connection from mylustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49760) [ 8403.925845] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8409.604796] Lustre: mylustre-OST0001: new connection from mylustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:3 to 0x2c0000400:33) [ 8411.642667] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 8419.753318] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 8423.638756] Lustre: 244359:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 8436.706688] LustreError: mylustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8436.713079] Lustre: mylustre-MDT0000-osp-MDT0001: Connection to mylustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8436.759066] Lustre: mylustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8436.762064] Lustre: Skipped 1 previous similar message [ 8440.294421] Lustre: mylustre-MDT0000-lwp-MDT0001: Connection to mylustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8440.297038] Lustre: mylustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8440.310163] Lustre: Skipped 2 previous similar messages [ 8440.330810] Lustre: Skipped 3 previous similar messages [ 8442.113122] Lustre: server umount mylustre-MDT0000 complete [ 8445.410732] LustreError: 241347:0:(ldlm_lib.c:1190:target_handle_connect()) mylustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8445.444303] LustreError: 241347:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 7 previous similar messages [ 8447.166565] LustreError: 244561:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787755350 with bad export cookie 2824806351800846312 [ 8447.183684] LustreError: MGC192.168.201.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8447.186794] LustreError: 244561:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 8 previous similar messages [ 8448.039685] Lustre: server umount mylustre-MDT0001 complete [ 8464.143521] Lustre: server umount mylustre-OST0000 complete [ 8466.847411] Lustre: 235188:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787755354/real 1787755354] req@ffff96955cd33b80 x1874597047872896/t0(0) o400->mylustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787755370 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 8466.899691] Lustre: mylustre-MDT0001-lwp-OST0001: Connection to mylustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8468.756647] Lustre: 235186:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787755356/real 1787755356] req@ffff9695497af480 x1874597047873152/t0(0) o400->mylustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787755372 ref 1 fl Rpc:EXNQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 8468.992085] Lustre: server umount mylustre-OST0001 complete [ 8496.988934] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing load_modules_local [ 8511.864954] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8512.396789] LustreError: 246673:0:(ldlm_lib.c:1190:target_handle_connect()) tfs-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8512.558227] Lustre: tfs-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8512.566856] Lustre: Skipped 1 previous similar message [ 8519.729812] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 8531.536612] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8538.313805] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 8541.830921] Lustre: 247815:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 8550.090307] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8556.614707] Lustre: tfs-OST0000: new connection from tfs-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:131 to 0x280000400:161) [ 8557.642708] Lustre: tfs-OST0000: new connection from tfs-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49792) [ 8558.120219] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 8567.561531] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8572.925200] Lustre: tfs-OST0001: new connection from tfs-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:3 to 0x2c0000400:65) [ 8575.093724] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 8583.353955] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 8587.714989] Lustre: 249685:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 8598.496533] LustreError: tfs-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8598.506381] Lustre: tfs-MDT0000-osp-MDT0001: Connection to tfs-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8598.522634] Lustre: tfs-MDT0000: Not available for connect from 0@lo (stopping) [ 8602.816955] Lustre: server umount tfs-MDT0000 complete [ 8607.869977] LustreError: 246650:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787755511 with bad export cookie 2824806351800848489 [ 8607.885264] LustreError: MGC192.168.201.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8607.895183] LustreError: 246650:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 8608.532521] Lustre: server umount tfs-MDT0001 complete [ 8624.328330] Lustre: server umount tfs-OST0000 complete [ 8625.131182] Lustre: 235186:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787755512/real 1787755512] req@ffff969557aa5c00 x1874597047926272/t0(0) o400->tfs-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787755528 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 8625.148393] Lustre: tfs-MDT0001-lwp-OST0001: Connection to tfs-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8625.153961] Lustre: Skipped 3 previous similar messages [ 8630.241615] Lustre: 235187:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787755517/real 1787755517] req@ffff96954ae19180 x1874597047926784/t0(0) o400->tfs-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787755533 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 8630.280487] Lustre: 235187:0:(client.c:2503:ptlrpc_expire_one_request()) Skipped 1 previous similar message [ 8630.773680] Lustre: server umount tfs-OST0001 complete [ 8659.419765] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing load_modules_local [ 8671.004851] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8671.658791] LustreError: 251938:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8671.685649] LustreError: 251938:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 12 previous similar messages [ 8671.793416] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8671.795912] Lustre: Skipped 3 previous similar messages [ 8677.858194] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 8691.312808] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8697.649661] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 8701.969226] Lustre: 253079:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 8710.224099] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8716.941604] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:131 to 0x280000400:193) [ 8716.946381] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49824) [ 8718.580157] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 8729.313544] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8734.745133] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:3 to 0x2c0000400:97) [ 8738.165075] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 8749.119669] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 8755.196236] Lustre: 254952:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 8766.602850] Lustre: DEBUG MARKER: == conf-sanity test 104a: Make sure user defined options are reflected in mount ========================================================== 10:47:47 (1787755667) [ 8784.353263] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8784.363582] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8784.392960] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8784.394890] Lustre: Skipped 3 previous similar messages [ 8790.053097] Lustre: server umount lustre-MDT0000 complete [ 8795.134572] LustreError: 251915:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787755698 with bad export cookie 2824806351800850407 [ 8795.146427] LustreError: MGC192.168.201.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8801.626663] Lustre: server umount lustre-MDT0001 complete [ 8806.323404] Lustre: server umount lustre-OST0000 complete [ 8810.848525] Lustre: server umount lustre-OST0001 complete [ 8818.863544] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_hostid [ 8829.337944] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing load_modules_local [ 8874.163838] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8874.583597] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 8874.628951] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 8874.720725] Lustre: lustre-MDT0000: new disk, initializing [ 8874.789859] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 188-180 [ 8874.794918] Lustre: Skipped 3 previous similar messages [ 8874.806424] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 8880.331836] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 8892.607787] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8892.754813] Lustre: 258142:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8892.834311] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 8892.838470] Lustre: Skipped 1 previous similar message [ 8892.931550] Lustre: lustre-MDT0001: new disk, initializing [ 8893.140975] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 8893.172552] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 8898.349131] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 8910.389375] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8910.842609] Lustre: lustre-OST0000: new disk, initializing [ 8910.845937] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 8910.852517] Lustre: 259723:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8912.295265] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 8912.322590] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 8912.445031] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 8920.092314] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 8933.456448] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8933.812647] Lustre: lustre-OST0001: new disk, initializing [ 8933.816876] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 8933.830076] Lustre: 260596:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8935.253225] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 8935.271180] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 8935.427686] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 8943.313162] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 8958.207489] Lustre: DEBUG MARKER: == conf-sanity test 104b: Mount uses last flock argument ========================================================== 10:50:59 (1787755859) [ 8983.099292] Lustre: DEBUG MARKER: == conf-sanity test 105: check file creation for ro and rw bind mnt pt ========================================================== 10:51:23 (1787755883) [ 9001.977186] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9001.989764] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9001.996836] Lustre: Skipped 6 previous similar messages [ 9002.016264] Lustre: Skipped 9 previous similar messages [ 9005.592914] Lustre: server umount lustre-OST0000 complete [ 9007.113623] LustreError: 259708:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9007.163599] LustreError: 259708:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 18 previous similar messages [ 9010.659592] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 9016.583615] Lustre: server umount lustre-MDT0000 complete [ 9021.364764] LustreError: 258133:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787755925 with bad export cookie 2824806351800852185 [ 9021.368038] LustreError: MGC192.168.201.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9021.371891] LustreError: 258133:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 5 previous similar messages [ 9028.114720] Lustre: server umount lustre-MDT0001 complete [ 9043.272316] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing unload_modules_local [ 9115.938525] Lustre: server umount lustre-OST0001 complete [ 9122.360772] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_hostid [ 9131.385722] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing load_modules_local [ 9156.967753] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9157.215914] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 9157.236206] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 9157.296654] Lustre: lustre-MDT0000: new disk, initializing [ 9157.339446] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9157.345660] Lustre: Skipped 3 previous similar messages [ 9157.368613] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 9160.932400] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 9169.257477] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9169.378987] Lustre: 265454:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 9169.422905] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 9169.426611] Lustre: Skipped 1 previous similar message [ 9169.489306] Lustre: lustre-MDT0001: new disk, initializing [ 9169.610806] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 9169.625760] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 9172.876866] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 9178.626661] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 9182.245898] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 9187.208764] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9187.456194] Lustre: lustre-OST0000: new disk, initializing [ 9187.458423] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 9187.461577] Lustre: 267422:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 9188.953308] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 9188.959293] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 9189.047690] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 9191.758088] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 9197.932140] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 9204.705620] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 9204.708200] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9204.711534] LustreError: Skipped 1 previous similar message [ 9204.718171] Lustre: Skipped 4 previous similar messages [ 9204.722919] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9204.726658] Lustre: Skipped 7 previous similar messages [ 9207.979376] Lustre: server umount lustre-OST0000 complete [ 9224.159114] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 9224.219956] Lustre: server umount lustre-MDT0000 complete [ 9225.470152] LustreError: 265448:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787756129 with bad export cookie 2824806351800853655 [ 9225.472311] LustreError: MGC192.168.201.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9225.474195] LustreError: 265448:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 9225.595627] Lustre: server umount lustre-MDT0001 complete [ 9229.073296] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing unload_modules_local [ 9230.049685] Key type lgssc unregistered [ 9230.172410] LNet: 269183:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 9230.175133] LNetError: 269183:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 9230.184332] LNet: Removed LNI 192.168.201.105@tcp [ 9230.485099] Key type .llcrypt unregistered [ 9230.486397] Key type ._llcrypt unregistered [ 9240.195393] Key type ._llcrypt registered [ 9240.196877] Key type .llcrypt registered [ 9240.232814] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing load_modules_local [ 9240.555442] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 9240.595251] alg: No test for adler32 (adler32-zlib) [ 9241.455862] Lustre: Lustre: Build Version: 2.17.57_81_g37bf112 [ 9241.541966] LNet: Added LNI 192.168.201.105@tcp [8/256/0/180] [ 9243.119211] Key type lgssc registered [ 9243.511965] Lustre: Echo OBD driver; http://www.lustre.org/ [ 9245.898242] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 9245.903722] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9247.036177] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9248.305031] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 9250.910992] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9251.026587] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9252.326670] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 9254.663401] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 9256.376249] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 9258.494849] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9258.626562] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9260.427032] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 9262.610187] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 9262.915515] Lustre: Setting parameter lustre-OST0000.ost.unknown_param=50 in log lustre-OST0000 [ 9266.146594] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9266.146644] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 9266.151381] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9269.583552] Lustre: server umount lustre-OST0000 complete [ 9271.264565] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9271.269061] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9271.270816] Lustre: Skipped 1 previous similar message [ 9276.384160] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9276.386072] Lustre: Skipped 1 previous similar message [ 9281.504091] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9281.506039] Lustre: Skipped 1 previous similar message [ 9285.087148] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 9285.166007] Lustre: server umount lustre-MDT0000 complete [ 9285.601812] LustreError: 270622:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9285.607079] LustreError: 270622:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [ 9286.427025] LustreError: 270649:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787756190 with bad export cookie 1526797456937343079 [ 9286.429620] LustreError: MGC192.168.201.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9286.430257] LustreError: 270649:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 9286.546475] Lustre: server umount lustre-MDT0001 complete [ 9290.152173] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing unload_modules_local [ 9291.114909] Key type lgssc unregistered [ 9291.229397] LNet: 274211:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 9291.231624] LNetError: 274211:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 9291.241347] LNet: Removed LNI 192.168.201.105@tcp [ 9291.550352] Key type .llcrypt unregistered [ 9291.551459] Key type ._llcrypt unregistered [ 9298.113635] Key type ._llcrypt registered [ 9298.114678] Key type .llcrypt registered [ 9298.155093] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing load_modules_local [ 9298.471023] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 9298.512776] alg: No test for adler32 (adler32-zlib) [ 9299.368787] Lustre: Lustre: Build Version: 2.17.57_81_g37bf112 [ 9299.453113] LNet: Added LNI 192.168.201.105@tcp [8/256/0/180] [ 9301.031184] Key type lgssc registered [ 9301.385531] Lustre: Echo OBD driver; http://www.lustre.org/ [ 9304.231882] Lustre: lustre-OST0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 9304.238328] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9319.647561] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 9324.767271] LustreError: 275381:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.201.105@tcp: failed processing log, type 4: rc = -110 [ 9351.391203] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9353.421627] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 9355.888436] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 9356.672164] Lustre: server umount lustre-OST0000 complete [ 9362.676639] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing unload_modules_local [ 9363.750675] Key type lgssc unregistered [ 9363.873481] LNet: 277012:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 9363.876315] LNetError: 277012:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 9363.885494] LNet: Removed LNI 192.168.201.105@tcp [ 9364.209312] Key type .llcrypt unregistered [ 9364.210336] Key type ._llcrypt unregistered [ 9379.200181] Key type ._llcrypt registered [ 9379.201081] Key type .llcrypt registered [ 9379.241918] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing load_modules_local [ 9379.555635] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 9379.563170] alg: No test for adler32 (adler32-zlib) [ 9380.413974] Lustre: Lustre: Build Version: 2.17.57_81_g37bf112 [ 9380.500055] LNet: Added LNI 192.168.201.105@tcp [8/256/0/180] [ 9382.079262] Key type lgssc registered [ 9382.490112] Lustre: Echo OBD driver; http://www.lustre.org/ [ 9387.338925] loop0: detected capacity change from 0 to 204800000 [ 9387.419740] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 9387.423766] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 9387.546212] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 9387.917052] loop0: detected capacity change from 0 to 204800000 [ 9387.988730] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 9387.993280] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 9388.167357] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 9388.594695] loop0: detected capacity change from 0 to 204800000 [ 9388.727864] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 9388.734961] blk_update_request: operation not supported error, dev loop0, sector 8224 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 9388.812039] blk_update_request: operation not supported error, dev loop0, sector 58264 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 9389.248554] loop0: detected capacity change from 0 to 204800000 [ 9389.307952] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 9389.725222] loop0: detected capacity change from 0 to 204800000 [ 9389.736309] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 9391.298432] loop0: detected capacity change from 0 to 204800000 [ 9391.309036] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 9392.859156] loop0: detected capacity change from 0 to 204800000 [ 9392.870258] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 9394.487381] loop0: detected capacity change from 0 to 204800000 [ 9394.503990] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 9396.068561] loop0: detected capacity change from 0 to 204800000 [ 9396.110223] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 9396.128345] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9396.169481] Lustre: 280401:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 9396.174664] Lustre: 280401:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000-MDT0000' with [0x200000005:0x1:0x0]: rc = 0 [ 9396.180309] Lustre: 280401:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000003:0xa:0x0]: rc = 0 [ 9396.185425] Lustre: 280401:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000-MDT0000' with [0x200000005:0x3:0x0]: rc = 0 [ 9396.190820] Lustre: 280401:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000003:0xc:0x0]: rc = 0 [ 9396.195936] Lustre: 280401:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000-MDT0000' with [0x200000005:0x2:0x0]: rc = 0 [ 9396.201421] Lustre: 280401:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000003:0xb:0x0]: rc = 0 [ 9396.206585] Lustre: 280401:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index 'nodemap' with [0x200000003:0x3:0x0]: rc = 0 [ 9396.211499] Lustre: 280401:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000006:0x10000:0x0]: rc = 0 [ 9396.216028] Lustre: 280401:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000006:0x2010000:0x0]: rc = 0 [ 9396.220323] Lustre: 280401:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000006:0x1010000:0x0]: rc = 0 [ 9396.224567] Lustre: 280401:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1020000' with [0x200000006:0x1020000:0x0]: rc = 0 [ 9396.230381] Lustre: 280401:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2020000' with [0x200000006:0x2020000:0x0]: rc = 0 [ 9396.235595] Lustre: 280401:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x20000' with [0x200000006:0x20000:0x0]: rc = 0 [ 9399.305321] Lustre: server umount MGS complete [ 9399.715628] loop0: detected capacity change from 0 to 204800000 [ 9399.758577] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9399.959110] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9399.976313] Lustre: lustre-MDT0000: Aborting client recovery [ 9400.281155] loop1: detected capacity change from 0 to 204800000 [ 9400.335969] LDISKFS-fs (loop1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9400.367277] Lustre: 280834:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 9400.370180] Lustre: 280834:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x10000-MDT0001' with [0x200000005:0x1:0x0]: rc = 0 [ 9400.373093] Lustre: 280834:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x10000' with [0x200000003:0x4:0x0]: rc = 0 [ 9400.375869] Lustre: 280834:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x1010000' with [0x200000003:0x5:0x0]: rc = 0 [ 9400.378679] Lustre: 280834:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x2010000' with [0x200000003:0x6:0x0]: rc = 0 [ 9400.381640] Lustre: 280834:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x2010000-MDT0001' with [0x200000005:0x3:0x0]: rc = 0 [ 9400.384963] Lustre: 280834:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x1010000-MDT0001' with [0x200000005:0x2:0x0]: rc = 0 [ 9400.392397] Lustre: Found index 1 for lustre-MDT0001, updating log [ 9400.485130] Lustre: lustre-MDT0001: Aborting client recovery [ 9400.770900] loop2: detected capacity change from 0 to 204800000 [ 9400.802572] LDISKFS-fs (loop2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9400.836191] Lustre: 280915:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 9400.839602] Lustre: 280915:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x2020000-OST0000' with [0x200000005:0x3:0x0]: rc = 0 [ 9400.843432] Lustre: 280915:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 9400.846369] Lustre: 280915:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x1020000-OST0000' with [0x200000005:0x2:0x0]: rc = 0 [ 9400.849600] Lustre: 280915:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 9400.852766] Lustre: 280915:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 9400.855830] Lustre: 280915:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x20000-OST0000' with [0x200000005:0x1:0x0]: rc = 0 [ 9400.901752] Lustre: Found index 0 for lustre-OST0000, updating log [ 9400.911816] Lustre: 280932:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 9400.928179] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9400.930150] Lustre: Skipped 1 previous similar message [ 9400.935157] Lustre: lustre-OST0000: Aborting recovery [ 9401.269978] loop3: detected capacity change from 0 to 204800000 [ 9401.312814] LDISKFS-fs (loop3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9401.344968] Lustre: 280997:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 9401.348605] Lustre: 280997:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x20000-OST0001' with [0x200000005:0x1:0x0]: rc = 0 [ 9401.358107] Lustre: 280997:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 9401.361388] Lustre: 280997:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 9401.364840] Lustre: 280997:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 9401.367900] Lustre: 280997:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x2020000-OST0001' with [0x200000005:0x3:0x0]: rc = 0 [ 9401.371424] Lustre: 280997:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x1020000-OST0001' with [0x200000005:0x2:0x0]: rc = 0 [ 9406.444766] LustreError: 280777:0:(lod_dev.c:511:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 7, retries 0, failed: rc = -108 [ 9409.506046] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 9409.506262] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 9409.517797] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000bd0 [ 9409.520854] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000bd0 [ 9410.529472] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:5 to 0x280000400:33) [ 9410.530269] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:5 to 0x2c0000400:33) [ 9412.367605] LustreError: 280741:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0000: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0000 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0000/identity_upcall, time 318us: rc = -2 [ 9425.888741] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9425.889497] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9425.897236] Lustre: Skipped 2 previous similar messages [ 9425.901089] Lustre: Skipped 1 previous similar message [ 9429.770684] Lustre: server umount lustre-MDT0000 complete [ 9430.168328] LustreError: 280726:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787756333 with bad export cookie 9638595747570812363 [ 9430.172754] LustreError: MGC192.168.201.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9430.174748] LustreError: 280726:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 9431.008300] LustreError: 280739:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9431.008622] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9431.009195] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 9431.009206] Lustre: Skipped 2 previous similar messages [ 9431.017953] LustreError: 280739:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [ 9431.022508] Lustre: Skipped 2 previous similar messages [ 9435.039813] LustreError: 280738:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9435.040100] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 9435.047986] LustreError: 280738:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 9435.051423] Lustre: Skipped 2 previous similar messages [ 9436.492523] Lustre: server umount lustre-MDT0001 complete [ 9443.014735] Lustre: server umount lustre-OST0000 complete [ 9449.527362] Lustre: server umount lustre-OST0001 complete [ 9452.500459] Lustre: DEBUG MARKER: == conf-sanity test 109a: test lctl clear_conf fsname ==== 10:59:14 (1787756354) [ 9464.159180] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_hostid [ 9467.907926] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing load_modules_local [ 9481.771640] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9481.863807] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 9481.874666] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 9481.913153] Lustre: lustre-MDT0000: new disk, initializing [ 9481.935104] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9481.937988] Lustre: Skipped 1 previous similar message [ 9481.943633] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 9483.297414] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 9488.299807] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9488.343397] Lustre: 285064:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 9488.368374] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 9488.371236] Lustre: Skipped 1 previous similar message [ 9488.414156] Lustre: lustre-MDT0001: new disk, initializing [ 9488.453702] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9488.468348] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 9488.472162] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 9489.931769] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 9494.081320] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 9496.221988] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 9498.651783] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9498.762911] Lustre: lustre-OST0000: new disk, initializing [ 9498.764573] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 9498.766976] Lustre: 287033:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 9498.769515] Lustre: 287033:0:(osd_compat.c:1353:osd_object_spec_find()) Skipped 1 previous similar message [ 9498.799984] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9500.996949] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 9505.463373] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 9505.805560] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 9505.813015] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 9505.875818] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 9513.292514] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 9516.086496] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 9525.485130] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 9567.203699] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9567.207622] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 9567.211196] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9567.213465] LustreError: Skipped 1 previous similar message [ 9567.216693] Lustre: Skipped 1 previous similar message [ 9571.988570] Lustre: server umount lustre-OST0000 complete [ 9575.391831] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 9575.394321] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9575.398240] Lustre: Skipped 1 previous similar message [ 9575.399928] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9579.712460] Lustre: server umount lustre-MDT0000 complete [ 9581.148849] LustreError: 285102:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787756484 with bad export cookie 9638595747570815072 [ 9581.154270] LustreError: MGC192.168.201.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9581.155567] LustreError: 285102:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 9581.287712] Lustre: server umount lustre-MDT0001 complete [ 9584.693683] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9586.465090] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 9588.420439] Lustre: server umount MGS complete [ 9593.682164] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9593.879630] LustreError: 290951:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9593.885755] LustreError: 290964:0:(qmt_pool.c:1639:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 9593.912254] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9595.478116] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 9598.947058] LustreError: 290952:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9599.410576] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9601.062547] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 9603.764629] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 9605.851900] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 9609.025868] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9611.384970] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 9614.623945] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 9630.688497] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 9630.690657] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9630.694091] Lustre: Skipped 1 previous similar message [ 9630.695730] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9630.697317] Lustre: Skipped 2 previous similar messages [ 9633.771460] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 9636.584360] Lustre: server umount lustre-OST0000 complete [ 9638.882752] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9638.892054] Lustre: Skipped 2 previous similar messages [ 9644.601478] Lustre: server umount lustre-MDT0000 complete [ 9646.347656] LustreError: 293786:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787756550 with bad export cookie 9638595747570816892 [ 9646.355182] LustreError: 293786:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 9646.356954] LustreError: MGC192.168.201.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9646.520582] Lustre: server umount lustre-MDT0001 complete [ 9651.386264] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing unload_modules_local [ 9652.637647] Key type lgssc unregistered [ 9652.791707] LNet: 294895:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 9652.797300] LNetError: 294895:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 9652.806577] LNet: Removed LNI 192.168.201.105@tcp [ 9653.262756] Key type .llcrypt unregistered [ 9653.264301] Key type ._llcrypt unregistered [ 9670.195467] Key type ._llcrypt registered [ 9670.196688] Key type .llcrypt registered [ 9670.251283] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_hostid [ 9678.199861] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing load_modules_local [ 9678.642725] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 9678.690034] alg: No test for adler32 (adler32-zlib) [ 9679.536921] Lustre: Lustre: Build Version: 2.17.57_81_g37bf112 [ 9679.619856] LNet: Added LNI 192.168.201.105@tcp [8/256/0/180] [ 9681.191226] Key type lgssc registered [ 9681.676938] Lustre: Echo OBD driver; http://www.lustre.org/ [ 9697.803241] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 9697.813471] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9698.918474] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 9698.929477] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 9698.968374] Lustre: lustre-MDT0000: new disk, initializing [ 9698.987202] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9698.992845] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 9700.651946] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 9706.268056] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9706.332594] Lustre: 298823:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 9706.376177] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 9706.379025] Lustre: Skipped 1 previous similar message [ 9706.423300] Lustre: lustre-MDT0001: new disk, initializing [ 9706.462185] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9706.481566] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 9706.485839] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 9708.271734] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 9713.236437] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 9715.393742] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 9718.838666] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9718.979543] Lustre: lustre-OST0000: new disk, initializing [ 9718.981893] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 9718.985298] Lustre: 300793:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 9719.024153] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9721.715112] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 9726.111204] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 9726.989787] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 9726.997131] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 9727.063679] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 9735.235813] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 9737.090473] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 9742.556512] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 9748.422647] Lustre: Modifying parameter lustre-client.llite.max_read_ahead_mb=64 in log lustre-client [ 9793.507139] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 9793.511109] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9793.512131] LustreError: Skipped 1 previous similar message [ 9793.521832] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9793.527712] Lustre: Skipped 1 previous similar message [ 9796.316380] Lustre: server umount lustre-OST0000 complete [ 9798.627357] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 9798.627424] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9798.640571] Lustre: Skipped 1 previous similar message [ 9798.644912] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9798.649263] Lustre: Skipped 1 previous similar message [ 9803.746219] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9803.750906] Lustre: Skipped 1 previous similar message [ 9803.985541] Lustre: server umount lustre-MDT0000 complete [ 9805.967052] LustreError: 298817:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787756709 with bad export cookie 12693414955957883770 [ 9805.974992] LustreError: 298817:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 9805.976517] LustreError: MGC192.168.201.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9806.172441] Lustre: server umount lustre-MDT0001 complete [ 9810.611558] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9812.441859] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 9814.871397] Lustre: server umount MGS complete [ 9820.317129] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9820.502406] LustreError: 304521:0:(qmt_pool.c:1639:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 9820.527287] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9822.107372] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 9825.713428] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9825.760801] LustreError: 304509:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9825.772962] LustreError: 304509:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 9825.915295] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9827.444424] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 9830.707348] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 9832.932599] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 9836.475683] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9836.673588] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9839.487502] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 9842.901987] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 9871.844292] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 9871.847412] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9871.848108] LustreError: Skipped 1 previous similar message [ 9871.853343] Lustre: Skipped 1 previous similar message [ 9871.854249] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9871.859442] Lustre: Skipped 1 previous similar message [ 9873.130361] Lustre: server umount lustre-OST0000 complete [ 9876.963581] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 9876.964534] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9876.966829] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9876.982175] Lustre: Skipped 2 previous similar messages [ 9887.201603] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9887.207577] Lustre: Skipped 4 previous similar messages [ 9889.247185] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 9889.364265] Lustre: server umount lustre-MDT0000 complete [ 9891.297895] LustreError: 305249:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9891.307059] LustreError: 305249:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 9891.375105] LustreError: 304490:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787756795 with bad export cookie 12693414955957885597 [ 9891.382997] LustreError: 304490:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 9891.384694] LustreError: MGC192.168.201.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9891.537827] Lustre: server umount lustre-MDT0001 complete [ 9896.362624] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing unload_modules_local [ 9897.655912] Key type lgssc unregistered [ 9897.822498] LNet: 308456:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 9897.827118] LNetError: 308456:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 9897.835478] LNet: Removed LNI 192.168.201.105@tcp [ 9898.300579] Key type .llcrypt unregistered [ 9898.302751] Key type ._llcrypt unregistered [ 9907.002125] Key type ._llcrypt registered [ 9907.003191] Key type .llcrypt registered [ 9907.037941] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_hostid [ 9914.040828] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing load_modules_local [ 9914.305541] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 9914.316184] alg: No test for adler32 (adler32-zlib) [ 9915.167619] Lustre: Lustre: Build Version: 2.17.57_81_g37bf112 [ 9915.258104] LNet: Added LNI 192.168.201.105@tcp [8/256/0/180] [ 9916.831314] Key type lgssc registered [ 9917.467724] Lustre: Echo OBD driver; http://www.lustre.org/ [ 9928.964476] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing load_modules_local [ 9935.573901] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 9935.583609] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9936.678370] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 9936.690647] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 9936.727259] Lustre: lustre-MDT0000: new disk, initializing [ 9936.747888] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9936.753873] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 9938.411242] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [ 9944.247543] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9944.418967] Lustre: lustre-OST0000: new disk, initializing [ 9944.421607] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 9944.424546] Lustre: Skipped 1 previous similar message [ 9944.427709] Lustre: 312480:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 9944.466514] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9945.998564] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 9946.002573] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 9946.014877] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 9947.198336] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [10217.442327] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10217.451927] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10219.458213] Lustre: server umount lustre-MDT0000 complete [10221.274887] LustreError: 311667:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787757124 with bad export cookie 16086721433444186784 [10221.279774] LustreError: MGC192.168.201.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [10221.281760] LustreError: 311667:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [10221.383262] Lustre: server umount lustre-OST0000 complete [10233.885895] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_hostid [10238.854027] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing load_modules_local [10257.608794] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10257.763534] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [10257.779443] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [10257.837472] Lustre: lustre-MDT0000: new disk, initializing [10257.872844] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10257.884622] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [10259.987996] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [10266.021811] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10266.100972] Lustre: 316720:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [10266.150951] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [10266.155479] Lustre: Skipped 1 previous similar message [10266.211036] Lustre: lustre-MDT0001: new disk, initializing [10266.258975] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [10266.275760] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [10266.280916] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [10267.685162] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [10272.556377] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [10275.055381] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [10278.657205] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10278.843804] Lustre: lustre-OST0000: new disk, initializing [10278.847521] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [10278.852719] Lustre: 318690:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [10278.905070] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [10279.834200] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [10279.841501] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [10279.899803] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [10281.578553] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [10286.486586] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [10288.548815] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [10288.672852] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [10290.673887] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [10290.811770] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [10295.268872] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [10295.272542] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10295.273742] LustreError: Skipped 1 previous similar message [10295.282788] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [10295.288653] Lustre: Skipped 1 previous similar message [10297.966759] Lustre: server umount lustre-OST0000 complete [10300.386576] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10300.387902] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10300.395194] Lustre: Skipped 2 previous similar messages [10305.505059] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10305.509139] Lustre: Skipped 2 previous similar messages [10310.625587] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10310.630397] Lustre: Skipped 1 previous similar message [10314.207167] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [10314.303111] Lustre: server umount lustre-MDT0000 complete [10316.251634] LustreError: 316714:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787757219 with bad export cookie 16086721433447127561 [10316.259401] LustreError: MGC192.168.201.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [10316.259827] LustreError: 316714:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [10316.433772] Lustre: server umount lustre-MDT0001 complete [10318.283668] Lustre: DEBUG MARKER: SKIP: conf-sanity test_111 skipping SLOW test 111 [10319.248688] Lustre: DEBUG MARKER: == conf-sanity test 112a: mount OST with no_create option ========================================================== 11:13:41 (1787757221) [10322.806295] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10323.051289] LustreError: 321003:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10323.062927] LustreError: 321003:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [10323.085921] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10325.133162] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [10328.545996] LustreError: 321004:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10329.001199] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10330.683799] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [10333.934902] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [10336.372981] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [10339.641391] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10339.779698] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [10339.781766] Lustre: Skipped 1 previous similar message [10342.710586] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [10346.435421] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [10350.144505] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10350.252317] Lustre: lustre-OST0001: new disk, initializing [10350.254851] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [10350.258608] Lustre: 323837:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [10353.131427] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [10353.686838] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [10353.690147] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [10353.705074] LustreError: 324264:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [10354.726476] LustreError: 324264:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [10354.733704] LustreError: 324264:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 2 previous similar messages [10355.750793] LustreError: 324264:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [10355.758494] LustreError: 324264:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 1 previous similar message [10357.799635] LustreError: 324272:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [10357.805484] LustreError: 324272:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 3 previous similar messages [10358.035282] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [10358.157753] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [10360.812410] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff889d850b7800.ost_server_uuid 50 [10361.531984] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff889d850b7800.ost_server_uuid in FULL state after 0 sec [10361.896851] LustreError: 324264:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [10361.904266] LustreError: 324264:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 7 previous similar messages [10364.230718] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff889d850b7800.ost_server_uuid 50 [10365.020662] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-ffff889d850b7800.ost_server_uuid in FULL state after 0 sec [10366.002721] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [10379.242565] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10379.244719] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [10379.250327] Lustre: Skipped 1 previous similar message [10383.568781] Lustre: server umount lustre-OST0001 complete [10384.360859] LustreError: 322824:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10384.369398] LustreError: 322824:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [10389.477229] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [10389.478885] LustreError: 322822:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10389.482466] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10389.492438] LustreError: 322822:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [10391.860186] Lustre: server umount lustre-OST0000 complete [10399.563722] Lustre: server umount lustre-MDT0000 complete [10399.713451] LustreError: 321004:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10399.723337] LustreError: 321004:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [10401.301689] LustreError: 320984:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787757305 with bad export cookie 16086721433447128443 [10401.308882] LustreError: 320984:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [10401.310338] LustreError: MGC192.168.201.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [10401.478578] Lustre: server umount lustre-MDT0001 complete [10406.863427] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing unload_modules_local [10408.448071] Key type lgssc unregistered [10408.613876] LNet: 326523:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [10408.618360] LNetError: 326523:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [10408.626660] LNet: Removed LNI 192.168.201.105@tcp [10409.202931] Key type .llcrypt unregistered [10409.205239] Key type ._llcrypt unregistered [10421.239828] Key type ._llcrypt registered [10421.241413] Key type .llcrypt registered [10421.280157] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing load_modules_local [10421.685981] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [10421.704680] alg: No test for adler32 (adler32-zlib) [10422.550853] Lustre: Lustre: Build Version: 2.17.57_81_g37bf112 [10422.634163] LNet: Added LNI 192.168.201.105@tcp [8/256/0/180] [10424.207244] Key type lgssc registered [10424.829619] Lustre: Echo OBD driver; http://www.lustre.org/ [10428.514491] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [10428.527667] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10429.755286] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10431.944660] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [10435.830397] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [10439.348353] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10439.568356] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [10441.527538] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [10446.175855] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10446.385242] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [10448.869127] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [10449.452474] LustreError: 329599:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10449.457436] LustreError: 329599:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [10452.572319] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [10454.504653] LustreError: 329600:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10455.530697] LustreError: 329600:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10455.539561] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:65) [10455.541912] LustreError: 329600:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [10455.592074] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10455.684780] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [10458.603833] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [10461.179181] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:33) [10462.367580] Lustre: DEBUG MARKER: oleg105-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [10465.018617] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing wait_import_state (FULL|IDLE) os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [10465.113740] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [10548.205217] Lustre: lustre-OST0001-osc-MDT0001: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10548.206871] LustreError: lustre-OST0001-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [10548.215715] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [10548.218284] LustreError: Skipped 1 previous similar message [10548.222827] Lustre: Skipped 1 previous similar message [10553.316614] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [10553.320723] Lustre: Skipped 1 previous similar message [10554.189317] Lustre: server umount lustre-OST0001 complete [10556.896803] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [10556.902129] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10556.909964] Lustre: Skipped 1 previous similar message [10556.913562] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [10557.921057] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [10557.926221] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10558.442864] LustreError: 331183:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10558.453595] LustreError: 331183:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [10562.483955] Lustre: server umount lustre-OST0000 complete [10567.648814] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [10567.654241] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10567.664167] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10567.668589] Lustre: Skipped 3 previous similar messages [10570.705451] Lustre: server umount lustre-MDT0000 complete [10572.689266] LustreError: 331602:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787757476 with bad export cookie 6793057652511950100 [10572.697122] LustreError: 331602:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [10572.701385] LustreError: MGC192.168.201.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [10572.902686] Lustre: server umount lustre-MDT0001 complete [10577.741852] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing unload_modules_local [10579.334608] Key type lgssc unregistered [10579.474655] LNet: 332860:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [10579.479553] LNetError: 332860:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [10579.492543] LNet: Removed LNI 192.168.201.105@tcp [10579.958379] Key type .llcrypt unregistered [10579.960212] Key type ._llcrypt unregistered [10603.919091] Key type ._llcrypt registered [10603.920266] Key type .llcrypt registered [10603.966249] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing load_modules_local [10604.416311] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [10604.435736] alg: No test for adler32 (adler32-zlib) [10605.344778] Lustre: Lustre: Build Version: 2.17.57_81_g37bf112 [10605.456992] LNet: Added LNI 192.168.201.105@tcp [8/256/0/180] [10607.071456] Key type lgssc registered [10607.762693] Lustre: Echo OBD driver; http://www.lustre.org/ [10612.545565] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [10612.556922] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10613.751271] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10615.555526] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [10619.818131] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10620.012565] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [10621.843434] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [10623.296490] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [10626.570612] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10626.802399] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [10629.142294] Lustre: DEBUG MARKER: oleg105-server.virtnet: executing set_default_debug -1 all [10629.862094] LustreError: 337071:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10629.868775] LustreError: 337071:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [10633.223086] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10633.361678] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180