[ 0.000000] Linux version 4.18.0rh8.10-debug (green@maintenance) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-26) (GCC)) #2 SMP Mon Jul 14 01:24:22 EDT 2025 [ 0.000000] Command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffcdfff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffce000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x0000000146dfffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.8 present. [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 [ 0.000000] Hypervisor detected: KVM [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 579002077 cycles [ 0.000000] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns [ 0.000000] tsc: Detected 2399.998 MHz processor [ 0.000000] last_pfn = 0x146e00 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0xbffce max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000f54b0-0x000f54bf] [ 0.000000] RAMDISK: [mem 0xbcc54000-0xbffbffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F52D0 000014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 0x00000000BFFE247C 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 0x00000000BFFE2318 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 0x00000000BFFE0040 0022D8 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 0x00000000BFFE0000 000040 [ 0.000000] ACPI: APIC 0x00000000BFFE238C 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: HPET 0x00000000BFFE241C 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: WAET 0x00000000BFFE2454 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0xbffe2318-0xbffe238b] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe2317] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0xbffe238c-0xbffe241b] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0xbffe241c-0xbffe2453] [ 0.000000] ACPI: Reserving WAET table memory at [mem 0xbffe2454-0xbffe247b] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x0000000146dfffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x1465a3000-0x1465cdfff] [ 0.000000] Reserving 256MB of memory at 2752MB for crashkernel (System RAM: 4205MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009efff] [ 0.000000] node 0: [mem 0x0000000000100000-0x00000000bffcdfff] [ 0.000000] node 0: [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Zeroed struct page in unavailable ranges: 4756 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x0000000146dfffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] TSC deadline timer available [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] kvm-guest: KVM setup pv remote TLB flush [ 0.000000] kvm-guest: setup PV sched yield [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbffce000-0xbfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.000000] [mem 0xc0000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u524288 [ 0.000000] kvm-guest: PV spinlocks enabled [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1059606 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] audit: disabled (until reboot) [ 0.000000] software IO TLB: area num 4. [ 0.000000] Memory: 2895240K/4306352K available (18435K kernel code, 11221K rwdata, 7248K rodata, 2908K init, 18040K bss, 524580K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] ftrace: allocating 41240 entries in 162 pages [ 0.000000] ftrace: allocated 162 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU event tracing is enabled. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=4. [ 0.000000] rcu: RCU callback double-/use-after-free debug enabled. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 [ 0.000000] NR_IRQS: 524544, nr_irqs: 456, preallocated irqs: 16 [ 0.000000] random: get_random_bytes called from start_kernel+0x622/0x9a8 with crng_init=0 [ 0.001000] Console: colour *CGA 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns [ 0.001017] APIC: Switch to symmetric I/O mode setup [ 0.003100] x2apic enabled [ 0.004025] Switched APIC routing to physical x2apic. [ 0.005023] kvm-guest: setup PV IPIs [ 0.009543] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.010000] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 0.010034] Calibrating delay loop (skipped) preset value.. 4799.99 BogoMIPS (lpj=2399998) [ 0.011023] pid_max: default: 32768 minimum: 301 [ 0.013038] LSM: Security Framework initializing [ 0.015036] Yama: becoming mindful. [ 0.016000] SELinux: Initializing. [ 0.016000] *** VALIDATE selinux *** [ 0.033232] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, vmalloc) [ 0.040635] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc) [ 0.042000] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.043158] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.044160] *** VALIDATE tmpfs *** [ 0.046676] *** VALIDATE proc *** [ 0.047000] *** VALIDATE cgroup *** [ 0.047022] *** VALIDATE cgroup2 *** [ 0.049244] x86/cpu: User Mode Instruction Prevention (UMIP) activated [ 0.051085] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.052023] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 [ 0.054016] Spectre V2 : User space: Vulnerable [ 0.055022] Speculative Store Bypass: Vulnerable [ 0.059027] debug: unmapping init [mem 0xffffffffa7859000-0xffffffffa7860fff] [ 0.063991] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (family: 0x6, model: 0x3e, stepping: 0x4) [ 0.067847] Performance Events: IvyBridge events, full-width counters, Intel PMU driver. [ 0.068037] ... version: 2 [ 0.069020] ... bit width: 48 [ 0.070029] ... generic registers: 4 [ 0.071028] ... value mask: 0000ffffffffffff [ 0.072035] ... max period: 00007fffffffffff [ 0.073036] ... fixed-purpose events: 3 [ 0.074036] ... event mask: 000000070000000f [ 0.077227] rcu: Hierarchical SRCU implementation. [ 0.080370] smp: Bringing up secondary CPUs ... [ 0.082368] x86: Booting SMP configuration: [ 0.083048] .... node #0, CPUs: #1 #2 #3 [ 0.112000] smp: Brought up 1 node, 4 CPUs [ 0.113041] smpboot: Max logical packages: 1 [ 0.114028] smpboot: Total of 4 processors activated (19199.98 BogoMIPS) [ 0.184026] node 0 deferred pages initialised in 65ms [ 0.188171] devtmpfs: initialized [ 0.189465] x86/mm: Memory block size: 128MB [ 0.191000] gcov: version magic: 0x41383552 [ 0.195303] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.202128] futex hash table entries: 1024 (order: 4, 65536 bytes, vmalloc) [ 0.208527] pinctrl core: initialized pinctrl subsystem [ 0.212350] [ 0.214011] ************************************************************* [ 0.217016] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.221019] ** ** [ 0.226037] ** IOMMU DebugFS SUPPORT HAS BEEN ENABLED IN THIS KERNEL ** [ 0.229021] ** ** [ 0.232017] ** This means that this kernel is built to expose internal ** [ 0.234022] ** IOMMU data structures, which may compromise security on ** [ 0.238019] ** your system. ** [ 0.241021] ** ** [ 0.244102] ** If you see this message and you are not debugging the ** [ 0.248023] ** kernel, report this immediately to your vendor! ** [ 0.251027] ** ** [ 0.253019] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.256129] ************************************************************* [ 0.262386] NET: Registered protocol family 16 [ 0.265554] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations [ 0.269104] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.273648] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.277169] cpuidle: using governor menu [ 0.281864] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.284176] PCI: Using configuration type 1 for base access [ 0.287508] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.298069] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.301094] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.302160] cryptd: max_cpu_qlen set to 1000 [ 0.303353] ACPI: Added _OSI(Module Device) [ 0.304000] ACPI: Added _OSI(Processor Device) [ 0.304077] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.306117] ACPI: Added _OSI(Processor Aggregator Device) [ 0.310000] ACPI: 1 ACPI AML tables successfully acquired and loaded [ 0.321085] ACPI: Interpreter enabled [ 0.322103] ACPI: PM: (supports S0 S3 S4 S5) [ 0.324019] ACPI: Using IOAPIC for interrupt routing [ 0.326188] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.330403] ACPI: Enabled 2 GPEs in block 00 to 0F [ 0.349182] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.352065] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3] [ 0.355033] acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI] [ 0.359127] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.369137] acpiphp: Slot [2] registered [ 0.372257] acpiphp: Slot [5] registered [ 0.373000] acpiphp: Slot [6] registered [ 0.376287] acpiphp: Slot [7] registered [ 0.378457] acpiphp: Slot [8] registered [ 0.380239] acpiphp: Slot [9] registered [ 0.386346] acpiphp: Slot [10] registered [ 0.389580] acpiphp: Slot [3] registered [ 0.393192] acpiphp: Slot [4] registered [ 0.395344] acpiphp: Slot [11] registered [ 0.397182] acpiphp: Slot [12] registered [ 0.399270] acpiphp: Slot [13] registered [ 0.402337] acpiphp: Slot [14] registered [ 0.403506] acpiphp: Slot [15] registered [ 0.405401] acpiphp: Slot [16] registered [ 0.407203] acpiphp: Slot [17] registered [ 0.409164] acpiphp: Slot [18] registered [ 0.410000] acpiphp: Slot [19] registered [ 0.411184] acpiphp: Slot [20] registered [ 0.412000] acpiphp: Slot [21] registered [ 0.417184] acpiphp: Slot [22] registered [ 0.418161] acpiphp: Slot [23] registered [ 0.420653] acpiphp: Slot [24] registered [ 0.424191] acpiphp: Slot [25] registered [ 0.427222] acpiphp: Slot [26] registered [ 0.429158] acpiphp: Slot [27] registered [ 0.431797] acpiphp: Slot [28] registered [ 0.433254] acpiphp: Slot [29] registered [ 0.440627] acpiphp: Slot [30] registered [ 0.441000] acpiphp: Slot [31] registered [ 0.442097] PCI host bridge to bus 0000:00 [ 0.443032] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.446034] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.448034] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.450035] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 0.453035] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] [ 0.456034] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.459320] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.463642] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.467817] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 0.485736] pci 0000:00:01.1: reg 0x20: [io 0xc320-0xc32f] [ 0.491043] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.494040] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.499037] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.502026] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.506015] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 0.510041] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 0.513061] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 0.517147] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 [ 0.523078] pci 0000:00:02.0: reg 0x10: [io 0xc300-0xc31f] [ 0.540000] pci 0000:00:02.0: reg 0x20: [mem 0xe0000000000-0xe0000003fff 64bit pref] [ 0.545072] pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 0.553849] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 [ 0.561019] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] [ 0.574022] pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] [ 0.600020] pci 0000:00:05.0: reg 0x20: [mem 0xe0000004000-0xe0000007fff 64bit pref] [ 0.616089] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 [ 0.624019] pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] [ 0.632020] pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 0.655000] pci 0000:00:06.0: reg 0x20: [mem 0xe0000008000-0xe000000bfff 64bit pref] [ 0.671332] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 [ 0.682024] pci 0000:00:07.0: reg 0x10: [io 0xc100-0xc17f] [ 0.685027] pci 0000:00:07.0: reg 0x14: [mem 0xfebc2000-0xfebc2fff] [ 0.707026] pci 0000:00:07.0: reg 0x20: [mem 0xe000000c000-0xe000000ffff 64bit pref] [ 0.727818] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 [ 0.738025] pci 0000:00:08.0: reg 0x10: [io 0xc180-0xc1ff] [ 0.748023] pci 0000:00:08.0: reg 0x14: [mem 0xfebc3000-0xfebc3fff] [ 0.777029] pci 0000:00:08.0: reg 0x20: [mem 0xe0000010000-0xe0000013fff 64bit pref] [ 0.795000] pci 0000:00:09.0: [1af4:1001] type 00 class 0x010000 [ 0.806028] pci 0000:00:09.0: reg 0x10: [io 0xc200-0xc27f] [ 0.819033] pci 0000:00:09.0: reg 0x14: [mem 0xfebc4000-0xfebc4fff] [ 0.855019] pci 0000:00:09.0: reg 0x20: [mem 0xe0000014000-0xe0000017fff 64bit pref] [ 0.876943] pci 0000:00:0a.0: [1af4:1001] type 00 class 0x010000 [ 0.887019] pci 0000:00:0a.0: reg 0x10: [io 0xc280-0xc2ff] [ 0.895024] pci 0000:00:0a.0: reg 0x14: [mem 0xfebc5000-0xfebc5fff] [ 0.925032] pci 0000:00:0a.0: reg 0x20: [mem 0xe0000018000-0xe000001bfff 64bit pref] [ 0.939192] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 [ 0.942531] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 0.945574] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 [ 0.948509] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 0.951370] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 [ 0.956150] iommu: Default domain type: Passthrough [ 0.959431] SCSI subsystem initialized [ 0.961311] ACPI: bus type USB registered [ 0.963161] usbcore: registered new interface driver usbfs [ 0.964207] usbcore: registered new interface driver hub [ 0.966197] usbcore: registered new device driver usb [ 0.969254] pps_core: LinuxPPS API ver. 1 registered [ 0.972019] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 0.976317] PTP clock support registered [ 0.979069] EDAC MC: Ver: 3.0.0 [ 0.981197] PCI: Using ACPI for IRQ routing [ 0.982000] NetLabel: Initializing [ 0.982086] NetLabel: domain hash size = 128 [ 0.985018] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 0.987259] NetLabel: unlabeled traffic allowed by default [ 0.990502] vgaarb: loaded [ 0.993045] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 0.995024] hpet0: 3 comparators, 64-bit 100.000000 MHz counter [ 1.002268] clocksource: Switched to clocksource kvm-clock [ 1.169890] VFS: Disk quotas dquot_6.6.0 [ 1.177456] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 1.187027] *** VALIDATE ramfs *** [ 1.189282] *** VALIDATE hugetlbfs *** [ 1.195080] pnp: PnP ACPI init [ 1.207639] pnp: PnP ACPI: found 6 devices [ 1.285388] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 1.291797] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 1.294133] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 1.302503] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 1.306738] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 1.311365] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] [ 1.316309] NET: Registered protocol family 2 [ 1.323634] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, vmalloc) [ 1.338358] tcp_listen_portaddr_hash hash table entries: 4096 (order: 5, 163840 bytes, vmalloc) [ 1.344448] TCP established hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 1.359903] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc) [ 1.366546] TCP: Hash tables configured (established 65536 bind 65536) [ 1.372880] MPTCP token hash table entries: 8192 (order: 6, 393216 bytes, vmalloc) [ 1.379630] UDP hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 1.390928] UDP-Lite hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 1.395562] NET: Registered protocol family 1 [ 1.399971] RPC: Registered named UNIX socket transport module. [ 1.409463] RPC: Registered udp transport module. [ 1.410961] RPC: Registered tcp transport module. [ 1.414461] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 1.417945] NET: Registered protocol family 44 [ 1.419842] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 1.422760] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 1.425497] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 1.428860] PCI: CLS 0 bytes, default 64 [ 1.431700] Unpacking initramfs... [ 5.284910] debug: unmapping init [mem 0xffff94a2fcc54000-0xffff94a2fffbffff] [ 5.304601] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 5.309426] software IO TLB: mapped [mem 0x00000000a8000000-0x00000000ac000000] (64MB) [ 5.321321] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 6.431075] Initialise system trusted keyrings [ 6.438349] Key type blacklist registered [ 6.443346] workingset: timestamp_bits=36 max_order=20 bucket_order=0 [ 6.455979] zbud: loaded [ 6.459250] *** VALIDATE nfs *** [ 6.460572] *** VALIDATE nfs4 *** [ 6.462356] pstore: using deflate compression [ 6.467237] Platform Keyring initialized [ 6.598769] NET: Registered protocol family 38 [ 6.603981] Key type asymmetric registered [ 6.606504] Asymmetric key parser 'x509' registered [ 6.609482] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 6.616209] io scheduler mq-deadline registered [ 6.619098] io scheduler kyber registered [ 6.621679] io scheduler bfq registered [ 6.624548] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 6.627893] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 6.630772] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 6.637910] ACPI: Power Button [PWRF] [ 6.652466] ACPI: \_SB_.LNKB: Enabled at IRQ 10 [ 6.662783] ACPI: \_SB_.LNKA: Enabled at IRQ 11 [ 6.676309] ACPI: \_SB_.LNKC: Enabled at IRQ 11 [ 6.687786] ACPI: \_SB_.LNKD: Enabled at IRQ 10 [ 6.712469] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 6.762128] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 6.794118] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 6.805149] Non-volatile memory driver v1.3 [ 6.808040] Linux agpgart interface v0.103 [ 6.875187] virtio_blk virtio1: [vda] 145960 512-byte logical blocks (74.7 MB/71.3 MiB) [ 6.885574] vda: detected capacity change from 0 to 74731520 [ 6.917183] virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) [ 6.921534] vdb: detected capacity change from 0 to 1073741824 [ 6.948496] virtio_blk virtio3: [vdc] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 6.951786] vdc: detected capacity change from 0 to 2621440000 [ 6.972465] virtio_blk virtio4: [vdd] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 6.977513] vdd: detected capacity change from 0 to 2621440000 [ 7.002741] virtio_blk virtio5: [vde] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 7.005934] vde: detected capacity change from 0 to 4294967296 [ 7.039657] virtio_blk virtio6: [vdf] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 7.043860] vdf: detected capacity change from 0 to 4294967296 [ 7.063267] libphy: Fixed MDIO Bus: probed [ 7.076891] usbcore: registered new interface driver usbserial_generic [ 7.082752] usbserial: USB Serial support registered for generic [ 7.089736] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 7.101319] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 7.105341] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 7.110159] mousedev: PS/2 mouse device common for all mice [ 7.118208] rtc_cmos 00:05: RTC can wake from S4 [ 7.126304] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 7.132526] rtc_cmos 00:05: registered as rtc0 [ 7.139422] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 7.143842] intel_pstate: CPU model not supported [ 7.148480] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 [ 7.149545] hid: raw HID events driver (C) Jiri Kosina [ 7.157611] usbcore: registered new interface driver usbhid [ 7.160049] usbhid: USB HID core driver [ 7.164842] drop_monitor: Initializing network drop monitor service [ 7.168143] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 [ 7.172624] Initializing XFRM netlink socket [ 7.189777] NET: Registered protocol family 10 [ 7.198930] Segment Routing with IPv6 [ 7.201890] NET: Registered protocol family 17 [ 7.212901] mpls_gso: MPLS GSO support [ 7.218928] RAS: Correctable Errors collector initialized. [ 7.221433] AVX version of gcm_enc/dec engaged. [ 7.223442] AES CTR mode by8 optimization enabled [ 7.417586] sched_clock: Marking stable (7417553236, 0)->(9713411172, -2295857936) [ 7.420443] registered taskstats version 1 [ 7.422586] Loading compiled-in X.509 certificates [ 7.425634] zswap: loaded using pool lzo/zbud [ 7.485199] Key type big_key registered [ 7.510304] Key type encrypted registered [ 7.514416] ima: No TPM chip found, activating TPM-bypass! [ 7.521767] ima: Allocated hash algorithm: sha1 [ 7.525122] ima: No architecture policies found [ 7.527534] evm: Initialising EVM extended attributes: [ 7.532888] evm: security.selinux [ 7.534576] evm: security.ima [ 7.535820] evm: security.capability [ 7.538155] evm: HMAC attrs: 0x1 [ 7.542900] rtc_cmos 00:05: setting system clock to 2026-09-08 21:36:05 UTC (1788903365) [ 7.557401] debug: unmapping init [mem 0xffffffffa8803000-0xffffffffa89fffff] [ 7.563876] debug: unmapping init [mem 0xffffffffa7582000-0xffffffffa7858fff] [ 7.574556] Write protecting the kernel read-only data: 28672k [ 7.583877] debug: unmapping init [mem 0xffffffffa5c03000-0xffffffffa5dfffff] [ 7.589142] debug: unmapping init [mem 0xffffffffa6514000-0xffffffffa65fffff] [ 7.649638] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 7.660400] systemd[1]: Detected virtualization kvm. [ 7.664427] systemd[1]: Detected architecture x86-64. [ 7.666848] systemd[1]: Running in initial RAM disk. Welcome to Rocky Linux 8.10 (Green Obsidian) dracut-049-233.git20240115.el8 (Initramfs)! [ 7.717355] systemd[1]: No hostname configured. [ 7.723385] systemd[1]: Set hostname to . [ 7.728541] random: systemd: uninitialized urandom read (16 bytes read) [ 7.735797] systemd[1]: Initializing machine ID from random generator. [ 7.934935] random: systemd: uninitialized urandom read (16 bytes read) [ 7.942784] systemd[1]: Reached target Timers. [ OK ] Reached target Timers. [ 7.953063] random: systemd: uninitialized urandom read (16 bytes read) [ 7.959983] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ 7.986564] systemd[1]: Reached target Slices. [ OK ] Reached target Slices. [ OK ] Reached target Local File Systems. [ OK ] Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket. Starting Create Volatile Files and Directories... Starting Setup Virtual Console... [ OK ] Reached target Local Encrypted Volumes. Starting Journal Service... [ OK ] Started Memstrack Anylazing Service. [ OK ] Reached target Initrd Root Device. [ OK ] Listening on udev Control Socket. [ OK ] Listening on udev Kernel Socket. [ OK ] Reached target Sockets. Starting Apply Kernel Variables... Starting Create list of required st…ce nodes for the current kernel... [ OK ] Reached target Swap. [ OK ] Reached target Paths. [ OK ] Started Create Volatile Files and Directories. [ OK ] Started Setup Virtual Console. [ OK ] Started Apply Kernel Variables. [ OK ] Started Journal Service. [ OK ] Started Create list of required sta…vice nodes for the current kernel. Starting Create Static Device Nodes in /dev... Starting dracut cmdline hook... [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ 9.879401] device-mapper: uevent: version 1.0.3 [ 9.889576] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting dracut pre-trigger hook... [ OK ] Started dracut pre-trigger hook. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. Starting dracut initqueue hook... [ OK ] Reached target System Initialization. [ OK ] Reached target Basic System. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. [ 12.383713] virtio_net virtio0 ens2: renamed from eth0 [ 12.388384] random: fast init done [ 12.660432] scsi host0: ata_piix [ 12.727966] scsi host1: ata_piix [ 12.740360] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc320 irq 14 [ 12.745292] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc328 irq 15 [ 18.063893] random: crng init done [ 18.066610] random: 7 urandom warning(s) missed due to ratelimiting [ 18.555994] dracut-initqueue[583]: RTNETLINK answers: File exists Starting nbd nbd0... [ OK ] Started nbd nbd0. [ OK ] Started dracut initqueue hook. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Mounting /sysroot... [ 21.453602] EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ 21.500678] hrtimer: interrupt took 8423971 ns [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Timers. Stopping Hardware RNG Entropy Gatherer Daemon... [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped Hardware RNG Entropy Gatherer Daemon. [ OK ] Stopped target Basic System. [ OK ] Stopped target Slices. [ OK ] Stopped target Paths. [ OK ] Stopped target Sockets. [ OK ] Stopped target System Initialization. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped dracut pre-trigger hook. Stopping udev Kernel Device Manager... [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Local Encrypted Volumes. [ OK ] Stopped Dispatch Password Requests to Console Directory Watch. [ OK ] Stopped target Swap. [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Closed udev Kernel Socket. [ OK ] Closed udev Control Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Reached target Switch Root. Starting Switch Root... [ 25.335200] printk: systemd: 22 output lines suppressed due to ratelimiting [ 26.285217] SELinux: Disabled at runtime. [ 26.472183] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 26.495397] systemd[1]: Detected virtualization kvm. [ 26.498843] systemd[1]: Detected architecture x86-64. Welcome to Rocky Linux 8.10 (Green Obsidian)! [ 28.572901] systemd[1]: initrd-switch-root.service: Succeeded. [ 28.585914] systemd[1]: Stopped Switch Root. [ OK ] Stopped Switch Root. [ 28.611420] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. [ 28.626721] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 28.638955] systemd[1]: Stopped Journal Service. [ OK ] Stopped Journal Service. [ 28.684958] systemd[1]: Starting Journal Service... Starting Journal Service... [ 28.703523] systemd[1]: Listening on initctl Compatibility Named Pipe. [ OK ] Listening on initctl Compatibility Named Pipe. Activating swap /dev/disk/by-label/SWAP... [ OK ] Listening on udev Kernel Socket. [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd Root File System. [ 28.885065] Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS [ OK ] Created slice system-serial\x2dgetty.slice. Mounting Huge Pages File System... Mounting POSIX Message Queue File System... [ OK ] Created slice system-getty.slice. [ OK ] Created slice User and Session Slice. Mounting Kernel Debug File System... [ OK ] Stopped target Initrd File Systems. [FAILED] Failed to set up automount Arbitrar…rmats File System Automount Point. See 'systemctl status proc-sys-fs-binfmt_misc.automount' for details. [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Created slice system-sshd\x2dkeygen.slice. Starting Create list of required st…ce nodes for the current kernel... Starting Remount Root and Kernel File Systems... [ OK ] Reached target rpc_pipefs.target. [ OK ] Reached target Slices. Starting Apply Kernel Variables... [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Paths. [ OK ] Listening on Process Core Dump Socket. [ OK ] Listening on udev Control Socket. Starting udev Coldplug all Devices... [ OK ] Started Journal Service. [ OK ] Activated swap /dev/disk/by-label/SWAP. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [FAILED] Failed to start Remount Root and Kernel File Systems. See 'systemctl status systemd-remount-fs.service' for details. [ OK ] Started Apply Kernel Variables. Starting Configure read-only root support... Starting Create Static Device Nodes in /dev... [ OK ] Reached target Swap. Starting Flush Journal to Persistent Storage... [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started udev Coldplug all Devices. [ OK ] Reached target Local File Systems (Pre). Mounting /mnt... Mounting /home/green/git/lustre-release... Starting udev Kernel Device Manager... [ OK ] Mounted /mnt. [ 30.970210] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ OK ] Mounted /home/green/git/lustre-release. [ OK ] Started udev Kernel Device Manager. [ 31.965107] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 32.198407] input: PC Speaker as /devices/platform/pcspkr/input/input5 [ 32.591297] RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer [ 32.792910] EDAC sbridge: Ver: 1.1.2 [* ] A start job is running for Configur…-only root support (8s / no limit) [** ] A start job is running for Configur…-only root support (8s / no limit) [*** ] A start job is running for Configur…-only root support (9s / no limit) [ *** ] A start job is running for Configur…-only root support (9s / no limit) [ *** ] A start job is running for Configur…only root support (10s / no limit) [ ***] A start job is running for Configur…only root support (10s / no limit)[ 39.322561] Key type dns_resolver registered [ **] A start job is running for Configur…only root support (11s / no limit) [ *] A start job is running for Configur…only root support (11s / no limit)[ 40.610852] NFS: Registering the id_resolver key type [ 40.616395] Key type id_resolver registered [ 40.620409] Key type id_legacy registered [ **] A start job is running for Configur…only root support (12s / no limit) [ ***] A start job is running for Configur…only root support (12s / no limit) [ OK ] Started Configure read-only root support. Starting Load/Save Random Seed... [ OK ] Reached target Local File Systems. Starting Mark the need to relabel after reboot... Starting Rebuild Dynamic Linker Cache... Starting Create Volatile Files and Directories... [ OK ] Started Load/Save Random Seed. [ OK ] Started Mark the need to relabel after reboot. [ OK ] Started Create Volatile Files and Directories. Starting RPC Bind... Starting Update UTMP about System Boot/Shutdown... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Started RPC Bind. [ OK ] Started Rebuild Dynamic Linker Cache. Starting Update is Completed... [ OK ] Started Update is Completed. [ OK ] Reached target System Initialization. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started dnf makecache --timer. [ OK ] Reached target Timers. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. [ OK ] Started irqbalance daemon. Starting Restore /run/initramfs on shutdown... [ OK ] Started Hardware RNG Entropy Gatherer Daemon. [ OK ] Reached target sshd-keygen.target. [ OK ] Started D-Bus System Message Bus. Starting Network Manager... Starting Login Service... [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Login Service. [ OK ] Started Network Manager. Starting Network Manager Wait Online... [ OK ] Reached target Network. Starting GSSAPI Proxy Daemon... Starting Dynamic System Tuning Daemon... Starting OpenSSH server daemon... [ OK ] Started GSSAPI Proxy Daemon. Starting Hostname Service... [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Started OpenSSH server daemon. [ OK ] Started Permit User Sessions. [ OK ] Started Serial Getty on ttyS0. [ OK ] Started Getty on tty1. [ OK ] Started Command Scheduler. [ OK ] Started Serial Getty on ttyS1. [ OK ] Reached target Login Prompts. [ OK ] Started Hostname Service. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Notify NFS peers of a restart... Starting System Logging Service... Starting Crash recovery kernel arming... [ OK ] Started Notify NFS peers of a restart. [ OK ] Started System Logging Service. Rocky Linux 8.10 (Green Obsidian) Kernel 4.18.0rh8.10-debug on an x86_64 oleg416-server login: [ 93.219667] libcfs: loading out-of-tree module taints kernel. [ 93.258863] Key type ._llcrypt registered [ 93.260595] Key type .llcrypt registered [ 93.348522] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_hostid [ 108.553566] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 109.627912] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 109.637689] alg: No test for adler32 (adler32-zlib) [ 110.821727] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 111.301517] LNet: Added LNI 192.168.204.116@tcp [8/256/0/180] [ 112.987071] Key type lgssc registered [ 114.018192] Lustre: Echo OBD driver; http://www.lustre.org/ [ 123.163642] ZFS: Loaded module v2.3.2-1, ZFS pool version 5000, ZFS filesystem version 5 [ 144.199202] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 150.497738] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 150.509146] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 151.630739] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 151.655296] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 151.722556] Lustre: lustre-MDT0000: new disk, initializing [ 151.796074] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 151.812023] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 154.017332] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 162.486887] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 162.556370] Lustre: 6518:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 162.583136] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 162.591873] Lustre: Skipped 1 previous similar message [ 162.656793] Lustre: lustre-MDT0001: new disk, initializing [ 162.703060] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 162.726074] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 162.735976] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 164.777983] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 167.714084] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 172.529575] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 172.651773] Lustre: lustre-OST0000: new disk, initializing [ 172.654718] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 172.659466] Lustre: 8456:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 172.686949] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 175.046322] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 175.050994] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 175.083503] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 175.420386] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 182.852043] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 182.923693] Lustre: lustre-OST0001: new disk, initializing [ 182.927532] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 182.932571] Lustre: 9527:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 182.966117] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 184.760312] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 184.767050] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 184.791401] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 185.698232] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 192.676678] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 197.832935] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 200.508033] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing check_logdir /tmp/testlogs/ [ 202.649414] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing yml_node [ 204.734138] Lustre: DEBUG MARKER: Client: 2.17.55.26 [ 205.994155] Lustre: DEBUG MARKER: MDS: 2.17.55.26 [ 207.189514] Lustre: DEBUG MARKER: OSS: 2.17.55.26 [ 207.987571] Lustre: DEBUG MARKER: -----============= acceptance-small: conf-sanity ============----- Tue Sep 8 17:39:25 EDT 2026 [ 216.396327] Lustre: DEBUG MARKER: excepting tests: 102 106 115 32newtarball [ 217.174498] Lustre: DEBUG MARKER: skipping tests SLOW=no: 45 69 106 111 114 [ 230.882114] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 230.882677] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 230.889222] Lustre: Skipped 3 previous similar messages [ 230.893020] Lustre: Skipped 3 previous similar messages [ 235.757750] Lustre: server umount lustre-MDT0000 complete [ 237.402137] LustreError: 6510:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788903595 with bad export cookie 11954988183433347155 [ 237.403822] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 237.408819] LustreError: 6510:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 241.120643] LustreError: 6523:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 241.121091] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 241.131080] LustreError: 6523:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 6 previous similar messages [ 241.139111] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 241.148625] Lustre: Skipped 1 previous similar message [ 242.145146] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 242.145150] LustreError: 10361:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 242.160038] Lustre: Skipped 1 previous similar message [ 243.600118] Lustre: server umount lustre-MDT0001 complete [ 245.368154] Lustre: server umount lustre-OST0000 complete [ 247.165646] Lustre: server umount lustre-OST0001 complete [ 249.965867] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_hostid [ 254.090301] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 270.426369] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 270.534519] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 270.552765] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 270.592221] Lustre: lustre-MDT0000: new disk, initializing [ 270.630971] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 270.643321] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 272.400804] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 277.487366] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 277.545770] Lustre: 15066:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 277.672430] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 279.451327] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 284.537872] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 287.450757] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 290.622755] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 290.782764] Lustre: lustre-OST0000: new disk, initializing [ 290.785049] Lustre: Skipped 1 previous similar message [ 290.790388] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 290.795148] Lustre: Skipped 2 previous similar messages [ 290.801232] Lustre: 17032:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 290.854062] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 290.858144] Lustre: Skipped 1 previous similar message [ 291.940628] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 291.945426] Lustre: Skipped 1 previous similar message [ 291.948697] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 292.015847] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 294.024463] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 299.243895] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 301.282874] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 301.387108] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 303.505986] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 303.609798] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 307.683155] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 307.683855] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 307.690952] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 307.695108] Lustre: Skipped 2 previous similar messages [ 310.701552] Lustre: server umount lustre-OST0000 complete [ 312.807177] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 312.809690] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 312.819344] Lustre: Skipped 1 previous similar message [ 312.823718] Lustre: Skipped 1 previous similar message [ 318.666032] Lustre: server umount lustre-MDT0000 complete [ 320.346584] LustreError: 15058:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788903678 with bad export cookie 11954988183433348688 [ 320.350307] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 320.351678] LustreError: 15058:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 320.505357] Lustre: server umount lustre-MDT0001 complete [ 322.755624] Lustre: DEBUG MARKER: == conf-sanity test 76a: set permanent params with lctl across mounts ========================================================== 17:41:20 (1788903680) [ 325.433058] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 325.671516] LustreError: 19293:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 325.679893] LustreError: 19293:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 325.709315] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 327.487068] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 330.723331] LustreError: 19294:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 331.344367] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 333.147433] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 336.415261] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 338.860312] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 341.811696] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 344.255398] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 347.242825] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 358.322452] Lustre: Modifying parameter general.osc.*.max_dirty_mb=452 in log params [ 362.465081] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 362.468411] LustreError: Skipped 1 previous similar message [ 362.469990] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 362.474911] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 362.476996] Lustre: Skipped 3 previous similar messages [ 367.842056] Lustre: server umount lustre-MDT0000 complete [ 369.375842] LustreError: 19273:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788903727 with bad export cookie 11954988183433349570 [ 369.378809] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 369.383193] LustreError: 19273:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 369.515226] Lustre: server umount lustre-MDT0001 complete [ 381.417650] Lustre: server umount lustre-OST0000 complete [ 390.043598] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 393.996122] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 394.166210] LustreError: 23693:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 394.183311] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 394.186128] Lustre: Skipped 2 previous similar messages [ 395.806254] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 398.842167] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 400.420223] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 401.500639] Lustre: Setting parameter general.debug_raw_pointers=Y in log params [ 404.074867] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 404.130070] LustreError: 25182:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 406.449189] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 409.881320] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 409.967380] Lustre: lustre-OST0001: new disk, initializing [ 409.970665] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 409.973986] Lustre: 26006:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 411.403903] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 411.408096] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 411.451979] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 412.427593] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 417.317411] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 418.787503] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 424.928927] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 424.932230] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 424.937694] Lustre: Skipped 2 previous similar messages [ 424.940545] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 424.942674] Lustre: Skipped 3 previous similar messages [ 428.144677] Lustre: server umount lustre-MDT0000 complete [ 429.708496] LustreError: 23674:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788903787 with bad export cookie 11954988183433350417 [ 429.712734] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 429.713873] LustreError: 23674:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 429.859264] Lustre: server umount lustre-MDT0001 complete [ 441.365794] Lustre: server umount lustre-OST0000 complete [ 452.133808] Lustre: server umount lustre-OST0001 complete [ 458.070403] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 461.772414] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 461.913553] LustreError: 28964:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 461.935841] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 461.939070] Lustre: Skipped 3 previous similar messages [ 463.477741] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 466.240099] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 467.705983] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 468.660656] Lustre: 30110:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 470.786887] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 472.825271] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 475.598621] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 477.591838] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 480.777703] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 481.946557] Lustre: 31987:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 486.884902] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 486.885121] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 486.885773] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 486.885777] Lustre: Skipped 4 previous similar messages [ 486.888424] Lustre: Skipped 5 previous similar messages [ 489.621456] Lustre: server umount lustre-MDT0000 complete [ 490.767949] LustreError: 28946:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788903848 with bad export cookie 11954988183433351649 [ 490.770943] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 490.773749] LustreError: 28946:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 490.874142] Lustre: server umount lustre-MDT0001 complete [ 502.403423] Lustre: server umount lustre-OST0000 complete [ 513.878285] Lustre: server umount lustre-OST0001 complete [ 516.606374] Lustre: DEBUG MARKER: == conf-sanity test 76b: verify params log setup correctly ========================================================== 17:44:34 (1788903874) [ 525.059333] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 528.333784] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 528.445793] LustreError: 34779:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 528.452297] LustreError: 34779:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 529.798810] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 532.543278] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 533.975880] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 534.916196] Lustre: 35929:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 537.155075] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 539.119829] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 541.926546] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 543.914441] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 546.967914] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 548.158174] Lustre: 37806:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 553.444338] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 553.444493] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 553.446507] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 553.446512] Lustre: Skipped 3 previous similar messages [ 553.452828] Lustre: Skipped 4 previous similar messages [ 555.548126] Lustre: server umount lustre-MDT0000 complete [ 556.761254] LustreError: 36310:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788903914 with bad export cookie 11954988183433352734 [ 556.763604] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 556.766016] LustreError: 36310:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 556.872461] Lustre: server umount lustre-MDT0001 complete [ 568.774209] Lustre: server umount lustre-OST0000 complete [ 579.289094] Lustre: server umount lustre-OST0001 complete [ 582.064835] Lustre: DEBUG MARKER: == conf-sanity test 76c: verify changelog_mask is applied with lctl set_param -P ========================================================== 17:45:39 (1788903939) [ 587.392441] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 590.688736] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 590.819268] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 590.823389] Lustre: Skipped 7 previous similar messages [ 592.136688] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 594.876219] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 596.245824] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 597.132963] Lustre: 41092:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 599.135325] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 600.292222] LustreError: 41445:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 600.297351] LustreError: 41445:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 601.061208] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 603.765382] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 605.649385] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 608.710326] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 610.112444] Lustre: Setting parameter general.mdd.*.changelog_mask=-CLOSE in log params [ 610.114555] Lustre: Skipped 1 previous similar message [ 613.274948] Lustre: server umount lustre-MDT0000 complete [ 614.433155] LustreError: 39922:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788903972 with bad export cookie 11954988183433353819 [ 614.439670] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 620.589943] Lustre: server umount lustre-MDT0001 complete [ 623.278338] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 624.352130] LustreError: 43822:0:(import.c:339:ptlrpc_invalidate_import()) MGS: timeout waiting for callback (1 != 0) [ 624.354800] LustreError: 43822:0:(import.c:363:ptlrpc_invalidate_import()) @@@ still on sending list req@ffff94a246da3b80 x1875801244201344/t0(0) o250->MGC192.168.204.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788903982 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 [ 624.362936] LustreError: 43822:0:(import.c:373:ptlrpc_invalidate_import()) MGS: Unregistering RPCs found (0). Network is sluggish? Waiting for them to error out. [ 624.544596] LustreError: 3642:0:(client.c:1391:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff94a374b75880 x1875801244203008/t0(0) o250->MGC192.168.204.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 625.956050] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 628.628839] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 630.085388] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 632.361072] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 641.980025] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 9 sec [ 643.659880] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 644.135115] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 644.177157] Lustre: DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec [ 649.188076] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 649.189162] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 649.192767] Lustre: Skipped 6 previous similar messages [ 651.475793] Lustre: server umount lustre-MDT0000 complete [ 652.630287] LustreError: 39921:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788904010 with bad export cookie 11954988183433354897 [ 652.633180] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 652.634497] LustreError: 39921:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 8 previous similar messages [ 652.740652] Lustre: server umount lustre-MDT0001 complete [ 663.489784] Lustre: server umount lustre-OST0000 complete [ 674.905338] Lustre: server umount lustre-OST0001 complete [ 677.780388] Lustre: DEBUG MARKER: == conf-sanity test 76d: verify llite.*.xattr_cache can be set by 'lctl set_param -P' correctly ========================================================== 17:47:15 (1788904035) [ 682.821564] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 685.920939] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 687.296755] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 690.031512] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 691.435848] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 692.380948] Lustre: 48712:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 692.384597] Lustre: 48712:0:(mgs_llog.c:1450:mgs_modify_param()) Skipped 1 previous similar message [ 694.528057] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 696.370818] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 698.970427] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 700.857682] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 703.958281] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 705.481127] Lustre: Setting parameter general.llite.*.xattr_cache=0 in log params [ 710.629329] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 710.632370] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 710.634266] Lustre: Skipped 13 previous similar messages [ 714.965978] Lustre: server umount lustre-MDT0000 complete [ 716.384852] Lustre: server umount lustre-MDT0001 complete [ 728.064690] Lustre: server umount lustre-OST0000 complete [ 739.476065] Lustre: server umount lustre-OST0001 complete [ 742.538577] Lustre: DEBUG MARKER: == conf-sanity test 77: comma-separated MGS NIDs and failover node NIDs ========================================================== 17:48:19 (1788904099) [ 743.323556] Lustre: DEBUG MARKER: SKIP: conf-sanity test_77 mixed loopback and real device not working [ 743.892439] Lustre: DEBUG MARKER: == conf-sanity test 78: run resize2fs on MDT and OST filesystems ========================================================== 17:48:21 (1788904101) [ 747.245041] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_hostid [ 749.980372] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 756.790723] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 756.874723] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 756.909352] Lustre: lustre-MDT0000: new disk, initializing [ 756.930412] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 758.158106] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 761.627813] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 763.747040] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 763.830715] Lustre: 54784:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 765.117193] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 765.125672] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 765.579174] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 769.033020] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 769.733904] Lustre: DEBUG MARKER: create test files [ 780.769795] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 780.769905] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 780.774802] Lustre: Skipped 4 previous similar messages [ 786.234402] Lustre: server umount lustre-OST0000 complete [ 787.489876] Lustre: server umount lustre-MDT0000 complete [ 790.997874] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing unload_modules_local [ 791.947574] Key type lgssc unregistered [ 792.065272] LNet: 56386:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 792.067409] LNetError: 56386:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 792.079324] LNet: Removed LNI 192.168.204.116@tcp [ 792.376093] Key type .llcrypt unregistered [ 792.377228] Key type ._llcrypt unregistered [ 804.014946] Key type ._llcrypt registered [ 804.016625] Key type .llcrypt registered [ 804.070143] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 804.632656] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 804.643414] alg: No test for adler32 (adler32-zlib) [ 805.581114] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 805.724480] LNet: Added LNI 192.168.204.116@tcp [8/256/0/180] [ 807.376373] Key type lgssc registered [ 808.155609] Lustre: Echo OBD driver; http://www.lustre.org/ [ 813.837464] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 813.854419] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 815.142104] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 818.516121] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 823.826930] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 828.864457] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 829.091037] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 832.832913] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 837.013638] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 840.361787] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:102 to 0x240000400:129) [ 840.399982] Lustre: 59105:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 510 < left 544, rollback = 9 [ 840.410151] Lustre: 59105:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 32/128/5, destroy: 0/0/0 [ 840.414210] Lustre: 59105:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 840.418955] Lustre: 59105:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/18/1, punch: 0/0/0, quota 1/3/0 [ 840.425252] Lustre: 59105:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 840.429474] Lustre: 59105:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 845.979822] Lustre: DEBUG MARKER: check files after expanding the MDT and OST filesystems [ 849.401137] Lustre: DEBUG MARKER: create more files after expanding the MDT and OST filesystems [ 856.042058] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 856.042063] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 856.042838] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 857.912366] Lustre: server umount lustre-OST0000 complete [ 859.610717] Lustre: server umount lustre-MDT0000 complete [ 870.951305] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing unload_modules_local [ 875.693286] Key type lgssc unregistered [ 876.093321] LNet: 60716:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 876.112806] LNetError: 60716:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 876.138891] LNet: Removed LNI 192.168.204.116@tcp [ 877.278186] Key type .llcrypt unregistered [ 877.281357] Key type ._llcrypt unregistered [ 923.640496] Key type ._llcrypt registered [ 923.647646] Key type .llcrypt registered [ 923.996954] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 929.151667] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 929.283578] alg: No test for adler32 (adler32-zlib) [ 930.582445] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 931.133395] LNet: Added LNI 192.168.204.116@tcp [8/256/0/180] [ 932.944563] Key type lgssc registered [ 935.337454] Lustre: Echo OBD driver; http://www.lustre.org/ [ 949.958819] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 949.995981] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 951.612548] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 957.321823] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 965.550118] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 972.785374] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 973.166916] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 976.262544] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:140 to 0x240000400:161) [ 976.315919] Lustre: 63556:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 510 < left 544, rollback = 9 [ 976.326994] Lustre: 63556:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 32/128/5, destroy: 0/0/0 [ 976.341509] Lustre: 63556:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 976.362985] Lustre: 63556:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/18/1, punch: 0/0/0, quota 1/3/0 [ 976.372968] Lustre: 63556:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 976.378802] Lustre: 63556:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 978.779822] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 986.450661] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 992.668433] Lustre: DEBUG MARKER: check files after shrinking the MDT and OST filesystems [ 1007.073460] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1007.088296] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1007.102165] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1009.017484] Lustre: server umount lustre-OST0000 complete [ 1013.059943] Lustre: server umount lustre-MDT0000 complete [ 1023.817747] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing unload_modules_local [ 1026.578875] Key type lgssc unregistered [ 1026.898550] LNet: 65115:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1026.913962] LNetError: 65115:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1026.936300] LNet: Removed LNI 192.168.204.116@tcp [ 1027.786786] Key type .llcrypt unregistered [ 1027.793639] Key type ._llcrypt unregistered [ 1046.954543] Key type ._llcrypt registered [ 1046.956985] Key type .llcrypt registered [ 1047.098353] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_hostid [ 1063.696821] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 1064.846585] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1064.870248] alg: No test for adler32 (adler32-zlib) [ 1066.111421] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 1066.356934] LNet: Added LNI 192.168.204.116@tcp [8/256/0/180] [ 1068.003417] Key type lgssc registered [ 1069.239947] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1104.742714] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1104.780726] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1106.049886] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1106.076297] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1106.208695] Lustre: lustre-MDT0000: new disk, initializing [ 1106.339423] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1106.357081] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1111.477598] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 1123.075436] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1123.222672] Lustre: 68265:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1123.343100] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 1123.348816] Lustre: Skipped 1 previous similar message [ 1123.536638] Lustre: lustre-MDT0001: new disk, initializing [ 1123.684152] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1123.736541] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 1123.747676] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1129.589419] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 1140.313411] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1147.398340] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 1155.131126] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1155.512191] Lustre: lustre-OST0000: new disk, initializing [ 1155.519883] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1155.528342] Lustre: 70236:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1155.672339] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1163.387152] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 1163.404959] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1163.579297] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1163.849181] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 1173.577675] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1179.614238] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1179.830933] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1186.106601] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1186.410918] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1189.348799] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1189.355572] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1189.363077] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1189.421918] Lustre: Skipped 1 previous similar message [ 1194.471983] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1194.479673] Lustre: Skipped 1 previous similar message [ 1195.378057] Lustre: server umount lustre-OST0000 complete [ 1199.591779] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1199.598879] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1199.606032] Lustre: Skipped 1 previous similar message [ 1199.614497] Lustre: Skipped 2 previous similar messages [ 1204.706071] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1204.710945] Lustre: Skipped 1 previous similar message [ 1205.389218] Lustre: server umount lustre-MDT0000 complete [ 1209.905723] LustreError: 68258:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788904567 with bad export cookie 9031515626458071496 [ 1209.914352] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1209.916153] LustreError: 68258:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 1210.241492] Lustre: server umount lustre-MDT0001 complete [ 1219.313913] Lustre: DEBUG MARKER: == conf-sanity test 79: format MDT/OST without mgs option (should return errors) ========================================================== 17:56:15 (1788904575) [ 1231.398812] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 1279.236678] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_hostid [ 1289.761548] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 1330.484940] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1330.712770] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1330.753857] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1330.918694] Lustre: lustre-MDT0000: new disk, initializing [ 1331.056924] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1331.078370] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1336.737295] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 1349.490575] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1349.619304] Lustre: 76260:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1349.695732] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 1349.704222] Lustre: Skipped 1 previous similar message [ 1349.775979] Lustre: lustre-MDT0001: new disk, initializing [ 1349.915188] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1349.983063] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 1350.005053] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1356.109199] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 1368.019205] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1375.054241] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 1381.114815] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1381.393543] Lustre: lustre-OST0000: new disk, initializing [ 1381.396468] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1381.406698] Lustre: 78226:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1381.474452] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1386.196231] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 1387.039082] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 1387.045614] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1387.101710] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1392.962895] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1395.995194] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1396.168192] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1399.609949] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1399.773788] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1402.349845] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1402.350429] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1402.351825] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1402.361757] Lustre: Skipped 1 previous similar message [ 1402.373325] LustreError: Skipped 1 previous similar message [ 1407.308189] Lustre: server umount lustre-OST0000 complete [ 1411.556348] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1411.559639] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1411.568899] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1411.572287] Lustre: Skipped 1 previous similar message [ 1416.376656] Lustre: server umount lustre-MDT0000 complete [ 1417.697205] LustreError: 76266:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1417.711923] LustreError: 76266:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 4 previous similar messages [ 1419.235728] LustreError: 76251:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788904777 with bad export cookie 9031515626458072378 [ 1419.245461] LustreError: 76251:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 1419.245641] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1419.473895] Lustre: server umount lustre-MDT0001 complete [ 1424.675085] Lustre: DEBUG MARKER: == conf-sanity test 80: mgc import reconnect race ======== 17:59:41 (1788904781) [ 1428.310923] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1428.551348] LustreError: 80637:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1428.599471] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1430.554123] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 1434.082140] LustreError: 80638:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1435.550437] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1438.024167] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 1442.081834] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1445.082934] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 1449.069368] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1453.078574] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 1457.103375] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1459.123341] Lustre: 83305:0:(genops.c:1803:obd_export_evict_by_uuid()) MGS: evicting a5ca89c9-e8ca-46eb-bdf4-05035ae8479e at adminstrative request [ 1461.542545] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1461.551375] Lustre: *** cfs_fail_loc=906, val=2147483648*** [ 1471.973501] Lustre: MGS: Client a5ca89c9-e8ca-46eb-bdf4-05035ae8479e (at 0@lo) reconnecting [ 1471.980274] Lustre: Evicted from MGS (at 0@lo) after server handle changed from 0x7d56639c7a6c48ac to 0x7d56639c7a6c4b4c [ 1471.989881] Lustre: MGC192.168.204.116@tcp: Connection restored to 0@lo (at 0@lo) [ 1493.010405] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1493.119314] Lustre: lustre-OST0001: new disk, initializing [ 1493.121883] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 1493.124908] Lustre: 83696:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1493.164707] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 1493.169968] Lustre: Skipped 2 previous similar messages [ 1496.456510] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 1499.169064] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 1499.177338] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 1499.225795] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 1501.919874] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1504.234303] Lustre: lustre-OST0001-osc-MDT0001: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1504.234387] LustreError: lustre-OST0001-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1504.237151] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 1504.237162] Lustre: Skipped 2 previous similar messages [ 1504.240611] Lustre: Skipped 2 previous similar messages [ 1504.244348] LustreError: Skipped 1 previous similar message [ 1505.622407] Lustre: server umount lustre-OST0001 complete [ 1509.347681] LustreError: 82457:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1509.357276] LustreError: 82457:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 1513.704190] Lustre: server umount lustre-OST0000 complete [ 1517.538189] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1517.549485] LustreError: Skipped 1 previous similar message [ 1517.554447] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1517.562818] Lustre: Skipped 2 previous similar messages [ 1521.781288] Lustre: server umount lustre-MDT0000 complete [ 1523.490739] LustreError: 80619:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788904881 with bad export cookie 9031515626458073932 [ 1523.493881] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1523.496876] LustreError: 80619:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 6 previous similar messages [ 1523.659525] Lustre: server umount lustre-MDT0001 complete [ 1527.752615] Lustre: DEBUG MARKER: == conf-sanity test 81: sparse OST indexing ============== 18:01:24 (1788904884) [ 1528.564164] Lustre: DEBUG MARKER: SKIP: conf-sanity test_81 needs >= 3 OSTs [ 1529.512462] Lustre: DEBUG MARKER: == conf-sanity test 82a: specify OSTs for file (succeed) or directory (succeed) ========================================================== 18:01:26 (1788904886) [ 1530.277575] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82a needs >= 3 OSTs [ 1531.136316] Lustre: DEBUG MARKER: == conf-sanity test 82b: specify OSTs for file with --pool and --ost-list options ========================================================== 18:01:28 (1788904888) [ 1531.909349] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82b needs >= 4 OSTs [ 1532.703708] Lustre: DEBUG MARKER: == conf-sanity test 82c: specify sparse OSTs for setstripe (should not crash) ========================================================== 18:01:29 (1788904889) [ 1533.567068] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82c needs >= 4 OSTs [ 1534.500402] Lustre: DEBUG MARKER: == conf-sanity test 83: ENOSPACE on OST doesn't cause message VFS: Busy inodes after unmount ... ========================================================== 18:01:31 (1788904891) [ 1535.327375] Lustre: DEBUG MARKER: mount the OST /dev/mapper/ost1_flakey as a ldiskfs filesystem [ 1538.242562] loop: module loaded [ 1538.248619] loop0: detected capacity change from 0 to 4294967296 [ 1538.281045] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 1539.089163] Lustre: DEBUG MARKER: run llverfs in partial mode on the OST ldiskfs /mnt/lustre-ost1 [ 1540.573774] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing run_llverfs /mnt/lustre-ost1 -vpl no [ 1542.324800] Lustre: DEBUG MARKER: unmount the OST /dev/mapper/ost1_flakey [ 1553.948184] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1553.973808] LustreError: 87823:0:(obd_config.c:845:class_setup()) setup lustre-OST0000-osd failed (-28) [ 1553.976138] LustreError: 87823:0:(obd_mount.c:259:lustre_start_simple()) lustre-OST0000-osd setup error -28 [ 1553.978654] LustreError: 87823:0:(tgt_mount.c:2671:server_fill_super()) Unable to start osd on /dev/mapper/ost1_flakey: -28 [ 1553.982156] LustreError: 87823:0:(super25.c:178:lustre_fill_super()) llite: Unable to mount : rc = -28 [ 1563.323445] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_hostid [ 1568.005662] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 1583.514422] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1583.607570] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1583.620255] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1583.663959] Lustre: lustre-MDT0000: new disk, initializing [ 1583.686594] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1583.695267] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1585.418196] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 1590.356961] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1590.408464] Lustre: 90683:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1590.524180] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1592.267484] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 1596.633745] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1598.867978] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 1601.605887] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1601.719023] Lustre: 92651:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1604.132111] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 1608.135379] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1609.660112] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1611.261908] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1611.303457] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1611.780969] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 2 sec [ 1613.275336] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1613.360312] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1616.354341] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1616.354946] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1616.358426] LustreError: Skipped 1 previous similar message [ 1616.364509] Lustre: Skipped 1 previous similar message [ 1616.367240] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1616.369740] Lustre: Skipped 8 previous similar messages [ 1620.248936] Lustre: server umount lustre-OST0000 complete [ 1627.812868] Lustre: server umount lustre-MDT0000 complete [ 1629.234492] LustreError: 91478:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788904987 with bad export cookie 9031515626458074548 [ 1629.237359] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1629.239875] LustreError: 91478:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 1629.363333] Lustre: server umount lustre-MDT0001 complete [ 1632.680029] Lustre: DEBUG MARKER: == conf-sanity test 84: check recovery_hard_time ========= 18:03:10 (1788904990) [ 1635.242666] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1635.479403] LustreError: 95077:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1637.126449] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 1640.389974] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1642.113940] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 1644.829663] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1646.859821] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 1649.409219] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1651.586757] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 1654.355968] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1655.926101] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1662.137516] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 6 sec [ 1663.580544] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1663.671253] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1666.075778] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1666.145412] Lustre: lustre-OST0001: new disk, initializing [ 1666.146936] Lustre: Skipped 2 previous similar messages [ 1666.148390] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 1666.150361] Lustre: Skipped 3 previous similar messages [ 1666.152840] Lustre: 98489:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1668.258200] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 1672.225315] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1673.748249] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid 50 [ 1676.286934] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 1676.290844] Lustre: Skipped 2 previous similar messages [ 1676.292928] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 1676.318369] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 1676.893697] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid in FULL state after 3 sec [ 1678.555679] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [ 1678.647859] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1689.455353] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 1698.339114] Lustre: Failing over lustre-MDT0000 [ 1698.683332] Lustre: server umount lustre-MDT0000 complete [ 1700.697974] LustreError: 95074:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1700.703691] LustreError: 95074:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 1701.858432] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1701.860354] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1701.861568] LustreError: Skipped 1 previous similar message [ 1701.866061] Lustre: Skipped 3 previous similar messages [ 1713.791204] LDISKFS-fs (dm-0): 4 truncates cleaned up [ 1713.792770] LDISKFS-fs (dm-0): recovery complete [ 1713.795607] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1713.837337] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1713.943294] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-60 [ 1713.946230] Lustre: Skipped 6 previous similar messages [ 1713.968953] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 1715.391780] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 1716.048813] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 1716.049583] Lustre: 96424:0:(ldlm_lib.c:2084:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 1719.265406] Lustre: 95078:0:(ldlm_lib.c:2084:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 1719.268752] Lustre: 95078:0:(ldlm_lib.c:2084:extend_recovery_timer()) Skipped 1 previous similar message [ 1719.275255] Lustre: lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) [ 1719.296619] LustreError: 101329:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1719.616063] LustreError: 101329:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1719.930056] LustreError: 101329:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1719.933104] LustreError: 101329:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 1 previous similar message [ 1720.248113] LustreError: 101329:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1720.251629] LustreError: 101329:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 1 previous similar message [ 1720.570635] Lustre: 101329:0:(ldlm_lib.c:2084:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 1720.575530] Lustre: 101329:0:(ldlm_lib.c:2084:extend_recovery_timer()) Skipped 8 previous similar messages [ 1721.203290] LustreError: 101329:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1721.207366] LustreError: 101329:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 3 previous similar messages [ 1721.520099] LustreError: 101329:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1721.524770] LustreError: 101329:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 3 previous similar messages [ 1722.776989] Lustre: 101329:0:(ldlm_lib.c:2084:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 1722.781630] Lustre: 101329:0:(ldlm_lib.c:2084:extend_recovery_timer()) Skipped 6 previous similar messages [ 1723.409125] LustreError: 101329:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1723.413879] LustreError: 101329:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 6 previous similar messages [ 1723.728068] LustreError: 101329:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1723.731370] LustreError: 101329:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 6 previous similar messages [ 1726.858608] Lustre: 101329:0:(ldlm_lib.c:2084:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 1726.863258] Lustre: 101329:0:(ldlm_lib.c:2084:extend_recovery_timer()) Skipped 12 previous similar messages [ 1727.490482] LustreError: 101329:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1727.494358] LustreError: 101329:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 12 previous similar messages [ 1727.808144] LustreError: 101329:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1727.810969] LustreError: 101329:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 12 previous similar messages [ 1734.993924] Lustre: 101329:0:(ldlm_lib.c:2084:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 1734.999184] Lustre: 101329:0:(ldlm_lib.c:2084:extend_recovery_timer()) Skipped 25 previous similar messages [ 1735.626465] LustreError: 101329:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1735.629872] LustreError: 101329:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 25 previous similar messages [ 1735.944118] LustreError: 101329:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1735.948365] LustreError: 101329:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 25 previous similar messages [ 1751.242535] Lustre: 101329:0:(ldlm_lib.c:2084:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 1751.248037] Lustre: 101329:0:(ldlm_lib.c:2084:extend_recovery_timer()) Skipped 51 previous similar messages [ 1751.874083] LustreError: 101329:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1751.877128] LustreError: 101329:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 51 previous similar messages [ 1752.192106] LustreError: 101329:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1752.195882] LustreError: 101329:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 51 previous similar messages [ 1776.224146] Lustre: 101329:0:(ldlm_lib.c:2393:target_recovery_overseer()) lustre-MDT0000 recovery is aborted by hard timeout [ 1776.227408] Lustre: 101329:0:(ldlm_lib.c:2403:target_recovery_overseer()) recovery is aborted, evict exports in recovery [ 1776.230418] Lustre: 101329:0:(genops.c:1630:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client 0f84957c-171d-4605-bc5f-69de696b4b6e@192.168.204.16@tcp [ 1776.235163] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 1776.237729] Lustre: 101329:0:(ldlm_lib.c:1913:abort_req_replay_queue()) @@@ aborted: req@000000004a8507a7 x1875802228592896/t0(8589934779) o101->0f84957c-171d-4605-bc5f-69de696b4b6e@192.168.204.16@tcp:594/0 lens 592/0 e 0 to 0 dl 1788905144 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:0 [ 1776.246108] Lustre: lustre-MDT0000-osd: cancel update llog [0x200000400:0x1:0x0] [ 1776.248830] Lustre: lustre-MDT0000: Denying connection for new client 0f84957c-171d-4605-bc5f-69de696b4b6e (at 192.168.204.16@tcp), waiting for 3 known clients (2 recovered, 0 in progress, and 1 evicted) to recover in 0:00 [ 1776.252741] Lustre: lustre-MDT0001-osp-MDT0000: cancel update llog [0x240000401:0x1:0x0] [ 1776.265859] Lustre: lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 1776.269233] Lustre: Skipped 2 previous similar messages [ 1776.270182] Lustre: lustre-MDT0000: Recovery over after 1:00, of 3 clients 2 recovered and 1 was evicted. [ 1776.286995] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:80 to 0x280000401:577) [ 1776.287174] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:47 to 0x2c0000401:545) [ 1785.831742] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1785.835554] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1785.836984] Lustre: Skipped 3 previous similar messages [ 1785.839144] Lustre: Skipped 2 previous similar messages [ 1791.040083] Lustre: server umount lustre-OST0000 complete [ 1794.016688] LustreError: lustre-OST0001-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1796.068519] LustreError: 100401:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1796.073287] LustreError: 100401:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 17 previous similar messages [ 1798.486537] Lustre: server umount lustre-OST0001 complete [ 1805.911817] Lustre: server umount lustre-MDT0000 complete [ 1807.248493] LustreError: 95811:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788905165 with bad export cookie 9031515626458125732 [ 1807.251138] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1807.253076] LustreError: 95811:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 1807.374195] Lustre: server umount lustre-MDT0001 complete [ 1810.479919] Lustre: DEBUG MARKER: == conf-sanity test 85: osd_ost init: fail ea_fid_set ==== 18:06:07 (1788905167) [ 1813.119617] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1813.122730] Lustre: *** cfs_fail_loc=197, val=0*** [ 1828.576726] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 1833.696556] LustreError: 103296:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.204.116@tcp: failed processing log, type 4: rc = -110 [ 1838.823205] Lustre: *** cfs_fail_loc=197, val=0*** [ 1838.824833] Lustre: Skipped 65 previous similar messages [ 1861.441764] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 1864.180471] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1864.993696] Lustre: server umount lustre-OST0000 complete [ 1868.078084] Lustre: DEBUG MARKER: == conf-sanity test 86: Replacing mkfs.lustre -G option == 18:07:05 (1788905225) [ 1882.004302] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1882.162912] LustreError: 104913:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1882.170383] LustreError: 104913:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 1883.579325] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 1887.429305] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1889.537707] LustreError: 104945:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x200000009:0x1:0x0]: rc = -5 [ 1889.541391] LustreError: 104945:0:(lod_sub_object.c:917:lod_sub_prep_llog()) lustre-MDT0000-mdtlov: can't get id from catalogs: rc = -5 [ 1889.545776] LustreError: 104945:0:(lod_dev.c:511:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 7, retries 0, failed: rc = -5 [ 1889.664267] Lustre: server umount lustre-MDT0000 complete [ 1900.947530] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_hostid [ 1904.412161] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 1916.789402] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1916.881528] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1916.896487] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1916.937232] Lustre: lustre-MDT0000: new disk, initializing [ 1916.968323] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1918.447168] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 1922.902515] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1922.950894] Lustre: 109115:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1923.071382] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1924.661261] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 1928.767672] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1930.831804] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 1933.297627] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1933.408123] Lustre: 111082:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1935.628053] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 1938.988480] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1939.737964] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1941.354095] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1941.444592] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1943.059219] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1943.147685] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1944.037122] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1944.038882] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1944.041692] Lustre: Skipped 4 previous similar messages [ 1944.045142] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1944.047710] Lustre: Skipped 9 previous similar messages [ 1945.959408] Lustre: server umount lustre-OST0000 complete [ 1953.494468] Lustre: server umount lustre-MDT0000 complete [ 1954.272782] LustreError: 109916:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1954.278185] LustreError: 109916:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 1954.769270] LustreError: 109910:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788905312 with bad export cookie 9031515626458136414 [ 1954.771572] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1954.774571] LustreError: 109910:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 1954.889679] Lustre: server umount lustre-MDT0001 complete [ 1957.730517] Lustre: DEBUG MARKER: == conf-sanity test 87: check if MDT inode can hold EAs with N stripes properly ========================================================== 18:08:35 (1788905315) [ 1960.735930] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing unload_modules_local [ 1961.773191] Key type lgssc unregistered [ 1961.899471] LNet: 113566:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1961.902022] LNetError: 113566:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1961.909257] LNet: Removed LNI 192.168.204.116@tcp [ 1962.201683] Key type .llcrypt unregistered [ 1962.203323] Key type ._llcrypt unregistered [ 1968.186423] Key type ._llcrypt registered [ 1968.187781] Key type .llcrypt registered [ 1968.230873] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_hostid [ 1974.482062] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 1974.783907] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1974.793642] alg: No test for adler32 (adler32-zlib) [ 1975.648787] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 1975.741091] LNet: Added LNI 192.168.204.116@tcp [8/256/0/180] [ 1977.320122] Key type lgssc registered [ 1977.673750] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1991.225644] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1991.232865] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1992.317781] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1992.331406] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1992.370085] Lustre: lustre-MDT0000: new disk, initializing [ 1992.393464] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1992.400566] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1993.860712] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 1998.075719] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1998.194212] Lustre: lustre-OST0000: new disk, initializing [ 1998.196181] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1998.198048] Lustre: Skipped 1 previous similar message [ 1998.200542] Lustre: 117712:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1998.226895] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1999.173765] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 1999.177443] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 1999.188381] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 2000.325882] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 2004.629842] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2004.692342] Lustre: lustre-OST0001: new disk, initializing [ 2004.694429] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 2004.697757] Lustre: 118575:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2004.725081] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 2006.787857] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 2007.000588] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost [ 2007.005182] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] [ 2007.015832] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 [ 2012.130839] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2012.131478] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2012.135337] Lustre: Skipped 1 previous similar message [ 2017.076908] Lustre: server umount lustre-MDT0000 complete [ 2019.362232] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null) [ 2020.962460] LustreError: 117711:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788905378 with bad export cookie 10029127636295979676 [ 2020.965131] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2020.967064] LustreError: 117711:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 2020.994729] Lustre: server umount lustre-OST0000 complete [ 2022.305309] Lustre: server umount lustre-OST0001 complete [ 2025.075627] Lustre: DEBUG MARKER: == conf-sanity test 88a: tunefs.lustre persists a --mountfsoptions-only change ========================================================== 18:09:42 (1788905382) [ 2032.215764] Lustre: DEBUG MARKER: == conf-sanity test 88b: check the default mount options can be overridden ========================================================== 18:09:49 (1788905389) [ 2035.333530] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 2042.690674] Lustre: DEBUG MARKER: == conf-sanity test 89: check tunefs --param and --erase-param{s} options ========================================================== 18:10:00 (1788905400) [ 2055.138527] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_hostid [ 2058.219973] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 2070.237674] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2070.323432] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2070.336463] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2070.371714] Lustre: lustre-MDT0000: new disk, initializing [ 2070.391373] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2070.399096] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2071.755188] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 2075.854891] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2075.893707] Lustre: 126311:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2075.913411] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 2075.915078] Lustre: Skipped 1 previous similar message [ 2075.947157] Lustre: lustre-MDT0001: new disk, initializing [ 2075.975685] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2075.987791] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 2075.991315] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2077.298390] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 2080.905251] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2082.683190] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2084.927057] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2085.024342] Lustre: lustre-OST0000: new disk, initializing [ 2085.026587] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 2085.028766] Lustre: 128278:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2085.056248] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2085.939495] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 2085.943342] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2085.971162] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2087.035132] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 2090.689443] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount (FULL|IDLE) failover.node=192.0.2.254@tcp0,osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2092.132916] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2092.207767] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2093.588455] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2093.654768] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2096.098474] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2096.099681] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2096.105251] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2096.109541] Lustre: Skipped 2 previous similar messages [ 2100.369172] Lustre: server umount lustre-OST0000 complete [ 2101.728698] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2101.731116] LustreError: Skipped 1 previous similar message [ 2101.732346] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2101.736177] Lustre: Skipped 1 previous similar message [ 2101.738270] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2106.336875] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2106.337496] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2107.803939] Lustre: server umount lustre-MDT0000 complete [ 2108.973206] LustreError: 128277:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788905466 with bad export cookie 10029127636295980887 [ 2108.975947] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2108.977077] LustreError: 128277:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2109.097340] Lustre: server umount lustre-MDT0001 complete [ 2111.800868] Lustre: DEBUG MARKER: == conf-sanity test 90a: check max_mod_rpcs_in_flight is enforced ========================================================== 18:11:09 (1788905469) [ 2113.904910] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2114.063881] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2115.373331] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 2118.235869] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2119.840749] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 2122.306234] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2124.075045] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2126.260989] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2128.243848] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 2130.620274] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2143.067076] Lustre: *** cfs_fail_loc=159, val=0*** [ 2158.429198] Lustre: lustre-MDT0000: Client 3eb52194-6261-4493-97cf-547abd38fee9 (at 192.168.204.16@tcp) reconnecting [ 2158.948311] Lustre: *** cfs_fail_loc=159, val=0*** [ 2158.950296] Lustre: Skipped 5 previous similar messages [ 2174.307467] Lustre: lustre-MDT0000: Client 3eb52194-6261-4493-97cf-547abd38fee9 (at 192.168.204.16@tcp) reconnecting [ 2179.552877] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2179.555966] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2179.561072] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2179.563453] Lustre: Skipped 1 previous similar message [ 2181.647044] Lustre: server umount lustre-OST0000 complete [ 2185.184861] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2185.187587] LustreError: Skipped 1 previous similar message [ 2189.074530] Lustre: server umount lustre-MDT0000 complete [ 2190.356164] LustreError: 130669:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788905548 with bad export cookie 10029127636295981755 [ 2190.359119] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2190.360607] LustreError: 130669:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2190.484205] Lustre: server umount lustre-MDT0001 complete [ 2194.107218] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing unload_modules_local [ 2195.167706] Key type lgssc unregistered [ 2195.305488] LNet: 134475:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2195.308489] LNetError: 134475:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2195.315990] LNet: Removed LNI 192.168.204.116@tcp [ 2195.644741] Key type .llcrypt unregistered [ 2195.646034] Key type ._llcrypt unregistered [ 2204.883228] Key type ._llcrypt registered [ 2204.884280] Key type .llcrypt registered [ 2204.922320] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 2205.266542] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2205.355427] alg: No test for adler32 (adler32-zlib) [ 2206.202605] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 2206.294402] LNet: Added LNI 192.168.204.116@tcp [8/256/0/180] [ 2207.896408] Key type lgssc registered [ 2208.344512] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2212.468441] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2212.484710] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2213.780959] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2217.558517] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 2223.076000] LustreError: 135868:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2223.100278] LustreError: 135868:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 2225.016263] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2225.244447] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2229.054477] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 2238.202785] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2244.618882] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2253.177887] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2253.724816] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2258.888856] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:42 to 0x280000401:65) [ 2262.781609] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 2272.537408] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2280.157506] Lustre: *** cfs_fail_loc=159, val=0*** [ 2296.694158] Lustre: lustre-MDT0000: Client 47efcb49-2fbb-4f54-8c45-92a1450118ad (at 192.168.204.16@tcp) reconnecting [ 2298.104626] Lustre: *** cfs_fail_loc=159, val=0*** [ 2314.607529] Lustre: lustre-MDT0001: Client 47efcb49-2fbb-4f54-8c45-92a1450118ad (at 192.168.204.16@tcp) reconnecting [ 2315.562257] Lustre: *** cfs_fail_loc=159, val=0*** [ 2315.566046] Lustre: Skipped 4 previous similar messages [ 2332.013803] Lustre: lustre-MDT0001: Client 47efcb49-2fbb-4f54-8c45-92a1450118ad (at 192.168.204.16@tcp) reconnecting [ 2334.441529] Lustre: 138906:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 2336.264625] Lustre: *** cfs_fail_loc=159, val=0*** [ 2336.266531] Lustre: Skipped 3 previous similar messages [ 2352.507730] Lustre: lustre-MDT0000: Client 6857cbd9-ec25-4ef1-8402-874390ce8c4d (at 192.168.204.16@tcp) reconnecting [ 2353.450965] Lustre: *** cfs_fail_loc=159, val=0*** [ 2353.455077] Lustre: Skipped 14 previous similar messages [ 2369.892448] Lustre: lustre-MDT0000: Client 6857cbd9-ec25-4ef1-8402-874390ce8c4d (at 192.168.204.16@tcp) reconnecting [ 2370.754401] Lustre: 139200:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 2376.167210] LustreError: lustre-OST0000-osc-MDT0000: operation ost_destroy to node 0@lo failed: rc = -107 [ 2376.172396] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2376.180949] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2377.191295] LustreError: lustre-OST0000-osc-MDT0001: operation ost_destroy to node 0@lo failed: rc = -107 [ 2377.197142] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2377.207867] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2379.584289] Lustre: server umount lustre-OST0000 complete [ 2382.819814] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2382.821670] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2382.826369] Lustre: Skipped 1 previous similar message [ 2382.834880] Lustre: Skipped 2 previous similar messages [ 2387.938738] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2387.943798] Lustre: Skipped 1 previous similar message [ 2393.059446] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2393.068595] Lustre: Skipped 1 previous similar message [ 2396.128144] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2397.156597] LustreError: 137498:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2397.168681] LustreError: 137498:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 2398.265199] Lustre: server umount lustre-MDT0000 complete [ 2400.261757] LustreError: 139033:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788905758 with bad export cookie 10006519492157724407 [ 2400.266625] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2400.268310] LustreError: 139033:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2400.419639] Lustre: server umount lustre-MDT0001 complete [ 2406.523663] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing unload_modules_local [ 2408.260089] Key type lgssc unregistered [ 2408.456791] LNet: 140251:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2408.460935] LNetError: 140251:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2408.475663] LNet: Removed LNI 192.168.204.116@tcp [ 2409.038082] Key type .llcrypt unregistered [ 2409.039894] Key type ._llcrypt unregistered [ 2423.414378] Key type ._llcrypt registered [ 2423.416375] Key type .llcrypt registered [ 2423.489236] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 2424.147737] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2424.172632] alg: No test for adler32 (adler32-zlib) [ 2425.127929] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 2425.311245] LNet: Added LNI 192.168.204.116@tcp [8/256/0/180] [ 2426.928163] Key type lgssc registered [ 2427.758454] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2433.026644] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2433.047447] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2434.309809] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2436.913541] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 2442.584746] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2442.820626] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2445.490846] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 2450.476572] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2454.243139] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2459.063758] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2459.172688] LustreError: 143461:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2459.184043] LustreError: 143461:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 2459.343418] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2463.397451] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 2464.753417] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:129) [ 2467.710301] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2467.844546] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:97) [ 2471.700529] Lustre: 144223:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 2473.395873] Lustre: 144271:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 2474.261923] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 in log params [ 2474.797264] Lustre: Setting parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=8 in log params [ 2476.875627] Lustre: 144418:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre/mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 (mode = 0) failed: rc = -17 [ 2477.394438] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=7 in log params [ 2477.918994] Lustre: 144516:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 2480.098637] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2480.103537] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2480.112686] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2483.173168] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2483.178866] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2483.184525] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2486.080813] Lustre: server umount lustre-OST0000 complete [ 2488.803174] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2488.807722] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2488.823335] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2488.826388] Lustre: Skipped 1 previous similar message [ 2493.409487] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2493.410639] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2494.657962] Lustre: server umount lustre-MDT0000 complete [ 2496.738960] LustreError: 141623:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788905854 with bad export cookie 17138803661164993418 [ 2496.746073] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2496.746575] LustreError: 141623:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 2496.928173] Lustre: server umount lustre-MDT0001 complete [ 2502.973399] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing unload_modules_local [ 2504.589935] Key type lgssc unregistered [ 2504.761251] LNet: 145573:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2504.764939] LNetError: 145573:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2504.781215] LNet: Removed LNI 192.168.204.116@tcp [ 2505.235501] Key type .llcrypt unregistered [ 2505.237774] Key type ._llcrypt unregistered [ 2535.844406] Key type ._llcrypt registered [ 2535.846803] Key type .llcrypt registered [ 2535.989803] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 2537.490519] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2537.597954] alg: No test for adler32 (adler32-zlib) [ 2538.699740] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 2539.195662] LNet: Added LNI 192.168.204.116@tcp [8/256/0/180] [ 2541.009658] Key type lgssc registered [ 2543.705122] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2555.686227] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2555.726317] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2557.467989] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2564.763001] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 2567.651396] LustreError: 146992:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2567.678846] LustreError: 146992:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 2572.789582] LustreError: 146993:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2577.890683] LustreError: 146992:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2581.630888] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2582.699125] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2591.314709] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 2600.775726] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2607.653476] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2615.451853] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2615.833312] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2622.996386] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 2627.136540] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:129) [ 2628.150899] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:161) [ 2631.752094] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2638.370906] Lustre: *** cfs_fail_loc=159, val=0*** [ 2654.647543] Lustre: lustre-MDT0000: Client 3e949513-80ea-4f76-9542-ea4b0d465c85 (at 192.168.204.16@tcp) reconnecting [ 2662.881356] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2662.892579] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2662.910053] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2663.910886] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2663.912216] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2663.937980] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2666.593178] Lustre: server umount lustre-OST0000 complete [ 2674.145754] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2674.160362] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2674.179414] Lustre: Skipped 2 previous similar messages [ 2676.875308] Lustre: server umount lustre-MDT0000 complete [ 2679.269608] LustreError: 146992:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2679.284262] LustreError: 146992:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 2681.237480] LustreError: 146972:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788906039 with bad export cookie 12545810970954541323 [ 2681.238278] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2681.246037] LustreError: 146972:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 2681.553573] Lustre: server umount lustre-MDT0001 complete [ 2693.380685] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing unload_modules_local [ 2696.348518] Key type lgssc unregistered [ 2696.754975] LNet: 150661:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2696.766607] LNetError: 150661:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2696.793378] LNet: Removed LNI 192.168.204.116@tcp [ 2697.793407] Key type .llcrypt unregistered [ 2697.803173] Key type ._llcrypt unregistered [ 2723.171598] Key type ._llcrypt registered [ 2723.174338] Key type .llcrypt registered [ 2723.266865] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 2724.268204] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2724.487168] alg: No test for adler32 (adler32-zlib) [ 2725.740315] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 2726.031419] LNet: Added LNI 192.168.204.116@tcp [8/256/0/180] [ 2727.816259] Key type lgssc registered [ 2729.028616] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2737.799044] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2737.836921] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2739.390527] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2744.618573] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 2749.924701] LustreError: 152076:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2749.954873] LustreError: 152076:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 2754.227704] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2754.727908] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2759.955717] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 2768.298375] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2775.039893] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2783.593964] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2784.050590] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2785.110661] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:170 to 0x280000401:193) [ 2791.641495] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 2799.422570] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:161) [ 2800.582359] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2822.175380] Lustre: lustre-OST0000: evicting 45bafcc3-540c-4e4b-b4f0-1a7d4f5463ee (at 192.168.204.16@tcp) by administrative request [ 2822.189617] Lustre: Skipped 1 previous similar message [ 2851.821810] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2851.835810] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2851.855685] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2855.916666] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2855.921776] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2855.922298] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2855.950404] Lustre: Skipped 1 previous similar message [ 2857.886400] Lustre: server umount lustre-OST0000 complete [ 2866.148743] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2866.171218] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2866.180220] Lustre: Skipped 1 previous similar message [ 2868.650188] Lustre: server umount lustre-MDT0000 complete [ 2871.268197] LustreError: 152077:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2871.281856] LustreError: 152077:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 2872.361146] LustreError: 152056:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788906230 with bad export cookie 2278096643710856531 [ 2872.367791] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2872.374420] LustreError: 152056:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 2872.790864] Lustre: server umount lustre-MDT0001 complete [ 2884.062792] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing unload_modules_local [ 2886.725623] Key type lgssc unregistered [ 2887.000825] LNet: 156146:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2887.010063] LNetError: 156146:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2887.026465] LNet: Removed LNI 192.168.204.116@tcp [ 2887.803416] Key type .llcrypt unregistered [ 2887.805283] Key type ._llcrypt unregistered [ 2964.579742] Key type ._llcrypt registered [ 2964.583899] Key type .llcrypt registered [ 2964.721518] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 2965.813676] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2966.020091] alg: No test for adler32 (adler32-zlib) [ 2967.170844] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 2967.503538] LNet: Added LNI 192.168.204.116@tcp [8/256/0/180] [ 2969.240580] Key type lgssc registered [ 2970.645673] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2979.587529] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2979.605842] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2981.170086] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2986.817986] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 2991.588419] LustreError: 158635:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2991.603878] LustreError: 158635:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 2996.572213] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2996.709412] LustreError: 158636:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2997.183392] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3002.513764] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 3011.094828] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3017.192801] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3024.375353] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3024.718834] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3026.827345] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:195 to 0x280000401:225) [ 3031.775463] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 3039.867474] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3041.152835] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:193) [ 3051.491664] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3051.493679] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3051.526157] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3051.551210] Lustre: Skipped 1 previous similar message [ 3054.904713] Lustre: server umount lustre-OST0000 complete [ 3058.657662] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3058.666509] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3058.677052] Lustre: Skipped 1 previous similar message [ 3058.682231] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3061.730730] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3061.732368] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3061.754024] Lustre: Skipped 1 previous similar message [ 3064.622262] Lustre: server umount lustre-MDT0000 complete [ 3066.856557] LustreError: 158631:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3066.873496] LustreError: 158631:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 3070.075041] LustreError: 158615:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788906428 with bad export cookie 505296849234954719 [ 3070.088565] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3070.555199] Lustre: server umount lustre-MDT0001 complete [ 3084.498953] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing unload_modules_local [ 3088.377964] Key type lgssc unregistered [ 3088.851763] LNet: 162180:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3088.862302] LNetError: 162180:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3088.875825] LNet: Removed LNI 192.168.204.116@tcp [ 3090.059462] Key type .llcrypt unregistered [ 3090.064207] Key type ._llcrypt unregistered [ 3126.495953] Key type ._llcrypt registered [ 3126.499756] Key type .llcrypt registered [ 3126.628829] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 3127.833802] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3127.979610] alg: No test for adler32 (adler32-zlib) [ 3129.147891] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 3129.524277] LNet: Added LNI 192.168.204.116@tcp [8/256/0/180] [ 3131.264181] Key type lgssc registered [ 3132.610788] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3151.537314] Lustre: DEBUG MARKER: == conf-sanity test 100: check lshowmount lists MGS, MDT, OST and 0@lo ========================================================== 18:28:27 (1788906507) [ 3170.964612] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_hostid [ 3183.202435] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 3226.966257] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3227.013457] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3228.287301] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3228.348793] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3228.460985] Lustre: lustre-MDT0000: new disk, initializing [ 3228.577240] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3228.609979] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3233.975826] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 3245.961562] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3246.123873] Lustre: 166465:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 3246.236969] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 3246.245438] Lustre: Skipped 1 previous similar message [ 3246.339702] Lustre: lustre-MDT0001: new disk, initializing [ 3246.437689] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3246.474854] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 3246.491714] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 3252.004334] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 3263.343600] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3269.773396] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3276.749655] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3277.070825] Lustre: lustre-OST0000: new disk, initializing [ 3277.073933] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3277.082198] Lustre: 168434:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3277.162962] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3283.677438] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 3284.022040] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 3284.036062] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 3284.182679] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 3292.786240] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3304.931757] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3304.934440] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3304.946790] LustreError: Skipped 1 previous similar message [ 3304.947989] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3304.978446] Lustre: Skipped 1 previous similar message [ 3310.054812] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3310.062964] Lustre: Skipped 2 previous similar messages [ 3315.177598] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3315.190054] Lustre: Skipped 1 previous similar message [ 3316.193957] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 3316.447887] Lustre: server umount lustre-OST0000 complete [ 3320.289635] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3320.304211] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3320.309085] Lustre: Skipped 1 previous similar message [ 3325.409775] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3325.414715] Lustre: Skipped 1 previous similar message [ 3325.834710] Lustre: server umount lustre-MDT0000 complete [ 3329.163776] LustreError: 166457:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788906687 with bad export cookie 4268402530196151869 [ 3329.170423] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3329.182764] LustreError: 166457:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 3329.486908] Lustre: server umount lustre-MDT0001 complete [ 3338.964793] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing unload_modules_local [ 3341.577458] Key type lgssc unregistered [ 3341.910233] LNet: 170340:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3341.923729] LNetError: 170340:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3341.940388] LNet: Removed LNI 192.168.204.116@tcp [ 3342.690358] Key type .llcrypt unregistered [ 3342.694176] Key type ._llcrypt unregistered [ 3366.550506] Key type ._llcrypt registered [ 3366.555868] Key type .llcrypt registered [ 3366.697640] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 3367.780841] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3367.797373] alg: No test for adler32 (adler32-zlib) [ 3368.924469] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 3369.168646] LNet: Added LNI 192.168.204.116@tcp [8/256/0/180] [ 3370.864319] Key type lgssc registered [ 3372.099033] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3380.268225] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3380.297254] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3381.781544] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3386.133442] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 3391.974240] LustreError: 171753:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3392.002324] LustreError: 171753:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 3395.375787] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3395.636159] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3400.330807] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 3407.633473] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3413.541829] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3420.995212] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3421.432449] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3426.564162] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:33) [ 3428.761674] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 3436.452256] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3446.620972] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3446.640741] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3446.654862] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3446.662315] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3446.680347] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3447.320795] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3447.344564] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3447.364375] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3447.373393] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3447.388874] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3448.132759] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3448.972951] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3448.984233] Lustre: Skipped 1 previous similar message [ 3449.003334] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3449.011600] Lustre: Skipped 1 previous similar message [ 3449.015960] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3449.020985] Lustre: Skipped 1 previous similar message [ 3449.025240] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3449.033975] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3449.045518] Lustre: Skipped 1 previous similar message [ 3449.894458] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3450.739251] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3451.622144] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3451.633414] Lustre: Skipped 2 previous similar messages [ 3451.658931] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3451.667729] Lustre: Skipped 2 previous similar messages [ 3451.674862] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3451.681311] Lustre: Skipped 2 previous similar messages [ 3451.684026] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3451.694682] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3451.700423] Lustre: Skipped 2 previous similar messages [ 3452.493491] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3453.285445] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3454.151303] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3455.151463] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3456.013200] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3456.020217] Lustre: Skipped 4 previous similar messages [ 3456.034572] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3456.047677] Lustre: Skipped 4 previous similar messages [ 3456.052705] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3456.060670] Lustre: Skipped 4 previous similar messages [ 3456.067140] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3456.080137] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3456.088249] Lustre: Skipped 4 previous similar messages [ 3457.022183] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3457.833315] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3458.815480] LustreError: 171773:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 3458.828607] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3458.834149] LustreError: 171773:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 3459.740631] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3460.683830] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3461.472579] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3462.298922] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3463.089127] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3463.987650] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3464.782973] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3464.790759] Lustre: Skipped 9 previous similar messages [ 3464.808779] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3464.832693] Lustre: Skipped 9 previous similar messages [ 3464.836816] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3464.840932] Lustre: Skipped 9 previous similar messages [ 3464.846656] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3464.855540] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3464.862902] Lustre: Skipped 9 previous similar messages [ 3465.708565] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3466.660233] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3467.699619] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3468.660504] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3469.665852] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3470.612934] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3471.681603] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3472.682598] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3473.750543] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3474.884267] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3475.876310] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3477.113901] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3478.006295] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3479.066193] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3479.989072] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3481.068858] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3481.074893] Lustre: Skipped 15 previous similar messages [ 3481.101711] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3481.117241] Lustre: Skipped 15 previous similar messages [ 3481.124557] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3481.131372] Lustre: Skipped 15 previous similar messages [ 3481.137063] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3481.149451] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3481.161767] Lustre: Skipped 15 previous similar messages [ 3482.085822] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3483.103042] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3484.105534] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3485.032035] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3485.973707] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3486.932980] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3487.912655] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3488.881307] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3489.826268] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3490.913216] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3491.987979] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3493.012739] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3494.138107] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3495.018687] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3496.059398] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3496.955325] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3498.028639] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3499.009241] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3499.897081] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3500.811150] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3501.619615] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3502.696337] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3503.557728] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3504.717691] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3505.519046] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3506.474995] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3507.320148] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3508.243216] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3509.315837] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3510.548299] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3511.467614] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3512.420070] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3513.336197] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3513.342996] Lustre: Skipped 32 previous similar messages [ 3513.357702] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3513.371677] Lustre: Skipped 32 previous similar messages [ 3513.385455] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3513.397085] Lustre: Skipped 32 previous similar messages [ 3513.403697] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3513.425784] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3513.444653] Lustre: Skipped 32 previous similar messages [ 3514.398728] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3515.351347] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3516.240705] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3517.147513] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3518.160106] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3519.242389] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3520.141369] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3521.148648] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3522.163705] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3523.401779] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3524.471522] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3525.442666] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3526.302065] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3527.296461] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3528.312221] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3529.215453] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3530.288637] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3531.104904] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3531.918343] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3532.889093] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3533.877442] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3534.731268] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3535.655900] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3536.613771] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3537.527558] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3538.501389] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3539.447914] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3540.513215] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3541.430111] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3542.459927] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3543.342125] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3544.469324] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3545.485744] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3546.504504] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3547.549579] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3548.549100] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3549.544938] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3550.422288] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3551.538218] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3552.485922] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3553.489631] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3554.438088] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3555.399448] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3556.325716] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3557.147193] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3558.144779] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3559.116185] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3559.940888] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3561.010296] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3562.030728] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3562.903607] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3563.633500] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3564.447080] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3565.257846] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3566.151810] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3567.117244] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3567.996292] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3568.975476] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3569.785330] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3570.719233] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3571.580253] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3572.370863] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3573.118937] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3573.945332] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3574.645959] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3575.363230] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3576.088978] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3576.879737] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3577.679623] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3577.685443] Lustre: Skipped 68 previous similar messages [ 3577.703633] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3577.711891] Lustre: Skipped 68 previous similar messages [ 3577.715747] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3577.719596] Lustre: Skipped 68 previous similar messages [ 3577.723431] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3577.729937] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3577.739359] Lustre: Skipped 68 previous similar messages [ 3578.766563] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3579.647974] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3580.510569] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3581.337751] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3582.178269] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3583.041712] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3583.972180] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3584.769190] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3585.586918] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3586.400098] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3587.157258] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3587.817675] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3588.529641] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3589.185281] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3589.968738] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3590.663631] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3591.422832] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3592.210157] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3592.969074] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3593.569297] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3594.296891] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3594.954468] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3595.696556] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3596.306593] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3596.993236] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3597.668712] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3598.305577] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3599.065841] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3599.839087] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3600.552308] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3601.311074] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3602.114174] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3602.932121] LustreError: 171773:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 3602.942993] LustreError: 171773:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 3602.953565] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3603.692670] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3604.626989] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3605.423712] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3606.303407] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3607.135771] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3607.847423] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3608.574031] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3609.303860] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3610.255981] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3611.107044] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3611.926125] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3612.807164] LustreError: 171773:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 3612.822623] LustreError: 171773:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 3612.826625] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3613.730828] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3614.704934] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3615.487325] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3616.419936] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3617.179267] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3617.983386] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3618.803918] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3619.679706] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3620.558492] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3621.376045] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3622.102927] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3622.824399] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3623.532324] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3624.440988] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3625.273477] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3626.001535] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3626.812490] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3627.622653] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3628.463867] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3629.205433] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3629.915808] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3630.560465] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3631.386570] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3632.168585] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3632.972781] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3633.813740] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3634.580272] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3635.326258] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3636.107256] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3636.863233] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3637.617333] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3638.380395] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3639.141128] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3639.932066] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3640.689352] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3641.428187] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3642.200499] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3643.004929] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3643.891996] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3644.655411] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3645.434141] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3646.173447] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3646.974374] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3647.737546] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3648.706989] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3649.520223] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3650.429412] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3651.339940] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3652.155240] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3653.005261] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3653.891770] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3654.734185] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3655.587764] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3656.336516] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3657.156574] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3657.809540] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3658.595646] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3659.258207] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3659.963125] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3660.656710] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3661.402197] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3662.084699] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3662.838231] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3663.571602] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3664.166802] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3664.856178] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3665.482446] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3666.135470] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3666.810439] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3667.501643] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3668.218904] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3668.873085] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3669.604808] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3670.227355] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3670.885094] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3671.575771] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3672.329533] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3672.985349] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3673.597108] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3674.214423] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3674.796781] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3675.346522] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3675.987279] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3676.622703] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3677.202715] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3677.755394] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3678.329983] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3678.865275] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3679.502257] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3680.171016] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3680.778332] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3681.322304] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3681.977116] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3682.674749] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3683.314355] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3684.085500] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3684.816609] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3685.594538] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3686.234544] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3686.856136] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3687.535882] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3688.216562] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3688.912523] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3689.539380] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3690.153386] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3690.921883] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3691.683496] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3692.275872] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3692.953690] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3693.597557] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3694.169499] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3694.885101] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3695.604490] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3696.273901] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3696.877488] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3697.589899] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3698.268926] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3698.942238] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3699.512705] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3700.204671] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3700.976884] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3701.693491] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3702.390727] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3703.110340] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3703.802530] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3704.638721] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3705.304609] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3706.010394] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3706.020573] Lustre: Skipped 172 previous similar messages [ 3706.032772] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3706.039216] Lustre: Skipped 172 previous similar messages [ 3706.041537] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3706.044694] Lustre: Skipped 172 previous similar messages [ 3706.048239] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3706.054729] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3706.058394] Lustre: Skipped 172 previous similar messages [ 3706.693635] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3707.448888] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3708.102123] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3708.799793] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3709.495688] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3710.378678] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3711.198950] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3711.942314] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3712.718593] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3713.557343] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3714.250619] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3715.003513] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3715.622699] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3716.250986] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3716.984166] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3717.809370] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3718.495126] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3719.192787] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3719.844318] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3720.548947] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3721.158617] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3721.747631] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3722.435180] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3723.067074] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3723.838632] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3724.502823] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3725.248214] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3725.942293] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3726.697145] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3727.292949] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3727.983936] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3728.648094] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3729.277698] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3729.935935] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3730.660793] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3731.341697] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3732.014913] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3732.561332] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3733.141652] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3733.742581] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3734.373874] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3734.949789] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3735.579838] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3736.251358] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3736.910053] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3737.523523] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3738.142410] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3738.778828] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3739.545366] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3740.148448] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3740.770132] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3741.379665] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3741.991598] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3742.625753] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3743.236949] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3743.880864] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3744.582268] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3745.349921] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3746.010038] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3746.660321] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3747.434441] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3748.190901] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3748.896918] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3749.546446] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3750.218292] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3750.832776] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3751.494524] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3752.216834] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3752.791275] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3753.397716] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3754.037286] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3754.625495] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3755.265596] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3755.960712] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3756.668938] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3757.340068] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3757.958455] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3758.635282] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3759.341503] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3760.009715] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3760.693625] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3761.364634] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3762.009436] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3762.602758] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3763.315592] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3763.941993] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3764.604905] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3765.270917] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3765.969345] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3766.644274] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3767.390955] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3768.071425] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3768.695521] LustreError: 171773:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 3768.702967] LustreError: 171773:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 3768.706424] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3769.399710] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3770.169672] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3770.869836] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3771.527625] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3772.217481] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3772.895074] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3773.600730] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3774.235969] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3774.965472] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3775.778614] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3776.487597] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3777.164789] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3777.923337] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3778.646903] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3779.422117] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3780.204329] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3781.048961] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3781.958764] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3782.699921] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3783.363496] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3784.177884] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3784.874227] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3785.628632] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3786.359706] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3787.213334] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3787.989172] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3788.706346] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3789.393049] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3790.195949] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3790.918342] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3791.642995] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3792.316234] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3793.036029] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3793.691607] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3794.457185] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3795.078296] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3795.651803] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3796.270846] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3796.893215] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3797.526510] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3798.211162] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3798.870527] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3799.676509] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3800.366609] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3801.149271] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3801.911515] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3802.626089] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3803.341290] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3804.164544] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3804.962551] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3805.896688] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3806.686531] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3807.592955] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3808.476566] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3809.407534] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3810.261991] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3811.207449] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3812.079642] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3812.985484] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3813.734364] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3814.549318] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3815.283533] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3815.944140] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3816.634694] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3817.365862] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3818.065229] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3818.738516] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3819.414547] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3820.155294] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3820.844486] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3821.521236] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3822.247579] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3822.975177] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3823.726775] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3824.559126] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3825.267776] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3826.002290] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3826.664468] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3827.339154] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3828.048817] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3828.756240] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3829.428605] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3830.251545] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3831.077522] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3831.898578] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3832.635550] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3833.343748] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3834.192446] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3834.948689] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3835.670239] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3836.466562] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3837.201594] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3838.012375] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3838.692903] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3839.408185] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3840.069402] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3840.792879] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3841.525135] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3842.207983] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3843.037157] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3843.846627] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3844.647029] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3845.406374] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3846.060515] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3846.910030] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3847.571427] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3848.338197] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3848.988503] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3849.685626] LustreError: 171773:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 3849.690332] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3849.692682] LustreError: 171773:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 3850.473939] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3851.202548] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3851.925457] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3852.699362] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3853.458938] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3854.322479] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3855.133180] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3855.961616] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3856.823314] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3857.514906] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3858.211926] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3858.853281] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3859.664330] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3860.367650] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3861.036614] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3861.738732] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3862.496487] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3863.216955] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3863.936363] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3864.581604] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3865.411560] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3866.170447] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3866.999787] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3867.724776] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3868.419750] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3869.138547] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3869.841966] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3870.648067] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3871.410227] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3872.156902] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3872.985728] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3873.901743] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3874.742541] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3875.514231] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3876.240212] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3876.917314] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3877.590605] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3878.233263] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3879.004342] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3879.783531] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3880.569312] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3881.282265] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3882.006325] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3882.598781] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3883.325609] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3884.090839] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3884.840404] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3885.499397] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3886.254969] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3886.904123] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3887.612939] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3888.211768] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3888.796611] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3889.416451] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3890.057532] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3890.647168] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3891.310919] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3891.847759] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3892.512714] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3893.106782] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3893.813271] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3894.477992] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3895.197603] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3895.735720] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3896.338429] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3897.019788] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3897.782359] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3898.439798] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3899.163635] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3899.774630] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3900.377973] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3901.018917] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3901.713605] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3902.344293] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3902.966298] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3903.807772] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3904.608710] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3905.265650] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3906.038978] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3906.665700] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3907.348355] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3908.085098] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3908.936298] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3909.734636] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3910.745788] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3911.531478] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3912.706278] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3913.635439] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3914.585518] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3915.877083] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3917.095429] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3918.753076] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3920.342534] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3921.650229] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3923.029559] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3924.820282] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3926.097859] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3927.250724] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3928.367177] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3929.597816] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3930.808299] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3932.095333] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3933.268811] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3934.565089] LustreError: 171773:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -108 [ 3934.572803] LustreError: 171773:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -108 [ 3934.589178] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3935.648489] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3936.946144] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3937.967303] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3939.333407] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3940.449447] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3942.033668] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3943.100933] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3944.417335] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3945.545372] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3946.955215] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3947.912121] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3949.395430] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3950.605137] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3952.243759] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3953.829336] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3955.027978] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3956.399755] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3957.807960] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3959.013076] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3960.311076] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3961.609232] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3962.801473] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3962.813245] Lustre: Skipped 327 previous similar messages [ 3962.836303] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3962.845360] Lustre: Skipped 327 previous similar messages [ 3962.848946] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3962.852642] Lustre: Skipped 327 previous similar messages [ 3962.855691] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3962.869630] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3962.883060] Lustre: Skipped 327 previous similar messages [ 3964.189079] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3965.248072] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3966.552826] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3967.792341] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3968.956624] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3970.109703] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3971.304762] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3972.309976] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3973.596102] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3974.993917] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3976.099127] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3977.271343] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3978.338302] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3979.712663] LustreError: 171773:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 3979.732746] LustreError: 171773:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 3979.742288] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3981.013543] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3982.070958] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3983.132303] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3984.035316] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3984.974424] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3986.101315] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3987.206168] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3988.306683] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3989.295727] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3990.441463] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3991.461650] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3992.440363] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3993.408351] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3994.567122] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3995.617295] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3996.799701] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3997.956753] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3999.180562] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4000.252700] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4001.290076] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4002.238678] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4003.503400] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4004.654688] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4005.673913] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4006.808568] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4007.870426] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4008.906548] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4009.859544] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4010.624699] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4011.456862] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4012.127911] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4012.944685] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4013.838636] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4014.738045] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4015.545485] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4016.329037] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4017.270327] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4018.194101] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4019.033678] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4019.819061] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4020.628276] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4021.558301] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4022.476636] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4023.246583] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4024.269689] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4025.211067] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4026.040165] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4026.769369] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4027.686561] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4028.479183] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4029.419611] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4030.179255] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4031.055652] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4031.945446] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4032.836353] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4033.770366] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4034.833674] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4035.799135] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4036.755196] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4037.688901] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4038.559464] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4039.415568] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4040.358954] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4041.337314] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4042.080948] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4042.903516] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4043.657558] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4044.472486] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4045.438394] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4046.293583] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4047.169338] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4048.016494] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4048.828746] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4049.595895] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4050.457920] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4051.365180] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4052.326843] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4053.186751] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4054.089495] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4054.908958] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4055.809431] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4056.655381] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4057.561763] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4058.330828] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4059.322645] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4060.162422] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4060.966251] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4061.743294] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4062.609629] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4063.533160] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4064.519712] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4065.609570] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4066.603778] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4067.657856] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4068.600965] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4069.726932] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4070.923886] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4071.938556] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4072.897831] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4073.831415] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4074.948785] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4075.959361] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4076.988401] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4077.976084] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4078.808637] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4079.763973] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4080.669491] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4081.688848] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4082.598620] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4083.543720] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4084.364268] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4085.441242] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4086.581440] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4087.618538] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4088.623219] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4089.814936] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4090.802359] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4091.909605] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4092.928105] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4093.902353] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4094.930856] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4096.034761] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4096.933372] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4097.989751] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4098.957164] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4099.927549] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4100.981515] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4101.921839] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4103.098864] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4104.186439] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4105.096280] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4106.179957] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4107.383233] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4108.411799] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4109.432251] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4110.441071] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4111.583177] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4112.411017] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4113.391679] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4114.335683] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4115.289761] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4116.551077] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4117.537639] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4118.572530] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4119.807629] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4120.770379] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4121.719974] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4122.576303] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4123.657131] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4124.588561] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4125.694232] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4126.924241] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4128.120756] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4129.131183] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4130.034598] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4130.994327] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4132.042590] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4132.860199] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4133.760242] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4134.700074] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4135.661369] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4136.421973] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4137.331356] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4138.146969] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4139.236166] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4140.064695] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4141.113857] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4142.062770] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4143.040453] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4143.966377] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4144.958720] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4146.041901] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4146.973869] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4148.049831] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4148.952189] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4149.984863] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4151.074117] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4151.894144] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4152.686880] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4153.489765] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4154.312577] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4155.230606] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4156.174344] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4157.177953] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4158.185509] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4159.164790] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4160.263664] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4161.439735] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4162.385472] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4163.476897] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4164.414744] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4165.258774] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4166.043888] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4166.910797] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4167.740808] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4168.694861] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4169.570848] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4170.629747] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4171.617303] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4172.504202] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4173.492355] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4174.426293] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4175.241260] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4176.237978] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4177.243586] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4178.269218] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4179.136326] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4180.121288] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4181.044606] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4182.068366] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4182.786769] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4183.836050] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4184.759146] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4185.661701] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4186.640993] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4187.627637] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4188.559696] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4189.575585] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4190.510938] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4191.438809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4192.212070] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4193.006273] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4193.865590] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4194.823321] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4195.591820] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4196.634868] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4197.559750] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4198.609949] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4199.535740] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4200.538493] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4201.485396] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4202.418304] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4203.510433] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4204.428907] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4205.361629] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4206.427609] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4207.435219] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4208.360370] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4209.280591] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4210.250861] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4211.105090] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4211.986271] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4212.848883] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4213.601776] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4214.362883] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4215.305934] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4216.324547] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4217.179066] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4217.999208] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4218.859093] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4219.892149] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4220.741585] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4221.693390] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4222.659041] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4223.646862] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4224.679971] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4225.637147] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4226.690598] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4227.608185] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4228.653936] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4229.673757] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4230.902607] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4231.955333] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4233.085586] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4234.077965] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4235.234310] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4236.227689] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4237.379288] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4238.595619] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4239.693174] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4240.715106] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4241.761852] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4242.835334] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4243.836399] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4245.058972] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4246.134218] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4247.095599] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4248.042298] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4248.970602] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4250.055565] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4251.021768] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4252.140474] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4253.160553] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4254.173458] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4255.303207] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4256.203889] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4257.310193] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4258.369877] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4259.503278] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4260.377854] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4261.563843] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4262.621906] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4263.508478] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4264.300779] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4265.130485] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4265.936547] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4266.913278] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4267.817889] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4268.788567] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4269.698844] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4270.718112] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4271.700042] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4272.642933] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4273.695196] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4274.592343] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4275.615320] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4276.509832] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4277.482681] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4278.313695] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4279.434524] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4280.247399] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4281.143961] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4282.151474] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4283.062917] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4283.954833] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4285.076295] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4286.113547] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4287.274765] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4288.453683] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4289.652636] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4290.529537] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4291.447403] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4292.383257] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4293.525435] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4294.686314] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4295.765345] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4296.743040] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4297.722772] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4298.608321] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4299.432968] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4300.206749] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4301.012618] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4301.812162] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4302.463642] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4303.238510] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4304.213604] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4305.017275] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4305.771845] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4306.610622] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4307.360076] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4308.263888] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4309.096035] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4309.985096] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4310.844785] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4311.608561] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4681.722769] LustreError: 173827:0:(ofd_dev.c:1780:ofd_create_hdl()) lustre-OST0000: unable to precreate: rc = -28 [ 4681.739506] LustreError: 171773:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -28 [ 5066.212070] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5066.217177] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5066.219319] Lustre: Skipped 360 previous similar messages [ 5066.231655] Lustre: Skipped 1 previous similar message [ 5067.639128] Lustre: server umount lustre-OST0000 complete [ 5069.793119] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5069.799634] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5071.329987] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5071.335784] Lustre: Skipped 1 previous similar message [ 5075.861605] Lustre: server umount lustre-MDT0000 complete [ 5076.451187] LustreError: 172996:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5076.459886] LustreError: 172996:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 5078.045798] LustreError: 171734:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788908436 with bad export cookie 14509746200374358520 [ 5078.049640] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5078.052165] LustreError: 171734:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 5078.237136] Lustre: server umount lustre-MDT0001 complete [ 5085.290722] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing unload_modules_local [ 5087.009657] Key type lgssc unregistered [ 5087.196766] LNet: 226958:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5087.200496] LNetError: 226958:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5087.209708] LNet: Removed LNI 192.168.204.116@tcp [ 5087.650706] Key type .llcrypt unregistered [ 5087.651974] Key type ._llcrypt unregistered [ 5102.786266] Key type ._llcrypt registered [ 5102.789337] Key type .llcrypt registered [ 5102.851967] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 5103.392072] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5103.438302] alg: No test for adler32 (adler32-zlib) [ 5104.353924] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 5104.484285] LNet: Added LNI 192.168.204.116@tcp [8/256/0/180] [ 5106.104202] Key type lgssc registered [ 5106.685913] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5110.660388] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5110.673384] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5111.928364] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5114.242944] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 5119.249111] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5119.457346] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5121.796043] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 5126.303629] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 5130.031697] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 5134.724776] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5134.942383] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5137.003522] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49665 to 0x280000401:49696) [ 5138.772701] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 5142.985341] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 5147.527799] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5148.588414] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5148.598851] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5148.607695] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5148.614704] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5148.615141] LustreError: 228381:0:(osp_precreate.c:1268:osp_precreate_thread()) cfs_fail_timeout id 2107 sleeping for 20000ms [ 5150.563815] Lustre: lustre-OST0000: Not available for connect from 192.168.204.16@tcp (stopping) [ 5154.785352] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 5154.787149] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5154.790516] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5154.796460] Lustre: Skipped 1 previous similar message [ 5159.908586] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5159.916524] Lustre: Skipped 3 previous similar messages [ 5164.001766] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 5164.107312] Lustre: server umount lustre-OST0000 complete [ 5168.704181] LustreError: 228381:0:(osp_precreate.c:1268:osp_precreate_thread()) cfs_fail_timeout id 2107 awake [ 5194.573706] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5194.804623] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5198.691712] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 5204.218727] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 5209.125592] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5209.129866] LustreError: lustre-OST0000-osc-MDT0001: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5209.140834] Lustre: lustre-OST0000-osc-MDT0001: Connection restored to 0@lo (at 0@lo) [ 5209.150944] Lustre: Skipped 1 previous similar message [ 5220.077980] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 11 sec [ 5230.963436] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8a3808732000.ost_server_uuid 50 [ 5234.355511] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff8a3808732000.ost_server_uuid in FULL state after 0 sec [ 5244.902075] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 5244.907535] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5244.925698] LustreError: Skipped 1 previous similar message [ 5244.950143] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5244.962661] Lustre: Skipped 2 previous similar messages [ 5248.761095] Lustre: server umount lustre-OST0000 complete [ 5255.139726] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5255.163721] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5255.184745] Lustre: Skipped 2 previous similar messages [ 5255.209921] Lustre: Skipped 1 previous similar message [ 5260.664660] Lustre: server umount lustre-MDT0000 complete [ 5264.384916] LustreError: 229089:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5264.421227] LustreError: 229089:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [ 5265.626390] LustreError: 228343:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788908623 with bad export cookie 8495099674824054453 [ 5265.636893] LustreError: 228343:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 5265.638409] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5265.948267] Lustre: server umount lustre-MDT0001 complete [ 5277.051428] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing unload_modules_local [ 5280.703729] Key type lgssc unregistered [ 5281.077491] LNet: 233590:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5281.102456] LNetError: 233590:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5281.134579] LNet: Removed LNI 192.168.204.116@tcp [ 5282.282827] Key type .llcrypt unregistered [ 5282.285364] Key type ._llcrypt unregistered [ 5318.541663] Key type ._llcrypt registered [ 5318.543919] Key type .llcrypt registered [ 5318.692695] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 5319.721403] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5319.844812] alg: No test for adler32 (adler32-zlib) [ 5320.873511] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 5321.037961] LNet: Added LNI 192.168.204.116@tcp [8/256/0/180] [ 5322.680847] Key type lgssc registered [ 5323.805770] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5332.763464] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5332.778734] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5334.176277] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5338.231539] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 5344.740310] LustreError: 235321:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5344.765454] LustreError: 235321:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 5347.191381] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5347.644447] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5352.449862] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 5355.540943] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 5362.330868] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5362.712641] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5369.470466] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 5378.009952] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5378.148755] Lustre: lustre-OST0001: new disk, initializing [ 5378.151736] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 5378.158920] Lustre: 237627:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 5378.243150] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 5379.332490] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49728) [ 5384.736792] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 5386.378139] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 5386.396197] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 5386.539072] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 5395.720462] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 5403.293905] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 5419.494853] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5419.502133] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5419.528390] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5422.573400] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5422.581796] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5422.595247] Lustre: Skipped 1 previous similar message [ 5422.618220] Lustre: Skipped 3 previous similar messages [ 5426.080544] Lustre: server umount lustre-MDT0000 complete [ 5427.688472] LustreError: 235320:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5429.907956] LustreError: 235300:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788908787 with bad export cookie 12957779935758969440 [ 5429.914169] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5429.919742] LustreError: 235300:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 5430.380057] Lustre: server umount lustre-MDT0001 complete [ 5445.074389] Lustre: server umount lustre-OST0000 complete [ 5448.160429] Lustre: 234584:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788908790/real 1788908790] req@ffff94a268652a00 x1875806706036224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788908806 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 5448.183559] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5448.198593] Lustre: Skipped 1 previous similar message [ 5448.980394] Lustre: server umount lustre-OST0001 complete [ 5472.630894] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 5483.731302] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5484.118760] LustreError: 240735:0:(ldlm_lib.c:1192:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5484.141544] LustreError: 240735:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [ 5484.235794] Lustre: mylustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5489.100861] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 5489.634502] LustreError: 240736:0:(ldlm_lib.c:1192:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5494.759602] LustreError: 240735:0:(ldlm_lib.c:1192:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5498.312330] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5498.745753] Lustre: mylustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5503.437632] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 5506.616772] Lustre: 241878:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 5513.699640] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5520.693351] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 5523.307670] LustreError: 242230:0:(ldlm_lib.c:1192:target_handle_connect()) mylustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5529.616351] Lustre: mylustre-OST0000: new connection from mylustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49731 to 0x280000401:49760) [ 5530.088983] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5530.453653] Lustre: mylustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 5530.461219] Lustre: Skipped 1 previous similar message [ 5537.844909] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 5545.912499] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 5549.574989] Lustre: 243749:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 5560.297519] LustreError: mylustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5560.304980] Lustre: mylustre-MDT0000-osp-MDT0001: Connection to mylustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5560.321526] Lustre: mylustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5565.679370] Lustre: server umount mylustre-MDT0000 complete [ 5566.441453] LustreError: 240735:0:(ldlm_lib.c:1192:target_handle_connect()) mylustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5566.457435] LustreError: 240735:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 6 previous similar messages [ 5569.176577] LustreError: 243950:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788908927 with bad export cookie 12957779935758972247 [ 5569.197643] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5569.201581] LustreError: 243950:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 5569.834661] Lustre: server umount mylustre-MDT0001 complete [ 5584.725411] Lustre: server umount mylustre-OST0000 complete [ 5587.938417] Lustre: 234583:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788908929/real 1788908929] req@ffff94a268f57100 x1875806706096640/t0(0) o400->mylustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788908945 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 5587.979880] Lustre: mylustre-MDT0001-lwp-OST0001: Connection to mylustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5587.998907] Lustre: Skipped 3 previous similar messages [ 5588.711083] Lustre: server umount mylustre-OST0001 complete [ 5612.155233] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 5623.088348] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5623.470510] LustreError: 246058:0:(ldlm_lib.c:1192:target_handle_connect()) tfs-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5623.577880] Lustre: tfs-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5628.964502] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 5638.391954] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5643.767983] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 5646.894683] Lustre: 247201:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 5653.446420] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5661.021213] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 5668.225808] Lustre: tfs-OST0000: new connection from tfs-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49731 to 0x280000401:49792) [ 5669.280835] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5675.017394] Lustre: tfs-OST0001: new connection from tfs-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) [ 5675.971829] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 5683.947543] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 5687.365131] Lustre: 249075:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 5694.956400] LustreError: tfs-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5694.974921] Lustre: tfs-MDT0000-osp-MDT0001: Connection to tfs-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5694.996227] Lustre: tfs-MDT0000: Not available for connect from 0@lo (stopping) [ 5695.000256] Lustre: Skipped 4 previous similar messages [ 5697.192831] Lustre: server umount tfs-MDT0000 complete [ 5700.582268] LustreError: 246058:0:(ldlm_lib.c:1192:target_handle_connect()) tfs-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5700.602930] LustreError: 246058:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 8 previous similar messages [ 5701.522446] LustreError: 249077:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788909059 with bad export cookie 12957779935758973906 [ 5701.535337] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5701.544058] LustreError: 249077:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 5702.055401] Lustre: server umount tfs-MDT0001 complete [ 5717.085585] Lustre: server umount tfs-OST0000 complete [ 5731.016443] Lustre: server umount tfs-OST0001 complete [ 5752.963406] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 5762.906990] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5763.489155] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5763.494415] Lustre: Skipped 3 previous similar messages [ 5767.770169] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 5776.273758] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5781.584376] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 5784.032752] Lustre: 252467:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 5790.415675] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5796.749820] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 5804.941208] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5808.254410] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49731 to 0x280000401:49824) [ 5808.269467] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:97) [ 5812.113833] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 5819.636791] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 5822.374939] Lustre: 254337:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 5828.059468] Lustre: DEBUG MARKER: == conf-sanity test 104a: Make sure user defined options are reflected in mount ========================================================== 19:13:04 (1788909184) [ 5843.426336] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5843.435420] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5843.452423] Lustre: Skipped 3 previous similar messages [ 5843.461380] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5843.464811] Lustre: Skipped 4 previous similar messages [ 5848.797445] Lustre: server umount lustre-MDT0000 complete [ 5849.575493] LustreError: 253647:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5849.596482] LustreError: 253647:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 7 previous similar messages [ 5851.827626] LustreError: 251300:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788909209 with bad export cookie 12957779935758975579 [ 5851.835989] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5851.842760] LustreError: 251300:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 5 previous similar messages [ 5854.698825] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 5854.704733] Lustre: Skipped 5 previous similar messages [ 5858.166306] Lustre: server umount lustre-MDT0001 complete [ 5867.376614] Lustre: server umount lustre-OST0000 complete [ 5877.015864] Lustre: server umount lustre-OST0001 complete [ 5882.546251] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_hostid [ 5890.364480] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 5919.152382] LDISKFS-fs (dm-0): Mount option "noacl" will be removed by 3.5 [ 5919.152382] Contact linux-ldiskfs@vger.kernel.org if you think we should keep it. [ 5919.152382] [ 5919.175747] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: acl,user_xattr,errors=remount-ro,noacl,no_mbcache,nodelalloc [ 5919.380542] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 5919.407180] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 5919.479379] Lustre: lustre-MDT0000: new disk, initializing [ 5919.561713] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5919.567755] Lustre: Skipped 3 previous similar messages [ 5919.590238] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 5923.839591] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 5933.877377] LDISKFS-fs (dm-1): Mount option "noacl" will be removed by 3.5 [ 5933.877377] Contact linux-ldiskfs@vger.kernel.org if you think we should keep it. [ 5933.877377] [ 5933.926841] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: acl,user_xattr,errors=remount-ro,noacl,no_mbcache,nodelalloc [ 5934.034708] Lustre: 257522:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 5934.087933] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 5934.091106] Lustre: Skipped 1 previous similar message [ 5934.166630] Lustre: lustre-MDT0001: new disk, initializing [ 5934.284846] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 5934.295142] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 5938.375610] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 5948.417470] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5948.676948] Lustre: lustre-OST0000: new disk, initializing [ 5948.686817] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 5948.707368] Lustre: 259102:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 5949.995119] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 5950.004562] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 5950.177372] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 5955.102819] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 5965.805662] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5965.936550] Lustre: lustre-OST0001: new disk, initializing [ 5965.944221] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 5965.949276] Lustre: 259972:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 5967.131739] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 5967.151090] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 5967.273562] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 5972.145477] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 5982.311159] Lustre: DEBUG MARKER: == conf-sanity test 104b: Mount uses last flock argument ========================================================== 19:15:38 (1788909338) [ 5993.194751] Lustre: DEBUG MARKER: == conf-sanity test 105: check file creation for ro and rw bind mnt pt ========================================================== 19:15:49 (1788909349) [ 6008.300368] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6008.306945] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6008.311460] Lustre: Skipped 6 previous similar messages [ 6008.323892] Lustre: Skipped 3 previous similar messages [ 6021.088161] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 6021.169889] Lustre: server umount lustre-OST0000 complete [ 6026.721510] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 6030.059176] Lustre: server umount lustre-MDT0000 complete [ 6032.611636] LustreError: 257513:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788909390 with bad export cookie 12957779935758977133 [ 6032.612581] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6032.617658] LustreError: 257513:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 6038.945760] Lustre: server umount lustre-MDT0001 complete [ 6046.941030] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing unload_modules_local [ 6061.785180] Lustre: server umount lustre-OST0001 complete [ 6065.764107] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_hostid [ 6077.666941] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 6105.388045] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6105.550180] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 6105.570365] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 6105.641872] Lustre: lustre-MDT0000: new disk, initializing [ 6105.744629] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 6109.191960] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 6117.245332] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6117.309885] Lustre: 264506:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 6117.538315] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 6121.207295] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 6129.172759] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 6133.682202] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 6139.439537] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6139.686685] Lustre: lustre-OST0000: new disk, initializing [ 6139.690499] Lustre: Skipped 1 previous similar message [ 6139.695896] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 6139.701931] Lustre: Skipped 2 previous similar messages [ 6139.706425] Lustre: 266473:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 6141.734098] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 6141.749864] Lustre: Skipped 1 previous similar message [ 6141.762659] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 6141.860901] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 6144.700856] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 6151.743831] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 6157.285113] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 6157.287883] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6157.291307] LustreError: Skipped 1 previous similar message [ 6157.305215] Lustre: Skipped 4 previous similar messages [ 6157.309547] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6157.317144] Lustre: Skipped 11 previous similar messages [ 6162.318499] Lustre: server umount lustre-OST0000 complete [ 6179.296573] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 6179.490453] Lustre: server umount lustre-MDT0000 complete [ 6182.223544] LustreError: 265301:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788909540 with bad export cookie 12957779935758978596 [ 6182.224849] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6182.238320] LustreError: 265301:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 6182.487306] Lustre: server umount lustre-MDT0001 complete [ 6190.318173] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing unload_modules_local [ 6192.293371] Key type lgssc unregistered [ 6192.516783] LNet: 268236:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6192.522296] LNetError: 268236:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6192.533761] LNet: Removed LNI 192.168.204.116@tcp [ 6193.160163] Key type .llcrypt unregistered [ 6193.162538] Key type ._llcrypt unregistered [ 6214.896465] Key type ._llcrypt registered [ 6214.898812] Key type .llcrypt registered [ 6214.979843] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 6215.582677] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6215.644212] alg: No test for adler32 (adler32-zlib) [ 6216.598671] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 6216.770478] LNet: Added LNI 192.168.204.116@tcp [8/256/0/180] [ 6218.416172] Key type lgssc registered [ 6219.095166] Lustre: Echo OBD driver; http://www.lustre.org/ [ 6224.157850] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 6224.170533] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6225.479191] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6228.156371] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 6233.804938] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6234.074096] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6237.165222] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 6242.800213] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 6247.254437] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 6251.770983] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6251.979396] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6256.199328] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 6261.642683] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 6262.410643] Lustre: Setting parameter lustre-OST0000.ost.unknown_param=50 in log lustre-OST0000 [ 6263.764166] Lustre: server umount lustre-OST0000 complete [ 6268.387179] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6268.391188] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6268.399416] Lustre: Skipped 1 previous similar message [ 6268.413229] LustreError: 269700:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6268.429246] LustreError: 269700:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 6268.494416] Lustre: server umount lustre-MDT0000 complete [ 6273.505716] LustreError: 269701:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6273.517772] LustreError: 269701:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 6278.626312] LustreError: 270506:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6278.638631] LustreError: 270506:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 6283.745489] LustreError: 269700:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6283.755870] LustreError: 269700:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 6284.769535] Lustre: 269012:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788909626/real 1788909626] req@0000000023ab5e95 x1875807645492096/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 1 dl 1788909642 ref 1 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 6284.785779] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6285.792154] Lustre: 269692:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788909627/real 1788909627] req@00000000e0a691d8 x1875807645492608/t0(0) o101->MGC192.168.204.116@tcp@0@lo:26/25 lens 328/344 e 0 to 1 dl 1788909643 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 6285.808532] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6285.817352] LustreError: 269692:0:(mgc_request.c:614:do_requeue()) failed processing log: -5 [ 6286.037298] Lustre: server umount lustre-MDT0001 complete [ 6294.237836] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing unload_modules_local [ 6296.310917] Key type lgssc unregistered [ 6296.513937] LNet: 273276:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6296.517809] LNetError: 273276:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6296.530958] LNet: Removed LNI 192.168.204.116@tcp [ 6297.085280] Key type .llcrypt unregistered [ 6297.086985] Key type ._llcrypt unregistered [ 6311.020165] Key type ._llcrypt registered [ 6311.022208] Key type .llcrypt registered [ 6311.136094] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 6311.970477] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6311.988054] alg: No test for adler32 (adler32-zlib) [ 6312.981691] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 6313.197867] LNet: Added LNI 192.168.204.116@tcp [8/256/0/180] [ 6314.865347] Key type lgssc registered [ 6315.683286] Lustre: Echo OBD driver; http://www.lustre.org/ [ 6322.381293] Lustre: lustre-OST0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 6322.398160] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6337.888499] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 6343.008436] LustreError: 274467:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.204.116@tcp: failed processing log, type 4: rc = -110 [ 6369.696236] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6373.860169] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 6380.069431] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 6381.809408] Lustre: server umount lustre-OST0000 complete [ 6395.163704] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing unload_modules_local [ 6397.381286] Key type lgssc unregistered [ 6397.622521] LNet: 276100:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6397.628953] LNetError: 276100:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6397.639233] LNet: Removed LNI 192.168.204.116@tcp [ 6398.262690] Key type .llcrypt unregistered [ 6398.265384] Key type ._llcrypt unregistered [ 6426.603098] Key type ._llcrypt registered [ 6426.605968] Key type .llcrypt registered [ 6426.678410] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 6427.231485] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6427.311073] alg: No test for adler32 (adler32-zlib) [ 6428.258980] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 6428.444286] LNet: Added LNI 192.168.204.116@tcp [8/256/0/180] [ 6430.104344] Key type lgssc registered [ 6430.839228] Lustre: Echo OBD driver; http://www.lustre.org/ [ 6439.528686] loop0: detected capacity change from 0 to 204800000 [ 6439.680989] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 6439.691734] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 6439.928818] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 6440.719310] loop0: detected capacity change from 0 to 204800000 [ 6440.819374] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 6440.832731] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 6441.055707] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 6441.822487] loop0: detected capacity change from 0 to 204800000 [ 6441.951993] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 6441.962907] blk_update_request: operation not supported error, dev loop0, sector 8224 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 6442.041508] blk_update_request: operation not supported error, dev loop0, sector 58264 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 6442.843863] loop0: detected capacity change from 0 to 204800000 [ 6442.976979] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 6443.712292] loop0: detected capacity change from 0 to 204800000 [ 6443.725529] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 6446.346316] loop0: detected capacity change from 0 to 204800000 [ 6446.369704] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 6448.801294] loop0: detected capacity change from 0 to 204800000 [ 6448.820997] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 6451.304627] loop0: detected capacity change from 0 to 204800000 [ 6451.335384] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 6453.780746] loop0: detected capacity change from 0 to 204800000 [ 6453.850313] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 6453.875848] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6453.942294] Lustre: 279505:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 6453.949582] Lustre: 279505:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index 'nodemap' with [0x200000003:0x3:0x0]: rc = 0 [ 6453.954724] Lustre: 279505:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000003:0xb:0x0]: rc = 0 [ 6453.959797] Lustre: 279505:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000003:0xa:0x0]: rc = 0 [ 6453.965978] Lustre: 279505:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000003:0xc:0x0]: rc = 0 [ 6453.971786] Lustre: 279505:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000-MDT0000' with [0x200000005:0x1:0x0]: rc = 0 [ 6453.977472] Lustre: 279505:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000-MDT0000' with [0x200000005:0x2:0x0]: rc = 0 [ 6453.983875] Lustre: 279505:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000-MDT0000' with [0x200000005:0x3:0x0]: rc = 0 [ 6453.989498] Lustre: 279505:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2020000' with [0x200000006:0x2020000:0x0]: rc = 0 [ 6453.995303] Lustre: 279505:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1020000' with [0x200000006:0x1020000:0x0]: rc = 0 [ 6454.001113] Lustre: 279505:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x20000' with [0x200000006:0x20000:0x0]: rc = 0 [ 6454.012341] Lustre: 279505:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000006:0x1010000:0x0]: rc = 0 [ 6454.018917] Lustre: 279505:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000006:0x10000:0x0]: rc = 0 [ 6454.023877] Lustre: 279505:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000006:0x2010000:0x0]: rc = 0 [ 6458.253640] Lustre: server umount MGS complete [ 6458.892380] loop0: detected capacity change from 0 to 204800000 [ 6458.942618] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6459.266980] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6459.312401] Lustre: lustre-MDT0000: Aborting client recovery [ 6459.954194] loop1: detected capacity change from 0 to 204800000 [ 6460.033735] LDISKFS-fs (loop1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6460.123365] Lustre: 279937:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 6460.137032] Lustre: 279937:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x1010000' with [0x200000003:0x5:0x0]: rc = 0 [ 6460.150423] Lustre: 279937:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x2010000-MDT0001' with [0x200000005:0x3:0x0]: rc = 0 [ 6460.160650] Lustre: 279937:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x10000-MDT0001' with [0x200000005:0x1:0x0]: rc = 0 [ 6460.174270] Lustre: 279937:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x2010000' with [0x200000003:0x6:0x0]: rc = 0 [ 6460.195232] Lustre: 279937:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x10000' with [0x200000003:0x4:0x0]: rc = 0 [ 6460.206475] Lustre: 279937:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x1010000-MDT0001' with [0x200000005:0x2:0x0]: rc = 0 [ 6460.249287] Lustre: Found index 1 for lustre-MDT0001, updating log [ 6460.407653] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6460.459922] Lustre: lustre-MDT0001: Aborting client recovery [ 6461.073337] loop2: detected capacity change from 0 to 204800000 [ 6461.135198] LDISKFS-fs (loop2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6461.196349] Lustre: 280018:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 6461.216155] Lustre: 280018:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x2020000-OST0000' with [0x200000005:0x3:0x0]: rc = 0 [ 6461.231066] Lustre: 280018:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 6461.240846] Lustre: 280018:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 6461.253898] Lustre: 280018:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x20000-OST0000' with [0x200000005:0x1:0x0]: rc = 0 [ 6461.265563] Lustre: 280018:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x1020000-OST0000' with [0x200000005:0x2:0x0]: rc = 0 [ 6461.276123] Lustre: 280018:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 6461.345880] Lustre: Found index 0 for lustre-OST0000, updating log [ 6461.371234] Lustre: 280036:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 6461.415701] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6461.433193] Lustre: lustre-OST0000: Aborting recovery [ 6462.048790] loop3: detected capacity change from 0 to 204800000 [ 6462.124187] LDISKFS-fs (loop3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6462.181410] Lustre: 280101:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 6462.191394] Lustre: 280101:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 6462.202107] Lustre: 280101:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 6462.208439] Lustre: 280101:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x2020000-OST0001' with [0x200000005:0x3:0x0]: rc = 0 [ 6462.216203] Lustre: 280101:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 6462.223320] Lustre: 280101:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x20000-OST0001' with [0x200000005:0x1:0x0]: rc = 0 [ 6462.230331] Lustre: 280101:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x1020000-OST0001' with [0x200000005:0x2:0x0]: rc = 0 [ 6462.273508] Lustre: 280107:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 6462.331366] Lustre: lustre-OST0001: Aborting recovery [ 6467.572107] LustreError: 279880:0:(lod_dev.c:511:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 8, retries 0, failed: rc = -108 [ 6469.620222] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 6469.625623] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 6469.653444] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000bd0 [ 6469.681271] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000bd0 [ 6470.632235] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:5 to 0x280000400:33) [ 6470.639288] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:5 to 0x2c0000400:33) [ 6475.098810] LustreError: 279847:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0000: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0000 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0000/identity_upcall, time 1405us: rc = -2 [ 6475.612433] LustreError: 279957:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0000: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0000 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0000/identity_upcall, time 364us: rc = -2 [ 6475.623890] LustreError: 279957:0:(mdt_identity.c:115:mdt_identity_do_upcall()) Skipped 26 previous similar messages [ 6491.106639] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6491.108279] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 6491.108837] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6491.116732] Lustre: Skipped 2 previous similar messages [ 6493.721311] Lustre: server umount lustre-MDT0000 complete [ 6494.259679] LustreError: 279829:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788909852 with bad export cookie 9028397682827951872 [ 6494.262731] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6494.266879] LustreError: 279829:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 6496.229196] LustreError: 279846:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6496.229355] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6496.236355] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 6496.236362] Lustre: Skipped 3 previous similar messages [ 6496.247871] LustreError: 279846:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [ 6496.255705] Lustre: Skipped 2 previous similar messages [ 6499.233567] LustreError: 280448:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6499.237472] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 6499.249567] LustreError: 280448:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 6499.251763] Lustre: Skipped 2 previous similar messages [ 6500.540514] Lustre: server umount lustre-MDT0001 complete [ 6507.239343] Lustre: server umount lustre-OST0000 complete [ 6522.336616] Lustre: lustre-OST0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 6522.478594] Lustre: server umount lustre-OST0001 complete [ 6527.779174] Lustre: DEBUG MARKER: == conf-sanity test 109a: test lctl clear_conf fsname ==== 19:24:44 (1788909884) [ 6544.545285] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_hostid [ 6549.850679] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 6571.111354] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6571.248950] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 6571.269748] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 6571.325291] Lustre: lustre-MDT0000: new disk, initializing [ 6571.382913] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6571.387578] Lustre: Skipped 1 previous similar message [ 6571.402498] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 6574.150303] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 6581.029559] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6581.129329] Lustre: 284172:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 6581.178772] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 6581.184127] Lustre: Skipped 1 previous similar message [ 6581.240589] Lustre: lustre-MDT0001: new disk, initializing [ 6581.308567] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6581.337497] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 6581.342682] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 6584.130515] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 6589.960487] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 6593.190591] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 6597.202315] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6597.363164] Lustre: lustre-OST0000: new disk, initializing [ 6597.366976] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 6597.373236] Lustre: 286139:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 6597.438084] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6600.917234] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 6607.004311] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 6607.387035] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 6607.393451] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 6607.456193] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 6616.205605] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 6625.831995] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 6629.852111] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 6635.841707] Lustre: Modifying parameter lustre-client.llite.max_read_ahead_mb=64 in log lustre-client [ 6679.012826] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 6679.013390] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6679.015098] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6679.018927] LustreError: Skipped 1 previous similar message [ 6679.025451] Lustre: Skipped 1 previous similar message [ 6684.133721] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6684.138561] Lustre: Skipped 2 previous similar messages [ 6684.548198] Lustre: server umount lustre-OST0000 complete [ 6688.739093] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 6688.745339] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6694.376909] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6694.383028] Lustre: Skipped 3 previous similar messages [ 6701.024145] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 6701.155489] Lustre: server umount lustre-MDT0000 complete [ 6703.773071] LustreError: 284966:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788910061 with bad export cookie 9028397682827954574 [ 6703.775121] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6703.783672] LustreError: 284966:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 6704.043901] Lustre: server umount lustre-MDT0001 complete [ 6709.710783] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6712.785914] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 6716.015380] Lustre: server umount MGS complete [ 6723.846875] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6724.183748] LustreError: 290052:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6724.207568] LustreError: 290065:0:(qmt_pool.c:1645:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 6724.278840] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6727.398970] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 6729.701346] LustreError: 290053:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6733.304540] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6736.500751] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 6741.859279] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 6745.551345] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 6749.987271] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6754.193776] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 6758.868405] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 6804.449094] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 6804.452433] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6804.462907] Lustre: Skipped 1 previous similar message [ 6804.468074] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6804.472833] Lustre: Skipped 2 previous similar messages [ 6816.224124] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 6816.313747] Lustre: server umount lustre-OST0000 complete [ 6820.836597] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6820.836751] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 6820.846760] Lustre: Skipped 1 previous similar message [ 6825.338256] Lustre: server umount lustre-MDT0000 complete [ 6825.953421] LustreError: 290782:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6825.971231] LustreError: 290782:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 6827.914609] LustreError: 290033:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788910185 with bad export cookie 9028397682827956415 [ 6827.923596] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6827.925058] LustreError: 290033:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 6828.129270] Lustre: server umount lustre-MDT0001 complete [ 6835.375440] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing unload_modules_local [ 6836.991151] Key type lgssc unregistered [ 6837.180573] LNet: 294016:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6837.186655] LNetError: 294016:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6837.197337] LNet: Removed LNI 192.168.204.116@tcp [ 6837.705147] Key type .llcrypt unregistered [ 6837.707175] Key type ._llcrypt unregistered [ 6860.594498] Key type ._llcrypt registered [ 6860.596511] Key type .llcrypt registered [ 6860.676927] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_hostid [ 6871.033816] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 6871.581704] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6871.675224] alg: No test for adler32 (adler32-zlib) [ 6872.620606] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 6872.859226] LNet: Added LNI 192.168.204.116@tcp [8/256/0/180] [ 6874.536175] Key type lgssc registered [ 6875.268510] Lustre: Echo OBD driver; http://www.lustre.org/ [ 6896.808185] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 6896.824046] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6897.952620] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 6897.969646] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 6898.014638] Lustre: lustre-MDT0000: new disk, initializing [ 6898.057953] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6898.072992] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 6900.605949] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 6907.877203] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6907.965271] Lustre: 297948:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 6908.012709] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 6908.015553] Lustre: Skipped 1 previous similar message [ 6908.078851] Lustre: lustre-MDT0001: new disk, initializing [ 6908.154916] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6908.182627] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 6908.186986] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 6910.777566] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 6917.134591] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 6920.779429] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 6925.163685] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6925.380984] Lustre: lustre-OST0000: new disk, initializing [ 6925.385249] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 6925.390961] Lustre: 299917:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 6925.456553] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6930.039861] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 6930.966601] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 6930.974094] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 6931.055955] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 6936.451401] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 6941.790408] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 6951.464932] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 6957.326408] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 6997.474632] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 6997.484685] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6997.495340] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7002.595585] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7002.604070] Lustre: Skipped 2 previous similar messages [ 7007.715829] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7007.719250] Lustre: Skipped 1 previous similar message [ 7010.272106] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 7010.368917] Lustre: server umount lustre-OST0000 complete [ 7012.834867] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7012.836704] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7012.843456] Lustre: Skipped 2 previous similar messages [ 7012.852967] Lustre: Skipped 1 previous similar message [ 7017.952937] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7017.959174] Lustre: Skipped 1 previous similar message [ 7018.680563] Lustre: server umount lustre-MDT0000 complete [ 7020.622545] LustreError: 299916:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788910378 with bad export cookie 15965233722415770877 [ 7020.626990] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7020.629660] LustreError: 299916:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 7020.795801] Lustre: server umount lustre-MDT0001 complete [ 7025.329753] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7027.837567] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 7030.881224] Lustre: server umount MGS complete [ 7037.156919] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7037.417531] LustreError: 303891:0:(qmt_pool.c:1645:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 7037.457354] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7039.579311] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 7042.529791] LustreError: 303878:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7042.553201] LustreError: 303878:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 7044.451559] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7044.663269] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7046.912655] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 7051.085162] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 7053.927934] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 7057.271102] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7057.454384] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7060.211882] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 7063.995174] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 7085.027780] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7085.029191] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7085.033560] Lustre: Skipped 1 previous similar message [ 7089.973226] Lustre: server umount lustre-OST0000 complete [ 7095.265530] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7095.272347] Lustre: Skipped 1 previous similar message [ 7098.173303] Lustre: server umount lustre-MDT0000 complete [ 7099.800310] LustreError: 303858:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788910457 with bad export cookie 15965233722415772704 [ 7099.803683] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7099.805234] LustreError: 303858:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 7099.952167] Lustre: server umount lustre-MDT0001 complete [ 7105.615557] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing unload_modules_local [ 7106.894333] Key type lgssc unregistered [ 7107.037843] LNet: 307817:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7107.042487] LNetError: 307817:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7107.051872] LNet: Removed LNI 192.168.204.116@tcp [ 7107.509142] Key type .llcrypt unregistered [ 7107.511173] Key type ._llcrypt unregistered [ 7116.467410] Key type ._llcrypt registered [ 7116.469100] Key type .llcrypt registered [ 7116.521161] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_hostid [ 7124.180498] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 7124.570233] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7124.592070] alg: No test for adler32 (adler32-zlib) [ 7125.487617] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 7125.620745] LNet: Added LNI 192.168.204.116@tcp [8/256/0/180] [ 7127.248752] Key type lgssc registered [ 7127.787705] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7138.936431] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 7145.398664] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7145.411789] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7146.528635] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 7146.542784] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 7146.586936] Lustre: lustre-MDT0000: new disk, initializing [ 7146.623035] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7146.632100] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 7148.544454] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 7153.635242] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7153.758783] Lustre: lustre-OST0000: new disk, initializing [ 7153.761639] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 7153.764559] Lustre: Skipped 1 previous similar message [ 7153.767232] Lustre: 311840:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 7153.811630] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7156.644490] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 7159.834456] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 7159.843831] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 7159.860890] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 7646.178092] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7646.184892] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7651.297348] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7652.026769] Lustre: server umount lustre-MDT0000 complete [ 7653.628309] LustreError: 311839:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788911011 with bad export cookie 473280610162250607 [ 7653.631893] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7653.639358] LustreError: 311839:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 7653.725136] Lustre: server umount lustre-OST0000 complete [ 7665.283947] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_hostid [ 7670.595921] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 7689.950984] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7690.066983] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 7690.083102] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 7690.129307] Lustre: lustre-MDT0000: new disk, initializing [ 7690.184776] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7690.202642] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 7692.118539] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 7697.251794] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7697.311416] Lustre: 316120:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 7697.348431] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 7697.351273] Lustre: Skipped 1 previous similar message [ 7697.399822] Lustre: lustre-MDT0001: new disk, initializing [ 7697.460044] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7697.483153] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 7697.490550] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 7699.292469] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 7703.813611] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 7706.227066] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 7709.257238] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7709.380378] Lustre: lustre-OST0000: new disk, initializing [ 7709.382908] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 7709.388556] Lustre: 318086:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 7709.427107] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7711.921259] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 7716.576359] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 7718.415679] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 7718.422074] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 7718.469347] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 7718.544636] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 7718.640557] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 7720.311356] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 7720.404400] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 7723.492490] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 7723.492892] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7723.496208] LustreError: Skipped 1 previous similar message [ 7723.503701] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7723.508114] Lustre: Skipped 1 previous similar message [ 7727.335203] Lustre: server umount lustre-OST0000 complete [ 7733.217467] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7733.221568] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7733.226576] Lustre: Skipped 1 previous similar message [ 7733.229345] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7735.076022] Lustre: server umount lustre-MDT0000 complete [ 7736.781530] LustreError: 316111:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788911094 with bad export cookie 473280610165191398 [ 7736.785118] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7736.787814] LustreError: 316111:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 7736.952965] Lustre: server umount lustre-MDT0001 complete [ 7738.528202] Lustre: DEBUG MARKER: SKIP: conf-sanity test_111 skipping SLOW test 111 [ 7739.354079] Lustre: DEBUG MARKER: == conf-sanity test 112a: mount OST with no_create option ========================================================== 19:44:56 (1788911096) [ 7742.328514] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7742.576281] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7744.353599] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 7748.066201] LustreError: 320398:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7748.073891] LustreError: 320398:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 7748.268731] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7750.258569] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 7753.580967] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 7755.864709] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 7758.903849] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7759.037621] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7759.041569] Lustre: Skipped 1 previous similar message [ 7761.489828] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 7764.624751] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 7767.681919] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7767.763180] Lustre: lustre-OST0001: new disk, initializing [ 7767.766275] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 7767.770808] Lustre: 323230:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 7770.286186] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 7774.740873] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 7774.746237] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 7774.770511] LustreError: 323983:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 7774.975056] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 7775.066268] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 7775.844055] LustreError: 323983:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 7775.848819] LustreError: 323983:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 2 previous similar messages [ 7776.867696] LustreError: 323995:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [ 7776.875489] LustreError: 323995:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 1 previous similar message [ 7777.553421] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8a38054fb000.ost_server_uuid 50 [ 7778.272121] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff8a38054fb000.ost_server_uuid in FULL state after 0 sec [ 7778.915337] LustreError: 323983:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 7778.922527] LustreError: 323983:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 3 previous similar messages [ 7780.640498] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8a38054fb000.ost_server_uuid 50 [ 7781.316776] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-ffff8a38054fb000.ost_server_uuid in FULL state after 0 sec [ 7781.996109] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 7793.505546] Lustre: lustre-OST0001: Not available for connect from 192.168.204.16@tcp (stopping) [ 7793.508778] Lustre: Skipped 1 previous similar message [ 7795.178694] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7795.183544] Lustre: Skipped 2 previous similar messages [ 7799.502086] Lustre: server umount lustre-OST0001 complete [ 7800.290599] LustreError: 322217:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7800.300150] LustreError: 322217:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 7803.360976] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 7803.364376] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7803.369296] LustreError: Skipped 1 previous similar message [ 7803.378620] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7803.383088] Lustre: Skipped 3 previous similar messages [ 7805.414469] LustreError: 322216:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7805.420554] LustreError: 322216:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 7807.702524] Lustre: server umount lustre-OST0000 complete [ 7810.017719] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7810.022248] LustreError: Skipped 1 previous similar message [ 7815.520699] Lustre: server umount lustre-MDT0000 complete [ 7815.649070] LustreError: 321609:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7815.655812] LustreError: 321609:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 7817.010196] LustreError: 320377:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788911174 with bad export cookie 473280610165192280 [ 7817.013092] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7817.014212] LustreError: 320377:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 7817.139650] Lustre: server umount lustre-MDT0001 complete [ 7821.731406] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing unload_modules_local [ 7823.055940] Key type lgssc unregistered [ 7823.212896] LNet: 325917:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7823.222569] LNetError: 325917:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7823.232128] LNet: Removed LNI 192.168.204.116@tcp [ 7823.641306] Key type .llcrypt unregistered [ 7823.642398] Key type ._llcrypt unregistered [ 7835.742850] Key type ._llcrypt registered [ 7835.744099] Key type .llcrypt registered [ 7835.799950] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 7836.232328] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7836.272358] alg: No test for adler32 (adler32-zlib) [ 7837.159623] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 7837.265250] LNet: Added LNI 192.168.204.116@tcp [8/256/0/180] [ 7838.864250] Key type lgssc registered [ 7839.342574] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7842.647239] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7842.654933] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7843.877080] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7845.514344] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 7848.360183] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 7851.119234] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7851.306510] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7853.050830] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 7856.867057] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7857.017687] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7859.436680] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 7861.094539] LustreError: 328994:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7861.106560] LustreError: 328994:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 7862.799477] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 7865.705893] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7865.808680] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 7868.443951] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 7868.908760] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:65) [ 7868.913814] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:33) [ 7871.776517] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 7875.816704] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing wait_import_state (FULL|IDLE) os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [ 7875.893441] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 7955.940800] LustreError: lustre-OST0001-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 7955.941112] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7955.941604] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 7955.944044] LustreError: Skipped 1 previous similar message [ 7955.947790] Lustre: Skipped 1 previous similar message [ 7961.060246] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 7961.062464] Lustre: Skipped 2 previous similar messages [ 7966.180683] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 7966.182924] Lustre: Skipped 1 previous similar message [ 7970.272592] Lustre: lustre-OST0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 7970.304668] Lustre: server umount lustre-OST0001 complete [ 7971.303722] LustreError: 328994:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7971.312797] LustreError: 328994:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 7973.857001] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 7973.861399] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7973.867960] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7976.417071] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 7976.424352] LustreError: 328993:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7976.424773] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7976.434627] LustreError: 328993:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 7978.204906] Lustre: server umount lustre-OST0000 complete [ 7981.539237] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7981.540098] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7981.545347] Lustre: Skipped 1 previous similar message [ 7981.550620] Lustre: Skipped 3 previous similar messages [ 7991.777643] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7991.780558] Lustre: Skipped 3 previous similar messages [ 7994.336102] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 7994.408166] Lustre: server umount lustre-MDT0000 complete [ 7995.827278] LustreError: 330993:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788911353 with bad export cookie 10554426357869298499 [ 7995.830663] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7995.832097] LustreError: 330993:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 7995.960957] Lustre: server umount lustre-MDT0001 complete [ 8000.498862] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing unload_modules_local [ 8001.615232] Key type lgssc unregistered [ 8001.760438] LNet: 332254:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8001.763251] LNetError: 332254:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8001.770751] LNet: Removed LNI 192.168.204.116@tcp [ 8002.099945] Key type .llcrypt unregistered [ 8002.101138] Key type ._llcrypt unregistered [ 8021.561617] Key type ._llcrypt registered [ 8021.562617] Key type .llcrypt registered [ 8021.600651] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 8021.961295] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8022.017887] alg: No test for adler32 (adler32-zlib) [ 8022.887949] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 8022.989523] LNet: Added LNI 192.168.204.116@tcp [8/256/0/180] [ 8024.576200] Key type lgssc registered [ 8024.963913] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8028.453324] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 8028.460571] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8029.640090] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8031.309337] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 8035.066236] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8035.270096] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8037.010359] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 8038.326816] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 8041.479414] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8041.644267] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8044.164447] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 8045.734403] LustreError: 336002:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8045.744159] LustreError: 336002:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 8047.769744] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8047.897081] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 8050.275620] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 8054.250656] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:65) [ 8054.250909] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:97) [ 8059.379305] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 8069.638602] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 8074.722432] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8074.723903] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8074.728214] Lustre: Skipped 2 previous similar messages [ 8074.730055] Lustre: Skipped 1 previous similar message [ 8075.999428] Lustre: server umount lustre-MDT0000 complete [ 8077.364789] LustreError: 335252:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788911435 with bad export cookie 730114660697718839 [ 8077.369972] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8077.370849] LustreError: 335252:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 8079.547684] Lustre: server umount lustre-MDT0001 complete [ 8090.244967] Lustre: server umount lustre-OST0000 complete [ 8101.859244] Lustre: server umount lustre-OST0001 complete [ 8107.737921] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 8111.260517] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8111.424702] LustreError: 339774:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8111.451422] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8112.963278] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 8116.091135] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8117.646719] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 8118.794145] Lustre: 340913:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 8121.188969] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8121.357572] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8121.360608] Lustre: Skipped 1 previous similar message [ 8122.405625] LustreError: 341441:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8122.407937] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:129) [ 8123.567601] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 8126.502765] LustreError: 341269:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8126.510719] LustreError: 341269:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 8127.054061] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8129.408602] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 8132.587248] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:97) [ 8132.849180] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 8134.130635] Lustre: 342785:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 8136.673157] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8136.676911] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8136.683247] Lustre: Skipped 1 previous similar message [ 8136.686624] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8136.689608] Lustre: Skipped 2 previous similar messages [ 8137.697799] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8137.700669] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8137.705262] Lustre: Skipped 2 previous similar messages [ 8141.279219] Lustre: server umount lustre-MDT0000 complete [ 8142.649300] LustreError: 340917:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788911500 with bad export cookie 730114660697720526 [ 8142.653021] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8142.653893] LustreError: 340917:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 8142.770663] Lustre: server umount lustre-MDT0001 complete [ 8154.378585] Lustre: server umount lustre-OST0000 complete [ 8165.992516] Lustre: server umount lustre-OST0001 complete [ 8167.443920] Lustre: DEBUG MARKER: SKIP: conf-sanity test_114 skipping SLOW test 114 [ 8168.127436] Lustre: DEBUG MARKER: SKIP: conf-sanity test_115 skipping excluded test 115 [ 8168.837354] Lustre: DEBUG MARKER: == conf-sanity test 116: big size MDT support ============ 19:52:06 (1788911526) [ 8177.597205] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 8181.123023] loop0: detected capacity change from 0 to 1099511627776 [ 8181.284831] SGI XFS with ACLs, security attributes, quota, no debug enabled [ 8181.289673] *** VALIDATE xfs *** [ 8181.305337] XFS (loop0): Mounting V5 Filesystem [ 8181.323291] XFS (loop0): Ending clean mount [ 8181.856887] loop1: detected capacity change from 0 to 18691697672192 [ 8205.085299] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_hostid [ 8209.150189] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 8222.273085] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8222.357187] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 8222.367269] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 8222.403032] Lustre: lustre-MDT0000: new disk, initializing [ 8222.424138] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8222.426660] Lustre: Skipped 1 previous similar message [ 8222.431668] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 8223.751289] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 8227.986808] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8228.039706] Lustre: 347897:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8228.070638] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 8228.072681] Lustre: Skipped 1 previous similar message [ 8228.111190] Lustre: lustre-MDT0001: new disk, initializing [ 8228.167776] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 8228.172767] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 8229.662741] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 8233.620973] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 8235.780777] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 8238.309273] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8238.411034] Lustre: lustre-OST0000: new disk, initializing [ 8238.413202] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 8238.415785] Lustre: 349865:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8240.055637] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 8240.058732] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 8240.099700] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 8240.399773] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 8244.341484] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 8245.864859] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 8245.936804] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 8247.319459] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 8247.396830] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 8250.338537] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 8250.339099] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8250.340773] LustreError: Skipped 1 previous similar message [ 8250.345991] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8250.349394] Lustre: Skipped 4 previous similar messages [ 8254.163918] Lustre: server umount lustre-OST0000 complete [ 8259.040926] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8259.044272] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8259.048925] Lustre: Skipped 1 previous similar message [ 8259.051124] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8261.854120] Lustre: server umount lustre-MDT0000 complete [ 8263.197060] LustreError: 347889:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788911621 with bad export cookie 730114660697722059 [ 8263.198583] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8263.201282] LustreError: 347889:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 8263.319397] Lustre: server umount lustre-MDT0001 complete [ 8266.434149] XFS (loop0): Unmounting Filesystem [ 8268.115230] Lustre: DEBUG MARKER: == conf-sanity test 117: lctl get_param return errors properly ========================================================== 19:53:45 (1788911625) [ 8270.629368] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8270.838707] LustreError: 352417:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8270.864171] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8270.866820] Lustre: Skipped 2 previous similar messages [ 8272.277722] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 8275.267283] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8276.948571] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 8279.561812] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 8281.700900] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 8284.164012] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8286.316886] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 8288.723927] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 8306.148128] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8306.148270] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 8306.151909] Lustre: Skipped 1 previous similar message [ 8306.152672] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8306.155204] LustreError: Skipped 1 previous similar message [ 8306.160358] Lustre: Skipped 3 previous similar messages [ 8308.567787] Lustre: server umount lustre-OST0000 complete [ 8311.265877] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8316.053721] Lustre: server umount lustre-MDT0000 complete [ 8316.385049] LustreError: 352418:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8316.390628] LustreError: 352418:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 8317.295545] LustreError: 352398:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788911675 with bad export cookie 730114660697722941 [ 8317.299162] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8317.299642] LustreError: 352398:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 8317.446358] Lustre: server umount lustre-MDT0001 complete [ 8321.393997] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing unload_modules_local [ 8322.481430] Key type lgssc unregistered [ 8322.614666] LNet: 356064:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8322.617336] LNetError: 356064:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8322.625518] LNet: Removed LNI 192.168.204.116@tcp [ 8322.972806] Key type .llcrypt unregistered [ 8322.974230] Key type ._llcrypt unregistered [ 8333.736289] Key type ._llcrypt registered [ 8333.737570] Key type .llcrypt registered [ 8333.792125] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 8334.124542] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8334.133942] alg: No test for adler32 (adler32-zlib) [ 8334.992920] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 8335.087359] LNet: Added LNI 192.168.204.116@tcp [8/256/0/180] [ 8336.672133] Key type lgssc registered [ 8337.053171] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8339.758464] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 8339.766064] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8340.920752] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8342.336518] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 8345.332410] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8345.447286] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8346.753413] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 8349.185765] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 8351.042488] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 8353.455021] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8353.570379] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8355.533536] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 8358.093745] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 8371.171578] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8371.171997] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [ 8371.176647] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 8371.180866] Lustre: Skipped 1 previous similar message [ 8373.593706] Lustre: lustre-MDT0001: Not available for connect from 192.168.204.16@tcp (stopping) [ 8376.290505] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 8376.293206] Lustre: Skipped 1 previous similar message [ 8377.232386] Lustre: server umount lustre-MDT0001 complete [ 8378.706834] LustreError: 360102:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.204.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8378.717304] LustreError: 360102:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 8381.226789] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8381.277293] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [ 8381.280196] Lustre: Found index 1 for lustre-MDT0001, updating log [ 8381.296642] Lustre: 357595:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8381.426675] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8383.074866] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 8386.540712] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 8387.046789] LustreError: 361284:0:(obd_mount.c:234:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [ 8387.049789] LustreError: 361284:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [ 8387.053703] LustreError: 357599:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [ 8387.073886] LustreError: 361287:0:(obd_config.c:2103:class_config_llog_handler()) MGC192.168.204.116@tcp: cfg command failed: rc = -17 [ 8387.077213] Lustre: cmd=cf001 0:lustre-MDT0001-osp-MDT0000 1:osp 2:lustre-MDT0000-mdtlov_UUID [ 8387.077213] [ 8685.918293] Lustre: lustre-MDT0001: Not available for connect from 192.168.204.16@tcp (stopping) [ 8688.611205] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8688.611895] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [ 8688.616059] Lustre: Skipped 1 previous similar message [ 8691.024226] Lustre: lustre-MDT0001: Not available for connect from 192.168.204.16@tcp (stopping) [ 8691.027347] Lustre: Skipped 2 previous similar messages [ 8699.360100] Lustre: lustre-MDT0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 8699.417773] Lustre: server umount lustre-MDT0001 complete [ 8701.264239] LustreError: 357602:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.204.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8702.869180] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8702.900149] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [ 8702.901822] Lustre: Found index 1 for lustre-MDT0001, updating log [ 8702.914932] Lustre: 357594:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8703.025294] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8704.441306] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 8708.071837] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 8709.605950] LustreError: 373688:0:(obd_mount.c:234:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [ 8709.608156] LustreError: 373688:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [ 8709.610935] LustreError: 357599:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [ 8709.612661] LustreError: 357599:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [ 8709.627823] LustreError: 373697:0:(obd_config.c:761:class_setup()) osp: device 8 already setup: rc = -17 [ 8709.631409] LustreError: 373697:0:(obd_config.c:866:class_detach()) OBD device 8 still set up [ 8709.633561] LustreError: 373697:0:(obd_config.c:2103:class_config_llog_handler()) MGC192.168.204.116@tcp: cfg command failed: rc = -17 [ 8709.636693] Lustre: cmd=cf003 0:lustre-MDT0001-osp-MDT0000 1:lustre-MDT0001_UUID 2:192.168.204.116@tcp [ 8709.636693] [ 9008.473928] Lustre: lustre-MDT0001: Not available for connect from 192.168.204.16@tcp (stopping) [ 9008.476161] Lustre: Skipped 5 previous similar messages [ 9010.148218] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9010.149707] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [ 9010.153401] Lustre: Skipped 2 previous similar messages [ 9014.094411] Lustre: server umount lustre-MDT0001 complete [ 9015.265457] LustreError: 363598:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9015.274215] LustreError: 363598:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 9017.714956] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9017.750533] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [ 9017.752749] Lustre: Found index 1 for lustre-MDT0001, updating log [ 9017.768333] Lustre: 357594:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 9017.883331] Lustre: lustre-MDT0001: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [ 9019.263841] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 9022.949911] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 9025.510664] LustreError: 386401:0:(obd_mount.c:234:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [ 9025.516276] LustreError: 386401:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [ 9025.520430] LustreError: 357599:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [ 9025.522101] LustreError: 357599:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [ 9025.537286] LustreError: 386405:0:(lod_lov.c:210:lod_add_device()) lustre-MDT0001-osp-MDT0000: cannot connect to next dev lustre-MDT0001_UUID (-114) [ 9025.542789] LustreError: 386405:0:(obd_config.c:2103:class_config_llog_handler()) MGC192.168.204.116@tcp: cfg command failed: rc = -114 [ 9025.546139] Lustre: cmd=cf014 0:lustre-MDT0000-mdtlov 1:lustre-MDT0001_UUID 2:1 3:1 [ 9025.546139] [ 9335.266789] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9335.267904] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9335.270751] Lustre: Skipped 2 previous similar messages [ 9335.273498] Lustre: Skipped 4 previous similar messages [ 9335.274995] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 9339.613351] Lustre: server umount lustre-MDT0000 complete [ 9340.385673] LustreError: 363598:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9340.392062] LustreError: 363598:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 9340.782083] LustreError: 359448:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788912698 with bad export cookie 4073774402530186611 [ 9340.784522] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9340.785315] LustreError: 359448:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 9345.504963] LustreError: 360102:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9345.505135] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9355.232091] Lustre: lustre-MDT0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 9355.313498] Lustre: server umount lustre-MDT0001 complete [ 9356.577577] Lustre: server umount lustre-OST0000 complete [ 9359.580995] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_hostid [ 9362.938032] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 9375.935482] Lustre: DEBUG MARKER: == conf-sanity test 120: cross-target rename should not create bad symlinks ========================================================== 20:12:13 (1788912733) [ 9378.091673] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9378.198265] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 9378.230430] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 9378.270669] Lustre: lustre-MDT0000: new disk, initializing [ 9378.293229] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9378.299772] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 9379.541552] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 9383.893058] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9383.941515] Lustre: 401058:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 9383.969918] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 9383.972365] Lustre: Skipped 1 previous similar message [ 9384.009621] Lustre: lustre-MDT0001: new disk, initializing [ 9384.048897] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9384.062328] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 9384.065639] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 9385.420224] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 9389.114868] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 9391.053561] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 9393.313965] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9393.430904] Lustre: lustre-OST0000: new disk, initializing [ 9393.433087] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 9393.436194] Lustre: 403027:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 9393.470375] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9395.447270] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_default_debug -1 all [ 9399.087834] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 9401.847992] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 9401.851446] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 9401.882175] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 9410.016846] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 9410.018619] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9410.021694] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9410.023378] Lustre: Skipped 2 previous similar messages [ 9413.402613] Lustre: server umount lustre-MDT0000 complete [ 9414.631305] LustreError: 401052:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788912772 with bad export cookie 4073774402530188550 [ 9414.633816] LustreError: 401868:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0000-osp-MDT0001: osp_attr_get update error [0x200000401:0x2:0x0]: rc = -5 [ 9414.634736] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9414.635536] LustreError: 401052:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 9414.749440] Lustre: server umount lustre-MDT0001 complete [ 9425.250609] Lustre: server umount lustre-OST0000 complete [ 9434.608093] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing set_hostid [ 9438.520171] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing load_modules_local [ 9458.096073] Lustre: DEBUG MARKER: == conf-sanity test complete, duration 9249 sec ========== 20:13:34 (1788912814) [ 9459.362676] Lustre: DEBUG MARKER: === conf-sanity: start cleanup 20:13:36 (1788912816) === [ 9461.921269] Lustre: DEBUG MARKER: === conf-sanity: finish cleanup 20:13:38 (1788912818) === [ 9488.689781] Lustre: DEBUG MARKER: oleg416-server.virtnet: executing unload_modules_local [ 9490.722485] Key type lgssc unregistered [ 9490.906077] LNet: 409383:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 9490.914110] LNetError: 409383:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 9490.924571] LNet: Removed LNI 192.168.204.116@tcp [ 9491.452600] Key type .llcrypt unregistered [ 9491.454622] Key type ._llcrypt unregistered