[ 0.000000] Linux version 4.18.0rh8.10-debug (green@maintenance) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-26) (GCC)) #2 SMP Mon Jul 14 01:24:22 EDT 2025 [ 0.000000] Command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffcdfff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffce000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x0000000146dfffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.8 present. [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 [ 0.000000] Hypervisor detected: KVM [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 475104020 cycles [ 0.000000] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns [ 0.000000] tsc: Detected 2399.998 MHz processor [ 0.000000] last_pfn = 0x146e00 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0xbffce max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000f54b0-0x000f54bf] [ 0.000000] RAMDISK: [mem 0xbcc54000-0xbffbffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F52D0 000014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 0x00000000BFFE247C 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 0x00000000BFFE2318 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 0x00000000BFFE0040 0022D8 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 0x00000000BFFE0000 000040 [ 0.000000] ACPI: APIC 0x00000000BFFE238C 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: HPET 0x00000000BFFE241C 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: WAET 0x00000000BFFE2454 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0xbffe2318-0xbffe238b] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe2317] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0xbffe238c-0xbffe241b] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0xbffe241c-0xbffe2453] [ 0.000000] ACPI: Reserving WAET table memory at [mem 0xbffe2454-0xbffe247b] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x0000000146dfffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x1465a3000-0x1465cdfff] [ 0.000000] Reserving 256MB of memory at 2752MB for crashkernel (System RAM: 4205MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009efff] [ 0.000000] node 0: [mem 0x0000000000100000-0x00000000bffcdfff] [ 0.000000] node 0: [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Zeroed struct page in unavailable ranges: 4756 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x0000000146dfffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] TSC deadline timer available [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] kvm-guest: KVM setup pv remote TLB flush [ 0.000000] kvm-guest: setup PV sched yield [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbffce000-0xbfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.000000] [mem 0xc0000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u524288 [ 0.000000] kvm-guest: PV spinlocks enabled [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1059606 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] audit: disabled (until reboot) [ 0.000000] software IO TLB: area num 4. [ 0.000000] Memory: 2829652K/4306352K available (18435K kernel code, 11221K rwdata, 7248K rodata, 2908K init, 18040K bss, 524580K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] ftrace: allocating 41240 entries in 162 pages [ 0.000000] ftrace: allocated 162 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU event tracing is enabled. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=4. [ 0.000000] rcu: RCU callback double-/use-after-free debug enabled. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 [ 0.000000] NR_IRQS: 524544, nr_irqs: 456, preallocated irqs: 16 [ 0.000000] random: get_random_bytes called from start_kernel+0x622/0x9a8 with crng_init=0 [ 0.001000] Console: colour *CGA 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns [ 0.001010] APIC: Switch to symmetric I/O mode setup [ 0.003374] x2apic enabled [ 0.004012] Switched APIC routing to physical x2apic. [ 0.005014] kvm-guest: setup PV IPIs [ 0.007832] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.008000] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 0.009019] Calibrating delay loop (skipped) preset value.. 4799.99 BogoMIPS (lpj=2399998) [ 0.010014] pid_max: default: 32768 minimum: 301 [ 0.011126] LSM: Security Framework initializing [ 0.012046] Yama: becoming mindful. [ 0.013035] SELinux: Initializing. [ 0.014066] *** VALIDATE selinux *** [ 0.021781] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, vmalloc) [ 0.026779] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc) [ 0.027150] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.028110] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.029106] *** VALIDATE tmpfs *** [ 0.030461] *** VALIDATE proc *** [ 0.031239] *** VALIDATE cgroup *** [ 0.032008] *** VALIDATE cgroup2 *** [ 0.033241] x86/cpu: User Mode Instruction Prevention (UMIP) activated [ 0.034151] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.035010] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 [ 0.036029] Spectre V2 : User space: Vulnerable [ 0.037010] Speculative Store Bypass: Vulnerable [ 0.040421] debug: unmapping init [mem 0xffffffff91e59000-0xffffffff91e60fff] [ 0.042191] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (family: 0x6, model: 0x3e, stepping: 0x4) [ 0.043714] Performance Events: IvyBridge events, full-width counters, Intel PMU driver. [ 0.044021] ... version: 2 [ 0.045012] ... bit width: 48 [ 0.046012] ... generic registers: 4 [ 0.047012] ... value mask: 0000ffffffffffff [ 0.048013] ... max period: 00007fffffffffff [ 0.049013] ... fixed-purpose events: 3 [ 0.050009] ... event mask: 000000070000000f [ 0.051271] rcu: Hierarchical SRCU implementation. [ 0.053325] smp: Bringing up secondary CPUs ... [ 0.054574] x86: Booting SMP configuration: [ 0.055024] .... node #0, CPUs: #1 #2 #3 [ 0.058453] smp: Brought up 1 node, 4 CPUs [ 0.059886] smpboot: Max logical packages: 1 [ 0.060016] smpboot: Total of 4 processors activated (19199.98 BogoMIPS) [ 0.134794] node 0 deferred pages initialised in 70ms [ 0.138294] devtmpfs: initialized [ 0.139227] x86/mm: Memory block size: 128MB [ 0.141657] gcov: version magic: 0x41383552 [ 0.144430] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.147094] futex hash table entries: 1024 (order: 4, 65536 bytes, vmalloc) [ 0.148305] pinctrl core: initialized pinctrl subsystem [ 0.150136] [ 0.150742] ************************************************************* [ 0.152013] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.154010] ** ** [ 0.156026] ** IOMMU DebugFS SUPPORT HAS BEEN ENABLED IN THIS KERNEL ** [ 0.159022] ** ** [ 0.162022] ** This means that this kernel is built to expose internal ** [ 0.164018] ** IOMMU data structures, which may compromise security on ** [ 0.166024] ** your system. ** [ 0.169022] ** ** [ 0.171020] ** If you see this message and you are not debugging the ** [ 0.174022] ** kernel, report this immediately to your vendor! ** [ 0.176017] ** ** [ 0.178022] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.180024] ************************************************************* [ 0.183789] NET: Registered protocol family 16 [ 0.186527] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations [ 0.188081] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.191098] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.195018] cpuidle: using governor menu [ 0.196000] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.198700] PCI: Using configuration type 1 for base access [ 0.201178] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.210113] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.213048] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.216128] cryptd: max_cpu_qlen set to 1000 [ 0.219298] ACPI: Added _OSI(Module Device) [ 0.221013] ACPI: Added _OSI(Processor Device) [ 0.222015] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.224014] ACPI: Added _OSI(Processor Aggregator Device) [ 0.228385] ACPI: 1 ACPI AML tables successfully acquired and loaded [ 0.236446] ACPI: Interpreter enabled [ 0.238064] ACPI: PM: (supports S0 S3 S4 S5) [ 0.239012] ACPI: Using IOAPIC for interrupt routing [ 0.241091] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.244432] ACPI: Enabled 2 GPEs in block 00 to 0F [ 0.255184] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.257040] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3] [ 0.260015] acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI] [ 0.262075] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.267414] acpiphp: Slot [2] registered [ 0.268224] acpiphp: Slot [5] registered [ 0.270152] acpiphp: Slot [6] registered [ 0.271145] acpiphp: Slot [7] registered [ 0.273097] acpiphp: Slot [8] registered [ 0.274092] acpiphp: Slot [9] registered [ 0.275121] acpiphp: Slot [10] registered [ 0.277146] acpiphp: Slot [3] registered [ 0.279102] acpiphp: Slot [4] registered [ 0.281142] acpiphp: Slot [11] registered [ 0.282101] acpiphp: Slot [12] registered [ 0.284116] acpiphp: Slot [13] registered [ 0.285136] acpiphp: Slot [14] registered [ 0.287096] acpiphp: Slot [15] registered [ 0.288103] acpiphp: Slot [16] registered [ 0.290102] acpiphp: Slot [17] registered [ 0.292150] acpiphp: Slot [18] registered [ 0.294082] acpiphp: Slot [19] registered [ 0.296108] acpiphp: Slot [20] registered [ 0.297000] acpiphp: Slot [21] registered [ 0.297000] acpiphp: Slot [22] registered [ 0.299183] acpiphp: Slot [23] registered [ 0.301106] acpiphp: Slot [24] registered [ 0.302153] acpiphp: Slot [25] registered [ 0.304070] acpiphp: Slot [26] registered [ 0.305091] acpiphp: Slot [27] registered [ 0.307103] acpiphp: Slot [28] registered [ 0.308083] acpiphp: Slot [29] registered [ 0.310116] acpiphp: Slot [30] registered [ 0.311094] acpiphp: Slot [31] registered [ 0.312070] PCI host bridge to bus 0000:00 [ 0.314018] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.317024] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.319021] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.322023] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 0.325052] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] [ 0.327021] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.328172] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.331019] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.334424] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 0.344815] pci 0000:00:01.1: reg 0x20: [io 0xc320-0xc32f] [ 0.350058] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.352024] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.354024] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.356027] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.359611] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 0.362804] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 0.365051] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 0.369533] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 [ 0.375017] pci 0000:00:02.0: reg 0x10: [io 0xc300-0xc31f] [ 0.387826] pci 0000:00:02.0: reg 0x20: [mem 0xe0000000000-0xe0000003fff 64bit pref] [ 0.392013] pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 0.397623] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 [ 0.403015] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] [ 0.413016] pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] [ 0.432015] pci 0000:00:05.0: reg 0x20: [mem 0xe0000004000-0xe0000007fff 64bit pref] [ 0.441000] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 [ 0.448024] pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] [ 0.457031] pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 0.475024] pci 0000:00:06.0: reg 0x20: [mem 0xe0000008000-0xe000000bfff 64bit pref] [ 0.485983] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 [ 0.495013] pci 0000:00:07.0: reg 0x10: [io 0xc100-0xc17f] [ 0.500013] pci 0000:00:07.0: reg 0x14: [mem 0xfebc2000-0xfebc2fff] [ 0.516015] pci 0000:00:07.0: reg 0x20: [mem 0xe000000c000-0xe000000ffff 64bit pref] [ 0.527597] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 [ 0.533014] pci 0000:00:08.0: reg 0x10: [io 0xc180-0xc1ff] [ 0.538014] pci 0000:00:08.0: reg 0x14: [mem 0xfebc3000-0xfebc3fff] [ 0.552014] pci 0000:00:08.0: reg 0x20: [mem 0xe0000010000-0xe0000013fff 64bit pref] [ 0.561606] pci 0000:00:09.0: [1af4:1001] type 00 class 0x010000 [ 0.567014] pci 0000:00:09.0: reg 0x10: [io 0xc200-0xc27f] [ 0.577014] pci 0000:00:09.0: reg 0x14: [mem 0xfebc4000-0xfebc4fff] [ 0.597014] pci 0000:00:09.0: reg 0x20: [mem 0xe0000014000-0xe0000017fff 64bit pref] [ 0.608282] pci 0000:00:0a.0: [1af4:1001] type 00 class 0x010000 [ 0.614013] pci 0000:00:0a.0: reg 0x10: [io 0xc280-0xc2ff] [ 0.623016] pci 0000:00:0a.0: reg 0x14: [mem 0xfebc5000-0xfebc5fff] [ 0.645016] pci 0000:00:0a.0: reg 0x20: [mem 0xe0000018000-0xe000001bfff 64bit pref] [ 0.655552] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 [ 0.658448] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 0.661415] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 [ 0.663343] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 0.668237] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 [ 0.672123] iommu: Default domain type: Passthrough [ 0.674631] SCSI subsystem initialized [ 0.676236] ACPI: bus type USB registered [ 0.678148] usbcore: registered new interface driver usbfs [ 0.680138] usbcore: registered new interface driver hub [ 0.682113] usbcore: registered new device driver usb [ 0.684223] pps_core: LinuxPPS API ver. 1 registered [ 0.686013] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 0.689092] PTP clock support registered [ 0.692058] EDAC MC: Ver: 3.0.0 [ 0.693494] PCI: Using ACPI for IRQ routing [ 0.695954] NetLabel: Initializing [ 0.697018] NetLabel: domain hash size = 128 [ 0.699013] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 0.700096] NetLabel: unlabeled traffic allowed by default [ 0.702038] vgaarb: loaded [ 0.703264] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 0.704021] hpet0: 3 comparators, 64-bit 100.000000 MHz counter [ 0.709330] clocksource: Switched to clocksource kvm-clock [ 0.814032] VFS: Disk quotas dquot_6.6.0 [ 0.815791] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 0.818542] *** VALIDATE ramfs *** [ 0.819901] *** VALIDATE hugetlbfs *** [ 0.821570] pnp: PnP ACPI init [ 0.823990] pnp: PnP ACPI: found 6 devices [ 0.841806] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 0.845489] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 0.847866] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 0.850401] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 0.852944] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 0.855570] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] [ 0.858058] NET: Registered protocol family 2 [ 0.860071] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, vmalloc) [ 0.864424] tcp_listen_portaddr_hash hash table entries: 4096 (order: 5, 163840 bytes, vmalloc) [ 0.868523] TCP established hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.874621] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc) [ 0.878496] TCP: Hash tables configured (established 65536 bind 65536) [ 0.881536] MPTCP token hash table entries: 8192 (order: 6, 393216 bytes, vmalloc) [ 0.884545] UDP hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.887820] UDP-Lite hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.891155] NET: Registered protocol family 1 [ 0.893916] RPC: Registered named UNIX socket transport module. [ 0.895900] RPC: Registered udp transport module. [ 0.897619] RPC: Registered tcp transport module. [ 0.899593] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 0.902073] NET: Registered protocol family 44 [ 0.903444] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 0.905851] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 0.908292] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 0.910559] PCI: CLS 0 bytes, default 64 [ 0.912574] Unpacking initramfs... [ 2.358525] debug: unmapping init [mem 0xffff959cbcc54000-0xffff959cbffbffff] [ 2.363242] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 2.366341] software IO TLB: mapped [mem 0x00000000a8000000-0x00000000ac000000] (64MB) [ 2.369739] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 2.861894] Initialise system trusted keyrings [ 2.863689] Key type blacklist registered [ 2.865597] workingset: timestamp_bits=36 max_order=20 bucket_order=0 [ 2.874493] zbud: loaded [ 2.877573] *** VALIDATE nfs *** [ 2.878658] *** VALIDATE nfs4 *** [ 2.882039] pstore: using deflate compression [ 2.886045] Platform Keyring initialized [ 3.000290] NET: Registered protocol family 38 [ 3.002373] Key type asymmetric registered [ 3.003973] Asymmetric key parser 'x509' registered [ 3.006238] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 3.009125] io scheduler mq-deadline registered [ 3.010948] io scheduler kyber registered [ 3.015045] io scheduler bfq registered [ 3.016804] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 3.019883] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.022709] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 3.027241] ACPI: Power Button [PWRF] [ 3.034637] ACPI: \_SB_.LNKB: Enabled at IRQ 10 [ 3.041624] ACPI: \_SB_.LNKA: Enabled at IRQ 11 [ 3.058142] ACPI: \_SB_.LNKC: Enabled at IRQ 11 [ 3.068310] ACPI: \_SB_.LNKD: Enabled at IRQ 10 [ 3.086910] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 3.113058] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.142866] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.149036] Non-volatile memory driver v1.3 [ 3.151795] Linux agpgart interface v0.103 [ 3.184320] virtio_blk virtio1: [vda] 146024 512-byte logical blocks (74.8 MB/71.3 MiB) [ 3.189066] vda: detected capacity change from 0 to 74764288 [ 3.202459] virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) [ 3.205408] vdb: detected capacity change from 0 to 1073741824 [ 3.221784] virtio_blk virtio3: [vdc] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 3.225179] vdc: detected capacity change from 0 to 2621440000 [ 3.242098] virtio_blk virtio4: [vdd] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 3.244791] vdd: detected capacity change from 0 to 2621440000 [ 3.259465] virtio_blk virtio5: [vde] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 3.262554] vde: detected capacity change from 0 to 4294967296 [ 3.277524] virtio_blk virtio6: [vdf] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 3.280916] vdf: detected capacity change from 0 to 4294967296 [ 3.291899] libphy: Fixed MDIO Bus: probed [ 3.298167] usbcore: registered new interface driver usbserial_generic [ 3.300941] usbserial: USB Serial support registered for generic [ 3.303305] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 3.308454] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 3.310144] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 3.312503] mousedev: PS/2 mouse device common for all mice [ 3.315601] rtc_cmos 00:05: RTC can wake from S4 [ 3.315655] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 3.319699] rtc_cmos 00:05: registered as rtc0 [ 3.322977] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 3.324889] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 [ 3.327053] intel_pstate: CPU model not supported [ 3.332665] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 [ 3.336428] hid: raw HID events driver (C) Jiri Kosina [ 3.338472] usbcore: registered new interface driver usbhid [ 3.340322] usbhid: USB HID core driver [ 3.341635] drop_monitor: Initializing network drop monitor service [ 3.344033] Initializing XFRM netlink socket [ 3.345780] NET: Registered protocol family 10 [ 3.348777] Segment Routing with IPv6 [ 3.350215] NET: Registered protocol family 17 [ 3.352432] mpls_gso: MPLS GSO support [ 3.358969] RAS: Correctable Errors collector initialized. [ 3.361579] AVX version of gcm_enc/dec engaged. [ 3.363288] AES CTR mode by8 optimization enabled [ 3.447819] sched_clock: Marking stable (3447794442, 0)->(4327075486, -879281044) [ 3.450789] registered taskstats version 1 [ 3.453413] Loading compiled-in X.509 certificates [ 3.455486] zswap: loaded using pool lzo/zbud [ 3.481473] Key type big_key registered [ 3.493790] Key type encrypted registered [ 3.495251] ima: No TPM chip found, activating TPM-bypass! [ 3.497084] ima: Allocated hash algorithm: sha1 [ 3.498633] ima: No architecture policies found [ 3.500355] evm: Initialising EVM extended attributes: [ 3.501786] evm: security.selinux [ 3.502914] evm: security.ima [ 3.504097] evm: security.capability [ 3.505276] evm: HMAC attrs: 0x1 [ 3.507710] rtc_cmos 00:05: setting system clock to 2026-09-02 00:40:22 UTC (1788309622) [ 3.513845] debug: unmapping init [mem 0xffffffff92e03000-0xffffffff92ffffff] [ 3.517247] debug: unmapping init [mem 0xffffffff91b82000-0xffffffff91e58fff] [ 3.526086] Write protecting the kernel read-only data: 28672k [ 3.529543] debug: unmapping init [mem 0xffffffff90203000-0xffffffff903fffff] [ 3.533106] debug: unmapping init [mem 0xffffffff90b14000-0xffffffff90bfffff] [ 3.571551] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 3.580476] systemd[1]: Detected virtualization kvm. [ 3.582423] systemd[1]: Detected architecture x86-64. [ 3.584514] systemd[1]: Running in initial RAM disk. Welcome to Rocky Linux 8.10 (Green Obsidian) dracut-049-233.git20240115.el8 (Initramfs)! [ 3.615045] systemd[1]: No hostname configured. [ 3.617027] systemd[1]: Set hostname to . [ 3.619718] random: systemd: uninitialized urandom read (16 bytes read) [ 3.622711] systemd[1]: Initializing machine ID from random generator. [ 3.658198] random: ln: uninitialized urandom read (6 bytes read) [ 3.769655] random: systemd: uninitialized urandom read (16 bytes read) [ 3.772304] systemd[1]: Reached target Timers. [ OK ] Reached target Timers. [ 3.776208] systemd[1]: Reached target Swap. [ OK ] Reached target Swap. [ 3.781396] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ OK ] Listening on udev Control Socket. [ OK ] Started Memstrack Anylazing Service. [ OK ] Reached target Initrd Root Device. [ OK ] Listening on Journal Socket (/dev/log). Starting Journal Service... [ OK ] Listening on udev Kernel Socket. [ OK ] Reached target Sockets. Starting Apply Kernel Variables... [ OK ] Reached target Slices. Starting Setup Virtual Console... Starting Create list of required st…ce nodes for the current kernel... [ OK ] Reached target Local File Systems. Starting Create Volatile Files and Directories... [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Reached target Paths. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Started Apply Kernel Variables. [ OK ] Started Setup Virtual Console. [ OK ] Started Create list of required sta…vice nodes for the current kernel. Starting Create Static Device Nodes in /dev... Starting dracut cmdline hook... [ OK ] Started Create Volatile Files and Directories. [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started Journal Service. [ OK ] [ 4.373195] random: fast init done Started dracut cmdline hook. Starting dracut pre-udev hook... [ 4.429041] device-mapper: uevent: version 1.0.3 [ 4.431309] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting dracut pre-trigger hook... [ OK ] Started dracut pre-trigger hook. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. Starting dracut initqueue hook... [ OK ] Reached target System Initialization. [ OK ] Reached target Basic System. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. [ 5.170778] virtio_net virtio0 ens2: renamed from eth0 [ 5.268317] scsi host0: ata_piix [ 5.294476] scsi host1: ata_piix [ 5.296318] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc320 irq 14 [ 5.298680] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc328 irq 15 [ 9.677027] dracut-initqueue[589]: RTNETLINK answers: File exists [ 10.011928] random: crng init done [ 10.018593] random: 7 urandom warning(s) missed due to ratelimiting Starting nbd nbd0... [ OK ] Started nbd nbd0. [ OK ] Started dracut initqueue hook. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Mounting /sysroot... [ 10.992552] EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... Stopping Hardware RNG Entropy Gatherer Daemon... [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Timers. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped Hardware RNG Entropy Gatherer Daemon. [ OK ] Stopped target Basic System. [ OK ] Stopped target Slices. [ OK ] Stopped target Sockets. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Local Encrypted Volumes. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped dracut pre-trigger hook. [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped Create Volatile Files and Directories. Stopping udev Kernel Device Manager... [ OK ] Stopped target Swap. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Paths. [ OK ] Stopped Dispatch Password Requests to Console Directory Watch. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Closed udev Kernel Socket. [ OK ] Closed udev Control Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Reached target Switch Root. Starting Switch Root... [ 13.413808] printk: systemd: 26 output lines suppressed due to ratelimiting [ 14.228878] SELinux: Disabled at runtime. [ 14.361291] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 14.379102] systemd[1]: Detected virtualization kvm. [ 14.384151] systemd[1]: Detected architecture x86-64. Welcome to Rocky Linux 8.10 (Green Obsidian)! [ 15.924379] systemd[1]: initrd-switch-root.service: Succeeded. [ 15.930533] systemd[1]: Stopped Switch Root. [ OK ] Stopped Switch Root. [ 15.942510] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. [ 15.952974] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 15.957393] systemd[1]: Stopped Journal Service. [ OK ] Stopped Journal Service. [ 15.976978] systemd[1]: Starting Journal Service... Starting Journal Service... [ 15.996561] systemd[1]: Starting Remount Root and Kernel File Systems... Starting Remount Root and Kernel File Systems... [ OK ] Created slice User and Session Slice. [ OK ] Stopped target Switch Root. Starting Apply Kernel Variables... [ OK ] Listening on udev Control Socket. [ OK ] Reached target Slices. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Listening on udev Kernel Socket. Mounting Huge Pages File System... [ OK ] Started Forward Password Requests to Wall Directory Watch. Mounting POSIX Message Queue File System... Starting Create list of required st…ce nodes for the current kernel... [FAILED] Failed to set up automount Arbitrar…rmats File System Automount Point. See 'systemctl status proc-sys-fs-binfmt_misc.automount' for details. [ OK ] Reached target RPC Port Mapper. [ OK ] Listening on Process Core Dump Socket. [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Reached target Paths. [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Stopped target Initrd Root File System. [ OK ] Created slice system-getty.slice. [ OK ] Stopped target Initrd File Systems. Starting udev Coldplug all Devices... [ OK ] Reached target Local Encrypted Volumes. [ OK ] Created slice system-serial\x2dgetty.slice. [ OK ] Created slice system-sshd\x2dkeygen.slice. Activating swap /dev/disk/by-label/SWAP... [ OK ] Reached target rpc_pipefs.target. Mounting Kernel Debug File System... [ 16.566572] Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS [ OK ] Started Journal Service. [FAILED] Failed to start Remount Root and Kernel File Systems. See 'systemctl status systemd-remount-fs.service' for details. [ OK ] Started Apply Kernel Variables. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Activated swap /dev/disk/by-label/SWAP. [ OK ] Mounted Kernel Debug File System. [ OK ] Reached target Swap. Starting Configure read-only root support... Starting Create Static Device Nodes in /dev... Starting Flush Journal to Persistent Storage... [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started udev Coldplug all Devices. [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Reached target Local File Systems (Pre). Mounting /home/green/git/lustre-release... Mounting /mnt... Starting udev Kernel Device Manager... [ OK ] Mounted /mnt. [ 17.270893] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ OK ] Mounted /home/green/git/lustre-release. [ OK ] Started udev Kernel Device Manager. [ 18.117615] input: PC Speaker as /devices/platform/pcspkr/input/input5 [ 18.167751] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 18.728142] RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer [ 18.767737] EDAC sbridge: Ver: 1.1.2 [ 22.115686] Key type dns_resolver registered [ 22.891097] NFS: Registering the id_resolver key type [ 22.896523] Key type id_resolver registered [ 22.899939] Key type id_legacy registered [* ] A start job is running for Configur…-only root support (7s / no limit) [** ] A start job is running for Configur…-only root support (7s / no limit) [ OK ] Started Configure read-only root support. [ OK ] Reached target Local File Systems. Starting Mark the need to relabel after reboot... Starting Rebuild Dynamic Linker Cache... Starting Create Volatile Files and Directories... Starting Load/Save Random Seed... [ OK ] Started Mark the need to relabel after reboot. [ OK ] Started Load/Save Random Seed. [ OK ] Started Create Volatile Files and Directories. Starting Update UTMP about System Boot/Shutdown... Starting RPC Bind... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Started RPC Bind. [ OK ] Started Rebuild Dynamic Linker Cache. Starting Update is Completed... [ OK ] Started Update is Completed. [ OK ] Reached target System Initialization. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Reached target Sockets. [ OK ] Started dnf makecache --timer. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Reached target Basic System. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. [ OK ] Reached target sshd-keygen.target. Starting Restore /run/initramfs on shutdown... [ OK ] Started irqbalance daemon. [ OK ] Started D-Bus System Message Bus. Starting Network Manager... Starting Login Service... [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Reached target Timers. [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Network Manager. Starting Network Manager Wait Online... [ OK ] Reached target Network. Starting OpenSSH server daemon... Starting GSSAPI Proxy Daemon... Starting Dynamic System Tuning Daemon... Starting Hostname Service... [ OK ] Started OpenSSH server daemon. [ OK ] Started Login Service. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Started Permit User Sessions. [ OK ] Started Serial Getty on ttyS1. [ OK ] Started Serial Getty on ttyS0. [ OK ] Started Command Scheduler. [ OK ] Started Getty on tty1. [ OK ] Reached target Login Prompts. [ OK ] Started Hostname Service. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ 29.572194] hrtimer: interrupt took 7332075 ns [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... Starting System Logging Service... Starting Notify NFS peers of a restart... [ OK ] Started Notify NFS peers of a restart. [ OK ] Started System Logging Service. Rocky Linux 8.10 (Green Obsidian) Kernel 4.18.0rh8.10-debug on an x86_64 oleg608-server login: [ 77.065738] libcfs: loading out-of-tree module taints kernel. [ 77.129386] Key type ._llcrypt registered [ 77.134289] Key type .llcrypt registered [ 77.233747] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_hostid [ 95.573691] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [ 97.104242] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 97.117668] alg: No test for adler32 (adler32-zlib) [ 98.669490] Lustre: Lustre: Build Version: 2.17.57_45_g07d9be3 [ 99.635732] LNet: Added LNI 192.168.206.108@tcp [8/256/0/180] [ 101.423840] Key type lgssc registered [ 103.146145] Lustre: Echo OBD driver; http://www.lustre.org/ [ 116.669440] ZFS: Loaded module v2.3.2-1, ZFS pool version 5000, ZFS filesystem version 5 [ 154.913782] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [ 166.587637] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 166.618683] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 167.820456] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 167.843322] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 167.917192] Lustre: lustre-MDT0000: new disk, initializing [ 167.983537] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 167.998802] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 171.857703] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 183.511700] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 183.602577] Lustre: 6509:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 183.623568] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 183.630569] Lustre: Skipped 1 previous similar message [ 183.697286] Lustre: lustre-MDT0001: new disk, initializing [ 183.737794] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 183.759635] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 183.767276] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 186.950196] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 191.478952] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 200.444441] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 200.719664] Lustre: lustre-OST0000: new disk, initializing [ 200.722627] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 200.726836] Lustre: 8448:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 200.811300] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 204.586324] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 204.598513] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 204.676419] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 207.435446] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 221.827892] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 222.001756] Lustre: lustre-OST0001: new disk, initializing [ 222.004439] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 222.008242] Lustre: 9521:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 222.060627] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 228.407992] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 232.002383] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 232.017934] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 232.078481] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 239.040203] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 250.568793] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 256.843483] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing check_logdir /tmp/testlogs/ [ 262.185496] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing yml_node [ 266.562756] Lustre: DEBUG MARKER: Client: 2.17.57.45 [ 268.896365] Lustre: DEBUG MARKER: MDS: 2.17.57.45 [ 271.459790] Lustre: DEBUG MARKER: OSS: 2.17.57.45 [ 272.949808] Lustre: DEBUG MARKER: -----============= acceptance-small: conf-sanity ============----- Tue Sep 1 20:44:50 EDT 2026 [ 288.534971] Lustre: DEBUG MARKER: excepting tests: 102 106 115 32newtarball [ 289.919762] Lustre: DEBUG MARKER: skipping tests SLOW=no: 45 69 106 111 114 [ 306.656024] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 306.669083] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 306.681137] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 308.704242] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 308.708868] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 308.716053] Lustre: Skipped 1 previous similar message [ 308.726631] Lustre: Skipped 1 previous similar message [ 311.277195] Lustre: server umount lustre-MDT0000 complete [ 314.434114] LustreError: 6503:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788309933 with bad export cookie 8025112041213409697 [ 314.456532] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 318.943455] LustreError: 6517:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 318.943737] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 318.956937] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 318.961059] LustreError: 6517:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 6 previous similar messages [ 318.989272] Lustre: Skipped 2 previous similar messages [ 319.972748] LustreError: 6515:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 319.996231] LustreError: 6515:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 320.877594] Lustre: server umount lustre-MDT0001 complete [ 324.498203] Lustre: server umount lustre-OST0000 complete [ 327.728615] Lustre: server umount lustre-OST0001 complete [ 333.193024] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_hostid [ 343.209928] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [ 377.471983] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 377.723686] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 377.747669] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 377.869875] Lustre: lustre-MDT0000: new disk, initializing [ 377.962727] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 377.990622] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 382.206752] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 391.666710] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 391.753548] Lustre: 15067:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 391.795148] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 391.802511] Lustre: Skipped 1 previous similar message [ 391.858787] Lustre: lustre-MDT0001: new disk, initializing [ 391.935965] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 391.977546] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 391.988294] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 396.183668] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 404.730559] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 409.453317] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 415.036025] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 415.291786] Lustre: lustre-OST0000: new disk, initializing [ 415.295511] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 415.300744] Lustre: 17037:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 415.387286] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 417.343912] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 417.351581] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 417.460362] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 421.056774] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 429.002631] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 433.011285] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 433.237053] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 436.880666] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 437.051253] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 443.367483] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 443.370619] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 443.373368] LustreError: Skipped 1 previous similar message [ 443.376166] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 443.385801] Lustre: Skipped 1 previous similar message [ 443.396816] Lustre: Skipped 4 previous similar messages [ 444.763726] Lustre: server umount lustre-OST0000 complete [ 448.480434] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 448.486335] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 448.489896] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 448.495513] Lustre: Skipped 1 previous similar message [ 454.726827] Lustre: server umount lustre-MDT0000 complete [ 458.392221] LustreError: 15060:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788310077 with bad export cookie 8025112041213411230 [ 458.395236] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 458.401565] LustreError: 15060:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 8 previous similar messages [ 458.777944] Lustre: server umount lustre-MDT0001 complete [ 463.516466] Lustre: DEBUG MARKER: == conf-sanity test 76a: set permanent params with lctl across mounts ========================================================== 20:48:01 (1788310081) [ 470.722898] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 471.211128] LustreError: 19302:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 471.263106] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 475.159213] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 476.643721] LustreError: 19303:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 481.761796] LustreError: 19302:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 483.102214] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 487.856650] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 497.225777] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 503.142580] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 510.077443] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 516.802989] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 524.407939] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 531.610548] Lustre: Modifying parameter general.osc.*.max_dirty_mb=452 in log params [ 539.110033] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 539.130665] Lustre: Skipped 1 previous similar message [ 539.130941] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 539.149794] Lustre: Skipped 5 previous similar messages [ 544.230112] LustreError: 21141:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 544.437726] Lustre: server umount lustre-MDT0000 complete [ 547.932871] LustreError: 21830:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788310166 with bad export cookie 8025112041213412112 [ 547.941631] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 547.955545] LustreError: 21830:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 548.265497] Lustre: server umount lustre-MDT0001 complete [ 562.811247] Lustre: server umount lustre-OST0000 complete [ 580.991972] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [ 588.354371] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 588.704098] LustreError: 23679:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 588.719057] LustreError: 23679:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 588.775516] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 588.779686] Lustre: Skipped 2 previous similar messages [ 592.076608] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 599.243054] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 604.635857] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 607.741095] Lustre: Setting parameter general.debug_raw_pointers=Y in log params [ 615.022552] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 621.845519] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 629.942199] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 630.158550] Lustre: lustre-OST0001: new disk, initializing [ 630.165627] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 630.174592] Lustre: 25993:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 631.571738] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 631.581620] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 631.663078] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 635.536520] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 644.605751] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 648.078035] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 660.961219] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 660.968541] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 660.988614] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 667.292123] Lustre: server umount lustre-MDT0000 complete [ 670.693573] LustreError: 23680:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 670.709271] LustreError: 23680:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 5 previous similar messages [ 670.715216] LustreError: 25992:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788310289 with bad export cookie 8025112041213412952 [ 670.721970] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 670.723230] LustreError: 25992:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 671.062226] Lustre: server umount lustre-MDT0001 complete [ 685.090739] Lustre: server umount lustre-OST0000 complete [ 698.935856] Lustre: server umount lustre-OST0001 complete [ 715.295411] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [ 725.289983] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 725.596624] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 725.603979] Lustre: Skipped 3 previous similar messages [ 729.411054] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 735.716661] LustreError: 29015:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 735.742045] LustreError: 29015:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 737.248846] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 741.623687] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 744.138329] Lustre: 30165:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 751.125840] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 759.084985] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 768.036258] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 774.127247] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 781.176835] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 784.745543] Lustre: 32043:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 791.009868] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 791.019155] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 791.025604] Lustre: Skipped 5 previous similar messages [ 791.037740] Lustre: Skipped 5 previous similar messages [ 796.101050] Lustre: server umount lustre-MDT0000 complete [ 799.121959] LustreError: 28997:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788310418 with bad export cookie 8025112041213414254 [ 799.130556] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 799.130947] LustreError: 28997:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 799.428571] Lustre: server umount lustre-MDT0001 complete [ 813.079212] Lustre: server umount lustre-OST0000 complete [ 826.809921] Lustre: server umount lustre-OST0001 complete [ 834.933615] Lustre: DEBUG MARKER: == conf-sanity test 76b: verify params log setup correctly ========================================================== 20:54:12 (1788310452) [ 857.464462] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [ 864.645462] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 864.981351] LustreError: 34844:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 865.001382] LustreError: 34844:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 6 previous similar messages [ 868.766590] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 875.597604] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 879.074372] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 881.202900] Lustre: 35994:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 886.594091] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 892.431598] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 899.164872] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 904.090247] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 911.040808] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 914.929619] Lustre: 37872:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 921.061605] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 921.063495] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 921.074454] Lustre: Skipped 4 previous similar messages [ 921.090728] Lustre: Skipped 3 previous similar messages [ 926.587047] Lustre: server umount lustre-MDT0000 complete [ 929.629276] LustreError: 34825:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788310548 with bad export cookie 8025112041213415360 [ 929.637054] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 929.637835] LustreError: 34825:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 6 previous similar messages [ 930.064693] Lustre: server umount lustre-MDT0001 complete [ 943.147058] Lustre: server umount lustre-OST0000 complete [ 956.901676] Lustre: server umount lustre-OST0001 complete [ 964.713958] Lustre: DEBUG MARKER: == conf-sanity test 76c: verify changelog_mask is applied with lctl set_param -P ========================================================== 20:56:22 (1788310582) [ 979.100376] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [ 987.611708] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 987.948883] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 987.972485] Lustre: Skipped 7 previous similar messages [ 991.938270] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 1000.903121] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1005.678480] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 1008.724593] Lustre: 41167:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 1015.701049] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1022.565760] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 1031.105372] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1038.170613] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 1045.693416] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1049.030305] Lustre: 43047:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 1050.235423] Lustre: Setting parameter general.mdd.*.changelog_mask=-CLOSE in log params [ 1050.244260] Lustre: Skipped 1 previous similar message [ 1053.156794] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1053.159585] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1053.168446] Lustre: Skipped 1 previous similar message [ 1053.175151] Lustre: Skipped 7 previous similar messages [ 1059.009993] Lustre: server umount lustre-MDT0000 complete [ 1062.906751] LustreError: 39996:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788310681 with bad export cookie 8025112041213416466 [ 1062.912425] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1062.927194] LustreError: 39996:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 1069.266695] Lustre: server umount lustre-MDT0001 complete [ 1079.011705] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1092.285496] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 1097.514579] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 1101.560244] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1105.910736] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 1107.451636] Lustre: lustre-MDT0001-lwp-OST0001: Connection restored to 0@lo (at 0@lo) [ 1107.458856] Lustre: Skipped 1 previous similar message [ 1113.413836] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1115.268945] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 1121.083541] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 1122.610872] Lustre: DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec [ 1132.515778] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1133.743816] Lustre: server umount lustre-MDT0000 complete [ 1137.257814] LustreError: 39995:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788310756 with bad export cookie 8025112041213417558 [ 1137.267560] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1137.280373] LustreError: 39995:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 1137.509288] Lustre: server umount lustre-MDT0001 complete [ 1150.924804] Lustre: server umount lustre-OST0000 complete [ 1163.202722] Lustre: server umount lustre-OST0001 complete [ 1171.239973] Lustre: DEBUG MARKER: == conf-sanity test 76d: verify llite.*.xattr_cache can be set by 'lctl set_param -P' correctly ========================================================== 20:59:48 (1788310788) [ 1185.501983] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [ 1193.199636] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1193.601762] LustreError: 47650:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1193.613394] LustreError: 47650:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 22 previous similar messages [ 1197.639307] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 1205.824373] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1210.711088] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 1213.631167] Lustre: 48802:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 1219.276513] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1224.951288] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 1232.317777] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1238.188410] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 1244.714734] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1248.464496] Lustre: Setting parameter general.llite.*.xattr_cache=0 in log params [ 1261.612537] Lustre: server umount lustre-MDT0000 complete [ 1264.692663] LustreError: 47630:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788310883 with bad export cookie 8025112041213418377 [ 1264.695674] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1264.702318] LustreError: 47630:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 1265.037467] Lustre: server umount lustre-MDT0001 complete [ 1279.098082] Lustre: server umount lustre-OST0000 complete [ 1292.849081] Lustre: server umount lustre-OST0001 complete [ 1301.672770] Lustre: DEBUG MARKER: == conf-sanity test 77: comma-separated MGS NIDs and failover node NIDs ========================================================== 21:01:59 (1788310919) [ 1303.966283] Lustre: DEBUG MARKER: SKIP: conf-sanity test_77 mixed loopback and real device not working [ 1305.777526] Lustre: DEBUG MARKER: == conf-sanity test 78: run resize2fs on MDT and OST filesystems ========================================================== 21:02:03 (1788310923) [ 1315.013696] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_hostid [ 1323.389079] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [ 1341.654302] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1341.892471] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1342.004937] Lustre: lustre-MDT0000: new disk, initializing [ 1342.095790] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1345.974383] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 1354.133816] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1359.330044] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1359.531133] Lustre: lustre-OST0000: new disk, initializing [ 1359.534590] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1359.540784] Lustre: Skipped 1 previous similar message [ 1359.544869] Lustre: 54889:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1361.474032] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 1361.489257] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 1361.526942] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 1365.369231] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 1374.349340] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1376.928536] Lustre: DEBUG MARKER: create test files [ 1412.581165] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1412.593985] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1412.617735] Lustre: Skipped 12 previous similar messages [ 1412.636193] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1412.641504] Lustre: Skipped 22 previous similar messages [ 1417.470469] Lustre: server umount lustre-OST0000 complete [ 1421.058666] Lustre: server umount lustre-MDT0000 complete [ 1433.642202] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing unload_modules_local [ 1437.491423] Key type lgssc unregistered [ 1437.984862] LNet: 56523:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1438.001691] LNetError: 56523:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1438.027553] LNet: Removed LNI 192.168.206.108@tcp [ 1439.377363] Key type .llcrypt unregistered [ 1439.379461] Key type ._llcrypt unregistered [ 1466.594631] Key type ._llcrypt registered [ 1466.599520] Key type .llcrypt registered [ 1466.676233] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [ 1467.877396] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1467.899395] alg: No test for adler32 (adler32-zlib) [ 1468.996296] Lustre: Lustre: Build Version: 2.17.57_45_g07d9be3 [ 1469.210375] LNet: Added LNI 192.168.206.108@tcp [8/256/0/180] [ 1470.898374] Key type lgssc registered [ 1471.893587] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1479.270634] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1479.301688] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1480.731195] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1484.720925] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 1491.730280] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1498.625550] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1499.043027] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1505.216156] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:102 to 0x240000400:129) [ 1505.412454] Lustre: 59237:0:(osd_internal.h:1460:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 511 < left 544, rollback = 9 [ 1505.433118] Lustre: 59237:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 32/128/4, destroy: 0/0/0 [ 1505.449296] Lustre: 59237:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 1505.464914] Lustre: 59237:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/18/1, punch: 0/0/0, quota 1/3/0 [ 1505.482874] Lustre: 59237:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 1505.505994] Lustre: 59237:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 1506.656564] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 1514.432883] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1519.544899] Lustre: DEBUG MARKER: check files after expanding the MDT and OST filesystems [ 1525.395433] Lustre: DEBUG MARKER: create more files after expanding the MDT and OST filesystems [ 1533.464317] Lustre: server umount lustre-OST0000 complete [ 1546.906996] Lustre: server umount lustre-MDT0000 complete [ 1557.045931] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing unload_modules_local [ 1559.410674] Key type lgssc unregistered [ 1559.715790] LNet: 60849:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1559.724717] LNetError: 60849:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1559.749405] LNet: Removed LNI 192.168.206.108@tcp [ 1560.596574] Key type .llcrypt unregistered [ 1560.601090] Key type ._llcrypt unregistered [ 1589.069824] Key type ._llcrypt registered [ 1589.073407] Key type .llcrypt registered [ 1589.169225] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [ 1590.237678] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1590.254370] alg: No test for adler32 (adler32-zlib) [ 1591.350544] Lustre: Lustre: Build Version: 2.17.57_45_g07d9be3 [ 1591.597816] LNet: Added LNI 192.168.206.108@tcp [8/256/0/180] [ 1593.231294] Key type lgssc registered [ 1594.321175] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1600.907899] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1600.922610] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1602.323160] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1606.715968] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 1615.518508] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1622.602658] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1622.916346] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1627.054491] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:140 to 0x240000400:161) [ 1627.119908] Lustre: 63684:0:(osd_internal.h:1460:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 509 < left 544, rollback = 9 [ 1627.128325] Lustre: 63684:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 32/128/6, destroy: 0/0/0 [ 1627.135788] Lustre: 63684:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 1627.140508] Lustre: 63684:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/18/1, punch: 0/0/0, quota 1/3/0 [ 1627.146693] Lustre: 63684:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 1627.157372] Lustre: 63684:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 1629.226361] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 1637.031268] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1643.327485] Lustre: DEBUG MARKER: check files after shrinking the MDT and OST filesystems [ 1652.709138] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1652.710565] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1652.718264] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1657.826294] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1658.724880] Lustre: server umount lustre-OST0000 complete [ 1662.843578] Lustre: server umount lustre-MDT0000 complete [ 1675.084101] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing unload_modules_local [ 1677.847689] Key type lgssc unregistered [ 1678.199767] LNet: 65245:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1678.205553] LNetError: 65245:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1678.230993] LNet: Removed LNI 192.168.206.108@tcp [ 1679.025695] Key type .llcrypt unregistered [ 1679.028692] Key type ._llcrypt unregistered [ 1694.565911] Key type ._llcrypt registered [ 1694.569701] Key type .llcrypt registered [ 1694.697171] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_hostid [ 1708.562381] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [ 1709.580337] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1709.615415] alg: No test for adler32 (adler32-zlib) [ 1710.614258] Lustre: Lustre: Build Version: 2.17.57_45_g07d9be3 [ 1710.832616] LNet: Added LNI 192.168.206.108@tcp [8/256/0/180] [ 1712.511151] Key type lgssc registered [ 1713.448600] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1742.230468] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1742.268743] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1743.490232] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1743.542914] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1743.653893] Lustre: lustre-MDT0000: new disk, initializing [ 1743.739714] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1743.755466] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1747.772514] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 1757.181322] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1757.296632] Lustre: 68397:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1757.377750] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 1757.383088] Lustre: Skipped 1 previous similar message [ 1757.444541] Lustre: lustre-MDT0001: new disk, initializing [ 1757.510487] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1757.541973] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 1757.547801] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1761.931343] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 1770.405422] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1775.772437] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 1782.447867] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1782.819271] Lustre: lustre-OST0000: new disk, initializing [ 1782.822792] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1782.829660] Lustre: 70362:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1782.916950] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1790.214529] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 1791.612992] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 1791.621570] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1791.764117] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1801.622681] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1806.349548] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1806.496351] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1811.396786] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1811.673744] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1817.572218] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1817.574738] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1817.584304] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1817.586481] LustreError: Skipped 1 previous similar message [ 1817.595001] Lustre: Skipped 1 previous similar message [ 1819.591346] Lustre: server umount lustre-OST0000 complete [ 1824.227797] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1824.234382] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1824.245933] Lustre: Skipped 1 previous similar message [ 1824.262014] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1827.810643] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1827.828154] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1829.743152] Lustre: server umount lustre-MDT0000 complete [ 1832.932291] LustreError: 68407:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1832.957179] LustreError: 68407:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [ 1833.315640] LustreError: 68388:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788311452 with bad export cookie 13478372245106792060 [ 1833.319244] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1833.325320] LustreError: 68388:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 1833.681285] Lustre: server umount lustre-MDT0001 complete [ 1841.909721] Lustre: DEBUG MARKER: == conf-sanity test 79: format MDT/OST without mgs option (should return errors) ========================================================== 21:10:59 (1788311459) [ 1851.571102] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [ 1888.004319] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_hostid [ 1896.527744] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [ 1929.696586] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1930.023504] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1930.053194] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1930.150793] Lustre: lustre-MDT0000: new disk, initializing [ 1930.251603] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1930.268277] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1934.821723] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 1946.206130] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1946.333752] Lustre: 76380:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1946.394626] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 1946.398585] Lustre: Skipped 1 previous similar message [ 1946.483815] Lustre: lustre-MDT0001: new disk, initializing [ 1946.586626] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1946.635332] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 1946.658052] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1950.943668] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 1960.122835] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1966.657373] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 1973.239631] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1973.656446] Lustre: lustre-OST0000: new disk, initializing [ 1973.664976] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1973.673323] Lustre: 78348:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1973.778848] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1980.974846] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 1983.547345] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 1983.553842] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1983.632541] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1991.873581] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1996.794508] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1996.947208] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2001.604988] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2001.791242] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2004.452905] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2004.460627] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2004.468125] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2004.481645] Lustre: Skipped 1 previous similar message [ 2004.495982] Lustre: Skipped 2 previous similar messages [ 2009.575528] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2009.588015] Lustre: Skipped 1 previous similar message [ 2009.936222] Lustre: server umount lustre-OST0000 complete [ 2014.689421] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2014.718701] Lustre: Skipped 1 previous similar message [ 2019.808215] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2019.819961] Lustre: Skipped 3 previous similar messages [ 2020.193876] Lustre: server umount lustre-MDT0000 complete [ 2024.309579] LustreError: 76371:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788311643 with bad export cookie 13478372245106792942 [ 2024.315224] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2024.319284] LustreError: 76371:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 2024.671508] Lustre: server umount lustre-MDT0001 complete [ 2034.293793] Lustre: DEBUG MARKER: == conf-sanity test 80: mgc import reconnect race ======== 21:14:11 (1788311651) [ 2042.019146] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2042.509138] LustreError: 80764:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2042.620972] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2047.251955] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 2047.982401] LustreError: 80765:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2052.076517] LustreError: 80764:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2055.058849] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2059.421716] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 2066.123833] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2071.360065] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2078.027055] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2078.376158] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2078.383842] Lustre: Skipped 1 previous similar message [ 2083.348952] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 2089.508815] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2092.923523] Lustre: 83432:0:(genops.c:1774:obd_export_evict_by_uuid()) MGS: evicting e02f3875-7a2c-4440-a2e3-5e00acee3517 at adminstrative request [ 2093.038333] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2093.055553] Lustre: *** cfs_fail_loc=906, val=2147483648*** [ 2103.272864] Lustre: MGS: Client e02f3875-7a2c-4440-a2e3-5e00acee3517 (at 0@lo) reconnecting [ 2103.278927] Lustre: Evicted from MGS (at 0@lo) after server handle changed from 0xbb0ccc253c131d60 to 0xbb0ccc253c132000 [ 2103.296948] Lustre: MGC192.168.206.108@tcp: Connection restored to 0@lo (at 0@lo) [ 2130.058824] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2130.248600] Lustre: lustre-OST0001: new disk, initializing [ 2130.251875] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 2130.257410] Lustre: 83827:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2136.157734] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 2136.166492] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 2136.250748] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 2136.455492] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 2145.083774] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2151.908698] LustreError: lustre-OST0001-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2151.914611] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2151.916695] LustreError: Skipped 1 previous similar message [ 2151.918245] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 2151.944766] Lustre: Skipped 1 previous similar message [ 2162.143156] Lustre: lustre-OST0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2162.326526] Lustre: server umount lustre-OST0001 complete [ 2167.276847] LustreError: 82583:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2167.311329] LustreError: 82583:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 2172.837486] Lustre: server umount lustre-OST0000 complete [ 2177.512987] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2177.535031] Lustre: Skipped 3 previous similar messages [ 2183.300299] Lustre: server umount lustre-MDT0000 complete [ 2187.170808] LustreError: 83826:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788311806 with bad export cookie 13478372245106794496 [ 2187.175931] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2187.184379] LustreError: 83826:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2187.563572] Lustre: server umount lustre-MDT0001 complete [ 2195.516499] Lustre: DEBUG MARKER: == conf-sanity test 81: sparse OST indexing ============== 21:16:53 (1788311813) [ 2196.924575] Lustre: DEBUG MARKER: SKIP: conf-sanity test_81 needs >= 3 OSTs [ 2198.717754] Lustre: DEBUG MARKER: == conf-sanity test 82a: specify OSTs for file (succeed) or directory (succeed) ========================================================== 21:16:56 (1788311816) [ 2200.307688] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82a needs >= 3 OSTs [ 2202.086945] Lustre: DEBUG MARKER: == conf-sanity test 82b: specify OSTs for file with --pool and --ost-list options ========================================================== 21:16:59 (1788311819) [ 2203.504699] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82b needs >= 4 OSTs [ 2205.721902] Lustre: DEBUG MARKER: == conf-sanity test 82c: specify sparse OSTs for setstripe (should not crash) ========================================================== 21:17:03 (1788311823) [ 2207.235645] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82c needs >= 4 OSTs [ 2209.433566] Lustre: DEBUG MARKER: == conf-sanity test 83: ENOSPACE on OST doesn't cause message VFS: Busy inodes after unmount ... ========================================================== 21:17:06 (1788311826) [ 2211.081419] Lustre: DEBUG MARKER: mount the OST /dev/mapper/ost1_flakey as a ldiskfs filesystem [ 2217.164602] loop: module loaded [ 2217.200221] loop0: detected capacity change from 0 to 4294967296 [ 2217.281792] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 2219.158133] Lustre: DEBUG MARKER: run llverfs in partial mode on the OST ldiskfs /mnt/lustre-ost1 [ 2223.075645] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing run_llverfs /mnt/lustre-ost1 -vpl no [ 2227.886256] Lustre: DEBUG MARKER: unmount the OST /dev/mapper/ost1_flakey [ 2255.443264] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2255.511790] LustreError: 87950:0:(obd_config.c:845:class_setup()) setup lustre-OST0000-osd failed (-28) [ 2255.520124] LustreError: 87950:0:(obd_mount.c:259:lustre_start_simple()) lustre-OST0000-osd setup error -28 [ 2255.526593] LustreError: 87950:0:(tgt_mount.c:2579:server_fill_super()) Unable to start osd on /dev/mapper/ost1_flakey: -28 [ 2255.532078] LustreError: 87950:0:(super25.c:179:lustre_fill_super()) llite: Unable to mount : rc = -28 [ 2273.207306] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_hostid [ 2284.160219] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [ 2325.206598] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2325.451339] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2325.481468] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2325.580362] Lustre: lustre-MDT0000: new disk, initializing [ 2325.701660] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2325.709633] Lustre: Skipped 1 previous similar message [ 2325.725777] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2330.010777] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 2340.196533] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2340.319820] Lustre: 90815:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2340.474072] Lustre: lustre-MDT0001: Not available for connect from 0@lo (not set up) [ 2340.480115] Lustre: Skipped 13 previous similar messages [ 2340.596484] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2344.609409] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 2354.247210] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2360.504597] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2368.158819] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2368.480496] Lustre: 92788:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2375.625361] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 2377.794616] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2377.865918] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2385.398218] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2390.068977] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2390.268860] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2394.020599] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2394.194666] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2398.690656] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2398.697534] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2398.711139] LustreError: Skipped 2 previous similar messages [ 2401.970753] Lustre: server umount lustre-OST0000 complete [ 2407.404245] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2407.422490] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2407.433638] Lustre: Skipped 2 previous similar messages [ 2412.689823] Lustre: server umount lustre-MDT0000 complete [ 2414.049401] LustreError: 90825:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2414.073410] LustreError: 90825:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [ 2417.336648] LustreError: 90808:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788312036 with bad export cookie 13478372245106795112 [ 2417.346371] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2417.354747] LustreError: 90808:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2418.291469] Lustre: server umount lustre-MDT0001 complete [ 2430.212359] Lustre: DEBUG MARKER: == conf-sanity test 84: check recovery_hard_time ========= 21:20:46 (1788312046) [ 2439.393098] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2440.186915] LustreError: 95201:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2446.893414] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 2457.702749] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2458.140468] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-60 [ 2458.146231] Lustre: Skipped 3 previous similar messages [ 2463.426509] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 2471.533744] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2477.412125] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2484.030811] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2491.784486] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 2499.639388] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2505.032377] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2505.231431] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2510.063115] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2510.305125] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2517.409687] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2517.678614] Lustre: lustre-OST0001: new disk, initializing [ 2517.685331] Lustre: Skipped 2 previous similar messages [ 2517.691544] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 2517.699672] Lustre: Skipped 3 previous similar messages [ 2517.709798] Lustre: 98573:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2524.761744] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 2525.258558] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 2525.266835] Lustre: Skipped 2 previous similar messages [ 2525.275514] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 2525.453344] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 2534.867816] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2539.661603] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid 50 [ 2539.877633] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2544.370992] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [ 2544.613632] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2564.704762] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 2591.519096] Lustre: Failing over lustre-MDT0000 [ 2592.184479] Lustre: server umount lustre-MDT0000 complete [ 2592.230930] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2592.247935] LustreError: 97585:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2592.251484] Lustre: Skipped 6 previous similar messages [ 2592.283085] LustreError: 97585:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 6 previous similar messages [ 2608.607491] Lustre: 66620:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788312211/real 1788312211] req@00000000670bdfa2 x1875180340390528/t0(0) o400->MGC192.168.206.108@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788312227 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 2608.702098] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2618.977778] LDISKFS-fs (dm-0): 4 truncates cleaned up [ 2618.979695] LDISKFS-fs (dm-0): recovery complete [ 2619.016915] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2633.185339] LustreError: 66619:0:(client.c:1404:ptlrpc_import_delay_req()) @@@ invalidate in flight req@00000000b21d69ee x1875180340402432/t0(0) o250->MGC192.168.206.108@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 2633.725225] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 2634.244979] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 2634.245768] Lustre: 97585:0:(ldlm_lib.c:2110:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 2638.821515] Lustre: 95931:0:(ldlm_lib.c:2110:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 2638.830953] Lustre: 95931:0:(ldlm_lib.c:2110:extend_recovery_timer()) Skipped 1 previous similar message [ 2638.848701] Lustre: lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 2638.925249] LustreError: 101423:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2639.044995] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 2639.241407] LustreError: 101423:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2639.577689] LustreError: 101423:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2639.592911] LustreError: 101423:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 1 previous similar message [ 2639.913147] LustreError: 101423:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2639.926300] LustreError: 101423:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 1 previous similar message [ 2639.937281] Lustre: 101423:0:(ldlm_lib.c:2110:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2639.943182] Lustre: 101423:0:(ldlm_lib.c:2110:extend_recovery_timer()) Skipped 7 previous similar messages [ 2640.584198] LustreError: 101423:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2640.608768] LustreError: 101423:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 2 previous similar messages [ 2640.954773] LustreError: 101423:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2640.973917] LustreError: 101423:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 2 previous similar messages [ 2641.953694] Lustre: 101423:0:(ldlm_lib.c:2110:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2641.977725] Lustre: 101423:0:(ldlm_lib.c:2110:extend_recovery_timer()) Skipped 5 previous similar messages [ 2642.639899] LustreError: 101423:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2642.650371] LustreError: 101423:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 5 previous similar messages [ 2642.975397] LustreError: 101423:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2642.991630] LustreError: 101423:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 5 previous similar messages [ 2646.206534] Lustre: 101423:0:(ldlm_lib.c:2110:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2646.227023] Lustre: 101423:0:(ldlm_lib.c:2110:extend_recovery_timer()) Skipped 12 previous similar messages [ 2646.886759] LustreError: 101423:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2646.921409] LustreError: 101423:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 12 previous similar messages [ 2647.256172] LustreError: 101423:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2647.277272] LustreError: 101423:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 12 previous similar messages [ 2654.312158] Lustre: 101423:0:(ldlm_lib.c:2110:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2654.322549] Lustre: 101423:0:(ldlm_lib.c:2110:extend_recovery_timer()) Skipped 24 previous similar messages [ 2654.982167] LustreError: 101423:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2654.999917] LustreError: 101423:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 24 previous similar messages [ 2655.335115] LustreError: 101423:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2655.339041] LustreError: 101423:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 24 previous similar messages [ 2670.550900] Lustre: 101423:0:(ldlm_lib.c:2110:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2670.575677] Lustre: 101423:0:(ldlm_lib.c:2110:extend_recovery_timer()) Skipped 50 previous similar messages [ 2671.236823] LustreError: 101423:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2671.249821] LustreError: 101423:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 50 previous similar messages [ 2671.575151] LustreError: 101423:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2671.588729] LustreError: 101423:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 50 previous similar messages [ 2694.079228] Lustre: 101423:0:(ldlm_lib.c:2419:target_recovery_overseer()) lustre-MDT0000 recovery is aborted by hard timeout [ 2694.090498] Lustre: 101423:0:(ldlm_lib.c:2429:target_recovery_overseer()) recovery is aborted, evict exports in recovery [ 2694.098154] Lustre: 101423:0:(genops.c:1601:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client cc2494e3-5bb5-430b-a327-694c7516dcad@192.168.206.8@tcp [ 2694.112252] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 2694.123483] Lustre: 101423:0:(ldlm_lib.c:1939:abort_req_replay_queue()) @@@ aborted: req@00000000b41ef7c9 x1875180326553984/t0(8589934769) o101->cc2494e3-5bb5-430b-a327-694c7516dcad@192.168.206.8@tcp:448/0 lens 592/0 e 0 to 0 dl 1788312323 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:0 [ 2694.156098] Lustre: lustre-MDT0000-osd: cancel update llog [0x200000400:0x1:0x0] [ 2694.161738] Lustre: lustre-MDT0000: Denying connection for new client cc2494e3-5bb5-430b-a327-694c7516dcad (at 192.168.206.8@tcp), waiting for 3 known clients (2 recovered, 0 in progress, and 1 evicted) to recover in 0:00 [ 2694.190448] Lustre: lustre-MDT0001-osp-MDT0000: cancel update llog [0x240000401:0x1:0x0] [ 2694.264987] Lustre: lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 2694.276143] Lustre: lustre-MDT0000: Recovery over after 1:00, of 3 clients 2 recovered and 1 was evicted. [ 2694.280308] Lustre: Skipped 2 previous similar messages [ 2694.350527] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:77 to 0x280000401:577) [ 2694.354401] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:45 to 0x2c0000401:545) [ 2714.086192] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2714.098287] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2714.104531] Lustre: Skipped 2 previous similar messages [ 2725.343505] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2725.487833] Lustre: server umount lustre-OST0000 complete [ 2725.860287] LustreError: 97024:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2725.878691] LustreError: 97024:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 55 previous similar messages [ 2730.465828] Lustre: lustre-OST0001-osc-MDT0001: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2730.476242] Lustre: Skipped 2 previous similar messages [ 2744.288043] Lustre: lustre-OST0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2744.494282] Lustre: server umount lustre-OST0001 complete [ 2750.954437] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2750.967490] LustreError: Skipped 2 previous similar messages [ 2763.231407] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2763.511246] Lustre: server umount lustre-MDT0000 complete [ 2767.608762] LustreError: 100671:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788312386 with bad export cookie 13478372245106846324 [ 2767.609085] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2767.623563] LustreError: 100671:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 2768.066376] Lustre: server umount lustre-MDT0001 complete [ 2776.658706] Lustre: DEBUG MARKER: == conf-sanity test 85: osd_ost init: fail ea_fid_set ==== 21:26:34 (1788312394) [ 2784.064266] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2784.074233] Lustre: *** cfs_fail_loc=197, val=0*** [ 2799.713342] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 2804.831494] LustreError: 103401:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.206.108@tcp: failed processing log, type 4: rc = -110 [ 2809.983645] Lustre: *** cfs_fail_loc=197, val=0*** [ 2809.993318] Lustre: Skipped 65 previous similar messages [ 2830.559284] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2830.579535] Lustre: Skipped 3 previous similar messages [ 2836.992931] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 2845.851879] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2848.466532] Lustre: server umount lustre-OST0000 complete [ 2858.436370] Lustre: DEBUG MARKER: == conf-sanity test 86: Replacing mkfs.lustre -G option == 21:27:55 (1788312475) [ 2881.077885] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2881.720714] LustreError: 105022:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2881.741722] LustreError: 105022:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 8 previous similar messages [ 2887.458936] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 2899.562610] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2903.474728] LustreError: 105053:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x200000009:0x1:0x0]: rc = -5 [ 2903.497601] LustreError: 105053:0:(lod_sub_object.c:917:lod_sub_prep_llog()) lustre-MDT0000-mdtlov: can't get id from catalogs: rc = -5 [ 2903.508435] LustreError: 105053:0:(lod_dev.c:511:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 22, retries 0, failed: rc = -5 [ 2903.755633] Lustre: server umount lustre-MDT0000 complete [ 2936.063567] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_hostid [ 2945.799729] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [ 2980.869348] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2981.097096] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2981.159862] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2981.224237] Lustre: lustre-MDT0000: new disk, initializing [ 2981.303909] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2986.162205] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 2996.726150] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2996.806803] Lustre: 109226:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2997.084127] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 3001.729838] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 3010.716200] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3016.156896] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3023.177617] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3023.499338] Lustre: 111196:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3029.383157] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 3030.719806] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 3038.659975] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3042.623806] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 3042.821460] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 3046.920712] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 3047.114920] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 3051.494832] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3051.496206] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3051.496912] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3051.496916] Lustre: Skipped 17 previous similar messages [ 3051.526857] Lustre: Skipped 4 previous similar messages [ 3063.263132] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 3063.393863] Lustre: server umount lustre-OST0000 complete [ 3073.504606] Lustre: server umount lustre-MDT0000 complete [ 3077.061156] LustreError: 109219:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788312696 with bad export cookie 13478372245106856901 [ 3077.068200] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3077.068946] LustreError: 109219:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 3077.439436] Lustre: server umount lustre-MDT0001 complete [ 3086.238701] Lustre: DEBUG MARKER: == conf-sanity test 87: check if MDT inode can hold EAs with N stripes properly ========================================================== 21:31:43 (1788312703) [ 3095.414690] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing unload_modules_local [ 3098.093479] Key type lgssc unregistered [ 3098.388670] LNet: 113688:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3098.397590] LNetError: 113688:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3098.409986] LNet: Removed LNI 192.168.206.108@tcp [ 3099.326761] Key type .llcrypt unregistered [ 3099.329855] Key type ._llcrypt unregistered [ 3116.151046] Key type ._llcrypt registered [ 3116.152694] Key type .llcrypt registered [ 3116.305393] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_hostid [ 3136.406571] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [ 3137.549842] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3137.722048] alg: No test for adler32 (adler32-zlib) [ 3138.886666] Lustre: Lustre: Build Version: 2.17.57_45_g07d9be3 [ 3139.104630] LNet: Added LNI 192.168.206.108@tcp [8/256/0/180] [ 3140.851808] Key type lgssc registered [ 3142.007528] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3180.568071] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3180.616643] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3181.888210] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3181.944845] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3182.043842] Lustre: lustre-MDT0000: new disk, initializing [ 3182.162833] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3182.180483] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3186.836171] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 3196.491658] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3196.706985] Lustre: lustre-OST0000: new disk, initializing [ 3196.709851] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3196.712850] Lustre: Skipped 1 previous similar message [ 3196.720039] Lustre: 117863:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3196.784693] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3202.028339] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 3202.593634] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 3202.601448] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 3202.629388] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 3211.405489] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3211.568811] Lustre: lustre-OST0001: new disk, initializing [ 3211.575933] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 3211.593796] Lustre: 118727:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3211.691731] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 3217.932583] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 3218.507759] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost [ 3218.521885] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] [ 3218.547299] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 [ 3228.645955] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3228.654726] Lustre: Skipped 1 previous similar message [ 3228.654903] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3228.666331] Lustre: Skipped 1 previous similar message [ 3232.418556] Lustre: server umount lustre-MDT0000 complete [ 3238.762263] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null) [ 3243.404716] LustreError: 117052:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788312862 with bad export cookie 14566153886220854378 [ 3243.409901] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3243.414428] LustreError: 117052:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 3243.539863] Lustre: server umount lustre-OST0000 complete [ 3246.887965] Lustre: server umount lustre-OST0001 complete [ 3254.744968] Lustre: DEBUG MARKER: == conf-sanity test 88a: tunefs.lustre persists a --mountfsoptions-only change ========================================================== 21:34:32 (1788312872) [ 3273.874366] Lustre: DEBUG MARKER: == conf-sanity test 88b: check the default mount options can be overridden ========================================================== 21:34:51 (1788312891) [ 3282.128884] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [ 3302.463467] Lustre: DEBUG MARKER: == conf-sanity test 89: check tunefs --param and --erase-param{s} options ========================================================== 21:35:20 (1788312920) [ 3338.921336] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_hostid [ 3348.579799] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [ 3385.236278] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3385.471177] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3385.503337] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3385.584545] Lustre: lustre-MDT0000: new disk, initializing [ 3385.652178] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3385.687683] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3389.218669] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 3398.489603] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3398.649943] Lustre: 126484:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 3398.705508] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 3398.709842] Lustre: Skipped 1 previous similar message [ 3398.784914] Lustre: lustre-MDT0001: new disk, initializing [ 3398.879633] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3398.927167] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 3398.943497] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 3403.290347] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 3412.970628] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3418.617206] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3426.799851] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3427.033705] Lustre: lustre-OST0000: new disk, initializing [ 3427.037812] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3427.046953] Lustre: 128452:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3427.154436] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3434.169844] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 3437.073074] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 3437.078776] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 3437.148521] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 3445.796088] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount (FULL|IDLE) failover.node=192.0.2.254@tcp0,osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3451.734540] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 3451.925294] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 3456.150857] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 3456.337303] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 3462.624987] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3462.627065] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3462.632051] LustreError: Skipped 1 previous similar message [ 3462.633076] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3462.665205] Lustre: Skipped 1 previous similar message [ 3467.749061] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3467.756020] Lustre: Skipped 2 previous similar messages [ 3472.351112] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 3472.521481] Lustre: server umount lustre-OST0000 complete [ 3477.984637] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3477.988783] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3477.994670] Lustre: Skipped 1 previous similar message [ 3478.016226] Lustre: Skipped 1 previous similar message [ 3482.498116] Lustre: server umount lustre-MDT0000 complete [ 3485.718447] LustreError: 126476:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788313104 with bad export cookie 14566153886220855596 [ 3485.722018] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3485.741021] LustreError: 126476:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3485.985475] Lustre: server umount lustre-MDT0001 complete [ 3493.875811] Lustre: DEBUG MARKER: == conf-sanity test 90a: check max_mod_rpcs_in_flight is enforced ========================================================== 21:38:31 (1788313111) [ 3500.164641] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3500.661371] LustreError: 130867:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3500.675389] LustreError: 130867:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [ 3500.732365] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3505.359716] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 3506.146436] LustreError: 130868:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3510.248824] LustreError: 130867:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3514.048616] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3518.368927] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 3525.107362] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3530.324804] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3536.530260] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3536.868445] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3536.874382] Lustre: Skipped 1 previous similar message [ 3542.889559] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 3550.073364] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3554.192595] Lustre: *** cfs_fail_loc=159, val=0*** [ 3570.743722] Lustre: lustre-MDT0000: Client 59256642-e92f-4568-b4ca-c6b9baeba022 (at 192.168.206.8@tcp) reconnecting [ 3571.986647] Lustre: *** cfs_fail_loc=159, val=0*** [ 3571.988415] Lustre: Skipped 5 previous similar messages [ 3588.676811] Lustre: lustre-MDT0000: Client 59256642-e92f-4568-b4ca-c6b9baeba022 (at 192.168.206.8@tcp) reconnecting [ 3595.585092] Lustre: server umount lustre-OST0000 complete [ 3601.378075] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3601.396360] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3601.398157] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3601.408518] Lustre: Skipped 1 previous similar message [ 3609.682145] Lustre: server umount lustre-MDT0000 complete [ 3611.624520] LustreError: 131595:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3611.652501] LustreError: 131595:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 3612.639073] Lustre: 115069:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788313215/real 1788313215] req@00000000a56c1f0d x1875181838638336/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 1 dl 1788313231 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 3612.641841] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3612.673168] Lustre: 115069:0:(client.c:2503:ptlrpc_expire_one_request()) Skipped 1 previous similar message [ 3612.706755] Lustre: Skipped 1 previous similar message [ 3613.609707] LustreError: 130848:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788313232 with bad export cookie 14566153886220856485 [ 3613.611405] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3613.622039] LustreError: 130848:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 3614.066831] Lustre: server umount lustre-MDT0001 complete [ 3624.919211] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing unload_modules_local [ 3627.353277] Key type lgssc unregistered [ 3627.624839] LNet: 134648:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3627.633288] LNetError: 134648:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3627.644960] LNet: Removed LNI 192.168.206.108@tcp [ 3628.236488] Key type .llcrypt unregistered [ 3628.238807] Key type ._llcrypt unregistered [ 3651.122757] Key type ._llcrypt registered [ 3651.126742] Key type .llcrypt registered [ 3651.254540] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [ 3652.188735] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3652.349041] alg: No test for adler32 (adler32-zlib) [ 3653.387871] Lustre: Lustre: Build Version: 2.17.57_45_g07d9be3 [ 3653.699064] LNet: Added LNI 192.168.206.108@tcp [8/256/0/180] [ 3655.399168] Key type lgssc registered [ 3656.615549] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3664.444754] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3664.475556] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3666.023135] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3670.340546] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 3675.109568] LustreError: 136063:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3675.140185] LustreError: 136063:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 3678.915918] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3679.235676] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3683.136079] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 3689.652600] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3694.890982] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3701.636032] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3702.050784] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3708.148713] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 3710.267817] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:42 to 0x280000401:65) [ 3715.376641] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3725.158448] Lustre: *** cfs_fail_loc=159, val=0*** [ 3741.751668] Lustre: lustre-MDT0000: Client e779b50e-bb5b-4a26-b5af-82566b20aa54 (at 192.168.206.8@tcp) reconnecting [ 3744.001645] Lustre: *** cfs_fail_loc=159, val=0*** [ 3760.183452] Lustre: lustre-MDT0001: Client e779b50e-bb5b-4a26-b5af-82566b20aa54 (at 192.168.206.8@tcp) reconnecting [ 3761.897374] Lustre: *** cfs_fail_loc=159, val=0*** [ 3761.904215] Lustre: Skipped 6 previous similar messages [ 3778.171894] Lustre: lustre-MDT0001: Client e779b50e-bb5b-4a26-b5af-82566b20aa54 (at 192.168.206.8@tcp) reconnecting [ 3783.916458] Lustre: 139108:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3787.474394] Lustre: *** cfs_fail_loc=159, val=0*** [ 3787.479531] Lustre: Skipped 1 previous similar message [ 3803.204543] Lustre: lustre-MDT0000: Client 02f71d12-dee8-4ead-8134-bdade405e57a (at 192.168.206.8@tcp) reconnecting [ 3804.583586] Lustre: *** cfs_fail_loc=159, val=0*** [ 3804.593866] Lustre: Skipped 15 previous similar messages [ 3820.095874] Lustre: lustre-MDT0000: Client 02f71d12-dee8-4ead-8134-bdade405e57a (at 192.168.206.8@tcp) reconnecting [ 3821.627083] Lustre: 139400:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3827.170250] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3827.179166] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3827.192376] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3828.194935] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3828.195368] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3828.202606] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3828.205250] Lustre: Skipped 1 previous similar message [ 3828.212860] LustreError: Skipped 1 previous similar message [ 3833.323902] LustreError: 137884:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3833.342211] LustreError: 137884:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 3833.469817] Lustre: server umount lustre-OST0000 complete [ 3837.920504] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3837.930298] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3837.942575] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3839.808236] Lustre: server umount lustre-MDT0000 complete [ 3843.553620] LustreError: 136790:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3843.568617] LustreError: 136790:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 3844.039217] LustreError: 136043:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788313463 with bad export cookie 3830795337527726290 [ 3844.041640] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3844.058742] LustreError: 136043:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3844.480856] Lustre: server umount lustre-MDT0001 complete [ 3855.869675] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing unload_modules_local [ 3858.131953] Key type lgssc unregistered [ 3858.559246] LNet: 140455:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3858.590115] LNetError: 140455:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3858.638744] LNet: Removed LNI 192.168.206.108@tcp [ 3859.204783] Key type .llcrypt unregistered [ 3859.208323] Key type ._llcrypt unregistered [ 3885.676835] Key type ._llcrypt registered [ 3885.679784] Key type .llcrypt registered [ 3885.799809] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [ 3886.921331] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3886.953988] alg: No test for adler32 (adler32-zlib) [ 3887.981812] Lustre: Lustre: Build Version: 2.17.57_45_g07d9be3 [ 3888.199334] LNet: Added LNI 192.168.206.108@tcp [8/256/0/180] [ 3889.879549] Key type lgssc registered [ 3890.992595] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3899.296267] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3899.329991] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3900.839169] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3905.150801] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 3910.118934] LustreError: 141870:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3910.153292] LustreError: 141870:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 3912.388712] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3912.659297] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3916.798819] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 3923.690464] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3927.909821] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3933.881328] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3934.265722] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3937.337561] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:97) [ 3939.860440] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 3945.555286] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:129) [ 3945.720294] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3952.527221] Lustre: 144454:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3955.485361] Lustre: 144503:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3957.081069] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 in log params [ 3958.168445] Lustre: Setting parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=8 in log params [ 3962.251142] Lustre: 144650:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre/mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 (mode = 0) failed: rc = -17 [ 3963.024181] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=7 in log params [ 3963.873632] Lustre: 144748:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3967.971258] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3967.981077] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3968.003547] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3971.043660] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3971.045309] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3971.050633] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3973.556419] Lustre: server umount lustre-OST0000 complete [ 3979.234445] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3979.248458] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3979.264718] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3979.271992] Lustre: Skipped 1 previous similar message [ 3981.281229] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3981.288124] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3982.636850] Lustre: server umount lustre-MDT0000 complete [ 3985.799894] LustreError: 141853:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788313604 with bad export cookie 11117743651469413010 [ 3985.805257] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3985.818720] LustreError: 141853:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 3986.108323] Lustre: server umount lustre-MDT0001 complete [ 3996.324478] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing unload_modules_local [ 3999.030433] Key type lgssc unregistered [ 3999.267823] LNet: 145811:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3999.276115] LNetError: 145811:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3999.286589] LNet: Removed LNI 192.168.206.108@tcp [ 3999.913451] Key type .llcrypt unregistered [ 3999.916188] Key type ._llcrypt unregistered [ 4024.430223] Key type ._llcrypt registered [ 4024.432032] Key type .llcrypt registered [ 4024.568637] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [ 4025.791081] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4025.859187] alg: No test for adler32 (adler32-zlib) [ 4026.952775] Lustre: Lustre: Build Version: 2.17.57_45_g07d9be3 [ 4027.178923] LNet: Added LNI 192.168.206.108@tcp [8/256/0/180] [ 4028.839161] Key type lgssc registered [ 4029.843127] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4037.063212] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4037.104056] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4038.606279] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4042.661296] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 4048.870501] LustreError: 147223:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4048.884065] LustreError: 147223:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 4051.317935] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4051.722711] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4055.926603] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 4063.390353] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 4068.664730] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 4075.080284] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4075.331614] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4076.401886] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:129) [ 4081.201478] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 4083.578076] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:161) [ 4088.542412] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 4094.783265] Lustre: *** cfs_fail_loc=159, val=0*** [ 4111.453852] Lustre: lustre-MDT0000: Client 2bb1c55d-c0bf-48d2-919f-c7be8ef14b58 (at 192.168.206.8@tcp) reconnecting [ 4129.761280] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4129.763508] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4129.784272] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4129.817767] Lustre: Skipped 1 previous similar message [ 4134.108958] Lustre: server umount lustre-OST0000 complete [ 4138.985135] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4139.002645] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4139.024551] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4139.035623] Lustre: Skipped 1 previous similar message [ 4140.008051] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4143.009904] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4143.013640] Lustre: Skipped 3 previous similar messages [ 4143.554277] Lustre: server umount lustre-MDT0000 complete [ 4146.956771] LustreError: 149834:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788313765 with bad export cookie 16699969794475087660 [ 4146.965719] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4146.977797] LustreError: 149834:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 4147.260308] Lustre: server umount lustre-MDT0001 complete [ 4157.827749] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing unload_modules_local [ 4160.510421] Key type lgssc unregistered [ 4160.840976] LNet: 150891:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4160.856943] LNetError: 150891:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4160.880831] LNet: Removed LNI 192.168.206.108@tcp [ 4161.720520] Key type .llcrypt unregistered [ 4161.723844] Key type ._llcrypt unregistered [ 4184.389160] Key type ._llcrypt registered [ 4184.391496] Key type .llcrypt registered [ 4184.482738] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [ 4185.286849] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4185.389044] alg: No test for adler32 (adler32-zlib) [ 4186.431136] Lustre: Lustre: Build Version: 2.17.57_45_g07d9be3 [ 4186.686515] LNet: Added LNI 192.168.206.108@tcp [8/256/0/180] [ 4188.335180] Key type lgssc registered [ 4189.373427] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4196.478855] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4196.496210] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4197.918237] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4201.805625] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 4207.074678] LustreError: 152307:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4207.094815] LustreError: 152307:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 4209.424901] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4209.779040] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4213.399377] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 4219.813647] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 4224.723023] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 4231.603222] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4232.032634] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4234.115862] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:161) [ 4237.386991] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 4242.309388] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:170 to 0x280000401:193) [ 4244.908769] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 4264.511109] Lustre: lustre-MDT0001: evicting 5fc6eb71-4712-4645-9f3e-333528cf158f (at 192.168.206.8@tcp) by administrative request [ 4264.517403] Lustre: Skipped 1 previous similar message [ 4293.602459] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4293.606899] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4293.616255] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4293.620372] Lustre: Skipped 1 previous similar message [ 4298.723035] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4298.733640] Lustre: Skipped 1 previous similar message [ 4300.110486] Lustre: server umount lustre-OST0000 complete [ 4306.912923] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4306.919651] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4306.943816] Lustre: Skipped 1 previous similar message [ 4306.962262] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4308.960920] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4308.962711] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4308.994519] Lustre: Skipped 1 previous similar message [ 4311.304327] Lustre: server umount lustre-MDT0000 complete [ 4314.091302] LustreError: 152307:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4314.119987] LustreError: 152307:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 4315.063022] LustreError: 152286:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788313934 with bad export cookie 2070218140169146533 [ 4315.078478] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4315.385891] Lustre: server umount lustre-MDT0001 complete [ 4324.213826] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing unload_modules_local [ 4326.530612] Key type lgssc unregistered [ 4326.835769] LNet: 156376:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4326.841530] LNetError: 156376:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4326.866843] LNet: Removed LNI 192.168.206.108@tcp [ 4327.554124] Key type .llcrypt unregistered [ 4327.557912] Key type ._llcrypt unregistered [ 4395.916241] Key type ._llcrypt registered [ 4395.918795] Key type .llcrypt registered [ 4396.021760] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [ 4396.871839] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4396.914100] alg: No test for adler32 (adler32-zlib) [ 4397.980858] Lustre: Lustre: Build Version: 2.17.57_45_g07d9be3 [ 4398.189992] LNet: Added LNI 192.168.206.108@tcp [8/256/0/180] [ 4399.847150] Key type lgssc registered [ 4400.852966] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4408.156796] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4408.177539] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4409.568873] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4413.534286] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 4419.041869] LustreError: 158865:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4419.066939] LustreError: 158865:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 4421.397849] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4421.773521] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4425.392436] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 4430.929311] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 4435.398751] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 4441.025968] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4441.261314] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4445.690704] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 4446.384763] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:193) [ 4451.987431] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 4454.573814] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:195 to 0x280000401:225) [ 4467.169522] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4467.177636] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4467.195994] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4468.197048] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4468.198232] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4468.222024] Lustre: Skipped 1 previous similar message [ 4471.966490] Lustre: server umount lustre-OST0000 complete [ 4477.923335] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4477.932548] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4477.949706] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4483.554903] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4483.564401] Lustre: Skipped 2 previous similar messages [ 4488.674183] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4488.681600] Lustre: Skipped 1 previous similar message [ 4490.207087] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 4490.423148] Lustre: server umount lustre-MDT0000 complete [ 4493.792362] LustreError: 158862:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4493.833893] LustreError: 158862:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 4494.166167] LustreError: 158845:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788314113 with bad export cookie 16401601835195634831 [ 4494.187043] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4494.621824] Lustre: server umount lustre-MDT0001 complete [ 4505.417257] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing unload_modules_local [ 4509.889367] Key type lgssc unregistered [ 4510.228973] LNet: 162429:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4510.234950] LNetError: 162429:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4511.274060] LNet: Removed LNI 192.168.206.108@tcp [ 4512.187571] Key type .llcrypt unregistered [ 4512.189532] Key type ._llcrypt unregistered [ 4535.999920] Key type ._llcrypt registered [ 4536.004905] Key type .llcrypt registered [ 4536.113895] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [ 4536.983750] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4537.020181] alg: No test for adler32 (adler32-zlib) [ 4538.107504] Lustre: Lustre: Build Version: 2.17.57_45_g07d9be3 [ 4538.281202] LNet: Added LNI 192.168.206.108@tcp [8/256/0/180] [ 4539.911309] Key type lgssc registered [ 4540.711517] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4551.849545] Lustre: DEBUG MARKER: == conf-sanity test 100: check lshowmount lists MGS, MDT, OST and 0@lo ========================================================== 21:56:09 (1788314169) [ 4566.445270] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_hostid [ 4575.426776] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [ 4610.381530] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4610.406311] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4611.599195] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 4611.637413] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 4611.718380] Lustre: lustre-MDT0000: new disk, initializing [ 4611.780790] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4611.796258] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 4615.853496] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 4625.836636] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4625.952911] Lustre: 166688:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 4626.010754] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 4626.017773] Lustre: Skipped 1 previous similar message [ 4626.090533] Lustre: lustre-MDT0001: new disk, initializing [ 4626.186233] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4626.218500] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 4626.230217] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 4629.923547] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 4637.945924] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 4643.459479] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 4649.392232] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4649.719908] Lustre: lustre-OST0000: new disk, initializing [ 4649.727864] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 4649.737833] Lustre: 168658:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 4649.848382] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4655.462897] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 4658.228096] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 4658.245162] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 4658.355716] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 4664.796837] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 4674.019288] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4674.032282] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4674.045093] LustreError: Skipped 1 previous similar message [ 4674.050051] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4674.069756] Lustre: Skipped 1 previous similar message [ 4674.089903] Lustre: Skipped 1 previous similar message [ 4679.141784] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4679.152361] Lustre: Skipped 1 previous similar message [ 4680.212669] Lustre: server umount lustre-OST0000 complete [ 4684.259763] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4684.283566] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4684.291164] Lustre: Skipped 1 previous similar message [ 4689.381817] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4689.387191] Lustre: Skipped 1 previous similar message [ 4690.240476] Lustre: server umount lustre-MDT0000 complete [ 4693.911208] LustreError: 166682:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788314312 with bad export cookie 13013876161331307757 [ 4693.914355] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4693.927019] LustreError: 166682:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4694.220484] Lustre: server umount lustre-MDT0001 complete [ 4705.981382] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing unload_modules_local [ 4708.857645] Key type lgssc unregistered [ 4709.207642] LNet: 170564:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4709.218100] LNetError: 170564:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4709.253506] LNet: Removed LNI 192.168.206.108@tcp [ 4710.133841] Key type .llcrypt unregistered [ 4710.135826] Key type ._llcrypt unregistered [ 4735.185437] Key type ._llcrypt registered [ 4735.187832] Key type .llcrypt registered [ 4735.303731] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [ 4736.348916] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4736.435275] alg: No test for adler32 (adler32-zlib) [ 4737.560288] Lustre: Lustre: Build Version: 2.17.57_45_g07d9be3 [ 4737.800502] LNet: Added LNI 192.168.206.108@tcp [8/256/0/180] [ 4739.495959] Key type lgssc registered [ 4740.528728] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4748.662115] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4748.699366] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4750.281732] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4755.246932] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 4760.546906] LustreError: 171980:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4760.571123] LustreError: 171980:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 4763.899778] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4764.367331] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4769.465435] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 4778.597349] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 4784.963624] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 4792.201779] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4792.624684] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4795.717682] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:33) [ 4798.175288] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 4805.050421] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 4814.661436] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4814.683151] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4814.696912] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4814.703209] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4814.715548] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4815.440496] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4815.454336] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4815.467356] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4815.472440] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4815.478129] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4816.303616] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4817.097405] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4817.100169] Lustre: Skipped 1 previous similar message [ 4817.113917] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4817.119895] Lustre: Skipped 1 previous similar message [ 4817.127773] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4817.134819] Lustre: Skipped 1 previous similar message [ 4817.137798] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4817.150434] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4817.161656] Lustre: Skipped 1 previous similar message [ 4817.905311] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4818.641397] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4819.447563] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4819.457499] Lustre: Skipped 2 previous similar messages [ 4819.479725] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4819.486554] Lustre: Skipped 2 previous similar messages [ 4819.490498] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4819.494410] Lustre: Skipped 2 previous similar messages [ 4819.497086] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4819.521800] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4819.531189] Lustre: Skipped 2 previous similar messages [ 4820.381648] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4821.391379] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4822.439219] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4823.367115] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4824.144435] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4824.155654] Lustre: Skipped 4 previous similar messages [ 4824.183454] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4824.196413] Lustre: Skipped 4 previous similar messages [ 4824.205463] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4824.211266] Lustre: Skipped 4 previous similar messages [ 4824.216914] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4824.227080] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4824.241184] Lustre: Skipped 4 previous similar messages [ 4825.078649] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4826.047868] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4827.017726] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4828.016608] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4828.897488] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4829.773165] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4830.528534] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4831.319413] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4832.076901] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4832.902246] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4832.916730] Lustre: Skipped 9 previous similar messages [ 4832.937443] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4832.945505] Lustre: Skipped 9 previous similar messages [ 4832.949599] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4832.953279] Lustre: Skipped 9 previous similar messages [ 4832.956489] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4832.966257] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4832.975646] Lustre: Skipped 9 previous similar messages [ 4833.812276] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4834.668479] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4835.475885] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4836.291068] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4837.053673] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4837.802819] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4838.669413] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4839.365494] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4840.230957] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4841.006417] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4841.831773] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4842.956509] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4843.831228] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4844.750521] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4845.712564] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4846.518183] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4847.294672] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4848.205765] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4849.042111] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4849.055852] Lustre: Skipped 18 previous similar messages [ 4849.073225] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4849.089535] Lustre: Skipped 18 previous similar messages [ 4849.093847] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4849.099893] Lustre: Skipped 18 previous similar messages [ 4849.104362] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4849.120309] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4849.128172] Lustre: Skipped 18 previous similar messages [ 4849.937683] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4850.799709] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4851.570157] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4852.287588] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4853.028236] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4853.940311] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4854.637424] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4855.360268] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4856.120448] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4856.968639] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4857.722656] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4858.421815] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4859.290527] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4860.049678] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4860.931884] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4861.833558] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4862.793091] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4863.622112] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4864.566027] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4865.451388] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4866.425822] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4867.293781] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4868.057930] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4868.880287] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4869.598262] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4870.468712] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4871.288993] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4872.226926] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4873.037937] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4873.838065] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4874.649419] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4875.509686] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4876.412641] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4877.284568] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4878.338699] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4879.316923] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4880.195461] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4881.037129] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4881.904059] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4881.908792] Lustre: Skipped 38 previous similar messages [ 4881.919619] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4881.926114] Lustre: Skipped 38 previous similar messages [ 4881.928932] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4881.931922] Lustre: Skipped 38 previous similar messages [ 4881.934335] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4881.948413] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4881.953187] Lustre: Skipped 38 previous similar messages [ 4882.715522] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4883.450665] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4884.258715] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4885.049903] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4885.817691] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4886.673602] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4887.533412] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4888.458172] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4889.397028] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4890.243078] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4891.217223] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4892.114735] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4892.904875] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4893.695413] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4894.465259] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4895.330268] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4896.020512] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4896.851396] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4897.535070] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4898.307067] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4899.013288] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4899.832486] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4900.540835] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4901.338408] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4902.083374] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4902.942260] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4903.742547] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4904.570759] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4905.453785] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4906.223799] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4906.993212] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4907.837872] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4908.657365] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4909.463613] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4910.236443] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4911.092450] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4911.796468] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4912.530262] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4913.323821] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4914.112541] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4914.862028] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4915.554888] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4916.317575] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4917.043167] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4917.828741] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4918.679902] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4919.576994] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4920.408453] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4921.166671] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4921.999009] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4922.781861] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4923.607269] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4924.435314] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4925.172537] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4925.897085] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4926.740903] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4927.588990] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4928.444830] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4929.188516] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4930.017992] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4930.787266] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4931.579141] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4932.266622] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4933.019775] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4933.665036] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4934.407814] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4935.093150] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4935.991271] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4936.825148] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4937.689804] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4938.548273] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4939.229183] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4940.048836] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4940.829899] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4941.631919] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4942.329636] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4943.291835] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4944.171413] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4944.909842] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4945.935779] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4945.941437] Lustre: Skipped 79 previous similar messages [ 4945.959328] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4945.972833] Lustre: Skipped 79 previous similar messages [ 4945.976723] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4945.981507] Lustre: Skipped 79 previous similar messages [ 4945.986040] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4945.998161] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4946.003757] Lustre: Skipped 79 previous similar messages [ 4947.018311] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4947.863539] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4948.630433] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4949.307444] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4950.067782] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4950.914070] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4951.678160] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4952.576512] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4953.309809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4954.178092] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4955.151517] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4956.026487] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4956.853090] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4957.614096] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4958.421436] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4959.331242] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4960.172231] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4960.969947] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4961.773238] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4962.654968] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4963.438179] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4964.226842] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4964.925638] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4965.654251] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4966.439923] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4967.375468] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4968.180354] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4969.012251] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4969.850353] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4970.603433] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4971.440988] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4972.126293] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4972.923178] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4973.786359] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4974.625645] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4975.394375] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4976.277262] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4977.088791] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4977.995347] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4978.760602] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4979.654686] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4980.371376] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4981.314026] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4982.199193] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4983.126540] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4983.968574] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4984.809708] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4985.601253] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4986.346877] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4987.090197] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4987.845171] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4988.482016] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4989.227146] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4989.872914] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4990.643759] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4991.366427] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4992.168803] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4992.899804] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4993.601368] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4994.267703] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4994.952784] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4995.646719] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4996.449820] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4997.173184] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4998.011938] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4998.787020] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4999.613200] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5000.372770] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5001.235853] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5002.120923] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5003.157734] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5004.086265] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5004.990087] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5005.721294] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5006.424127] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5007.150931] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5007.847899] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5008.624153] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5009.397245] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5010.220283] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5011.173157] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5011.869690] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5012.716953] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5013.435278] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5014.239776] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5015.105403] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5015.883091] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5016.720503] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5017.415979] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5018.098514] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5018.908179] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5019.572646] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5020.302791] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5020.985543] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5021.635325] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5022.297260] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5023.027932] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5023.737970] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5024.488385] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5025.378245] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5026.140079] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5026.994263] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5027.867965] LustreError: 171999:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 5027.878709] LustreError: 171999:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 5027.884422] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5028.858716] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5029.696677] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5030.494358] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5031.259720] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5032.101986] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5032.928368] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5033.732226] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5034.630584] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5035.489975] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5036.394523] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5037.284649] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5038.083634] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5038.826663] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5039.665624] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5040.425496] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5041.382602] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5042.158924] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5042.894450] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5043.717814] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5044.633087] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5045.377825] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5046.204420] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5047.069691] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5048.043424] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5048.851279] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5049.753225] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5050.679813] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5051.663333] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5052.489901] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5053.293649] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5054.090814] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5054.872609] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5055.690608] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5056.665162] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5057.464636] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5058.382290] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5059.261676] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5060.157502] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5060.983654] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5061.739902] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5062.778634] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5063.666289] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5064.502766] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5065.192624] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5066.073376] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5066.993571] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5067.867062] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5068.699274] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5069.415813] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5070.127699] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5070.976847] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5071.701222] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5072.515882] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5073.366914] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5074.126211] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5074.131232] Lustre: Skipped 157 previous similar messages [ 5074.152329] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5074.162615] Lustre: Skipped 157 previous similar messages [ 5074.166685] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5074.171300] Lustre: Skipped 157 previous similar messages [ 5074.175073] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5074.183263] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5074.192554] Lustre: Skipped 157 previous similar messages [ 5074.919405] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5075.659835] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5076.448959] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5077.361225] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5078.265143] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5079.199556] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5080.085461] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5080.924096] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5081.726061] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5082.571581] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5083.365470] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5084.322777] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5085.121895] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5085.856052] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5086.625518] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5087.437801] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5088.202722] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5089.038307] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5089.898670] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5090.634240] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5091.556115] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5092.369282] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5093.089342] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5094.018225] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5094.628528] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5095.507628] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5096.176489] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5097.053935] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5097.750720] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5098.574308] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5099.299331] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5100.221386] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5101.141939] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5102.078041] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5103.076927] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5104.023184] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5105.135740] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5106.138378] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5107.246239] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5108.346771] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5109.453047] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5110.362755] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5111.557442] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5112.407294] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5113.314942] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5114.416597] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5115.299771] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5116.332239] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5117.334023] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5118.217919] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5118.938189] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5119.743812] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5120.550475] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5121.559213] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5122.518677] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5123.325585] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5123.939086] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5124.544915] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5125.201810] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5125.970170] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5126.631024] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5127.498699] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5128.299864] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5129.451522] LustreError: 171999:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 5129.466680] LustreError: 171999:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 5129.471267] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5130.536978] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5131.177191] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5132.037767] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5132.689207] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5133.635479] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5134.310363] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5135.116590] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5135.944125] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5136.753686] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5137.422486] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5138.210193] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5138.971608] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5139.645433] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5140.347772] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5141.030584] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5141.839213] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5142.535181] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5143.232587] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5143.970076] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5144.803569] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5145.728270] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5146.593615] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5147.307337] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5148.073434] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5148.878562] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5149.708629] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5150.542383] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5151.524631] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5152.432694] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5153.259648] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5153.994578] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5154.777706] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5155.462053] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5156.288077] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5157.045708] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5157.910441] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5158.893864] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5159.764775] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5160.640504] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5161.447116] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5162.326935] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5163.221603] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5164.008908] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5164.793951] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5165.628356] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5166.527902] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5167.682521] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5168.429868] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5169.206550] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5169.952630] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5170.744900] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5171.551769] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5172.395053] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5173.276559] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5174.223368] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5174.981307] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5175.735531] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5176.600250] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5177.462943] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5178.402455] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5179.193227] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5180.090467] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5181.041047] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5181.851712] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5182.539248] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5183.279038] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5184.095079] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5184.919234] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5185.650212] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5186.465786] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5187.299969] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5188.241615] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5189.044937] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5189.922275] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5190.806590] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5191.568605] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5192.320939] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5193.143874] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5194.016168] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5194.820617] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5195.531307] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5196.323511] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5197.022072] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5197.745453] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5198.445352] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5199.216231] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5199.935593] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5200.737648] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5201.669885] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5202.701227] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5203.828132] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5204.658620] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5205.488646] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5206.422950] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5207.450536] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5208.456939] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5209.584793] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5210.391696] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5211.304351] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5212.189877] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5213.094569] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5213.836856] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5214.608069] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5215.400359] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5216.282647] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5217.137899] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5218.034687] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5218.849289] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5219.630996] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5220.499186] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5221.491068] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5222.308382] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5223.120302] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5223.809226] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5224.562961] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5225.281835] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5226.049897] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5226.793733] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5227.529589] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5228.245479] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5228.977266] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5229.710177] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5230.415336] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5231.104581] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5232.013515] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5232.736942] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5233.499848] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5234.143400] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5234.916343] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5235.619609] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5236.382048] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5237.068583] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5237.932656] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5238.592177] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5239.291675] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5239.928746] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5240.863572] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5241.592430] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5242.354709] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5243.046238] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5243.761095] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5244.519312] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5245.289328] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5245.971874] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5246.781763] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5247.561478] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5248.325560] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5249.151579] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5249.988316] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5250.835537] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5251.783330] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5252.534461] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5253.363318] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5254.204027] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5255.155485] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5255.942043] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5256.771768] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5257.548893] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5258.381348] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5259.239953] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5260.089651] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5260.910787] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5261.739671] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5262.597646] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5263.479801] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5264.250838] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5265.245227] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5266.011594] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5267.106471] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5267.920450] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5268.771484] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5269.858484] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5270.773864] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5271.741897] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5272.645342] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5273.759653] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5274.810322] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5275.708384] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5276.784809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5277.798304] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5278.636241] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5279.567949] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5280.385395] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5281.275357] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5282.143570] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5282.986983] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5283.797982] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5284.726932] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5285.744027] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5286.566184] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5287.335536] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5288.206823] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5289.029837] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5289.812615] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5290.650133] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5291.492359] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5292.274274] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5293.028021] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5293.790909] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5294.638455] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5295.608878] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5296.333757] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5297.193278] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5298.068051] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5299.009700] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5299.909740] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5300.710543] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5301.578237] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5302.775930] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5303.671204] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5304.733682] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5305.675633] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5306.577520] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5307.400605] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5308.453799] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5309.443966] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5310.337513] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5311.184122] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5312.053665] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5312.817332] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5313.617195] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5314.339980] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5315.039989] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5315.882381] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5316.868915] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5317.687788] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5318.477671] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5319.269701] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5320.228458] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5321.129167] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5321.971631] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5322.852611] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5323.713182] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5324.617398] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5325.480567] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5326.349771] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5327.071217] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5327.997512] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5328.795234] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5329.545473] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5330.252932] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5330.264841] Lustre: Skipped 304 previous similar messages [ 5330.288487] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5330.298990] Lustre: Skipped 304 previous similar messages [ 5330.314261] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5330.322438] Lustre: Skipped 304 previous similar messages [ 5330.326364] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5330.341823] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5330.352625] Lustre: Skipped 304 previous similar messages [ 5331.215153] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5332.020021] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5332.837472] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5333.646110] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5334.474732] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5335.280369] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5336.053473] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5336.842847] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5337.685819] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5338.368113] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5339.120506] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5339.874933] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5340.656071] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5341.597762] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5342.481751] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5343.435733] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5344.376961] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5345.446576] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5346.347387] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5347.395421] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5348.412638] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5349.411066] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5350.377554] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5351.362985] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5352.299974] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5353.194554] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5354.049970] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5355.000081] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5355.870042] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5356.615841] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5357.338116] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5358.217931] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5359.053834] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5359.997757] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5360.869090] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5361.700493] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5362.503500] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5363.564819] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5364.540978] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5365.646454] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5366.552420] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5367.535346] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5368.412766] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5369.392140] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5370.232044] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5371.029555] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5371.897763] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5372.743604] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5373.755945] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5374.741491] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5375.575580] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5376.481981] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5377.338558] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5378.311295] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5379.257683] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5380.281934] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5381.138523] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5382.166820] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5383.176911] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5384.090104] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5384.883706] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5385.703986] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5386.644722] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5387.416132] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5388.179975] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5389.004523] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5389.863533] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5390.711872] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5391.678688] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5392.575360] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5393.460089] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5394.245749] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5395.139492] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5395.896846] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5396.785475] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5397.606290] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5398.405817] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5399.278849] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5400.187821] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5401.054275] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5401.912098] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5402.649454] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5403.390814] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5404.310909] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5405.162478] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5405.984307] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5406.707959] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5407.669504] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5408.464109] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5409.583789] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5410.596273] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5411.545051] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5412.494884] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5413.508425] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5414.355091] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5415.348530] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5416.186241] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5417.020171] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5417.796299] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5418.621833] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5419.380482] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5420.169413] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5420.954036] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5421.652258] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5422.277474] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5423.019756] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5423.713353] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5424.571831] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5425.425381] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5426.216298] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5426.868149] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5427.682066] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5428.246846] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5428.918823] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5429.568449] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5430.240423] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5430.898707] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5431.579179] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5432.306638] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5433.092279] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5433.803783] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5434.585256] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5435.390694] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5436.216747] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5437.019635] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5437.854808] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5438.788300] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5439.950162] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5440.825843] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5441.811318] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5442.633239] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5443.527967] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5444.211552] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5445.321825] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5446.100396] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5446.787633] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5447.599924] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5448.789541] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5449.660700] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5450.394170] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5451.329195] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5452.342974] LustreError: 171999:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 5452.356141] LustreError: 171999:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 5452.364326] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5453.363282] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5454.198925] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5455.130958] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5455.956249] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5456.878316] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5457.869579] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5458.795646] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5459.812296] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5460.678289] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5461.520227] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5462.236300] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5463.077687] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5463.900494] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5464.713996] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5465.366202] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5465.987416] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5466.746647] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5467.563567] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5468.222923] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5469.357961] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5470.397380] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5471.277780] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5472.008820] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5472.701674] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5473.466606] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5474.132475] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5474.891139] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5475.951040] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5476.992418] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5478.093170] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5479.128945] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5480.242952] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5481.419255] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5482.328917] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5483.447354] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5484.354469] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5485.290883] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5486.012479] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5486.882543] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5487.692259] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5488.594805] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5489.365925] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5490.232103] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5491.067244] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5492.197301] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5493.229305] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5493.957765] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5494.798695] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5496.049746] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5497.144330] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5498.088033] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5498.915638] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5500.040280] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5500.925696] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5501.819446] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5502.515956] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5503.412796] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5504.143294] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5504.909871] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5505.593454] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5506.150437] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5506.728559] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5507.449201] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5508.283506] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5509.028842] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5509.668465] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5510.621458] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5511.512322] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5512.347434] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5513.281528] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5513.978821] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5514.692030] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5515.452603] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5516.248657] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5517.063820] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5517.945369] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5518.783082] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5519.674221] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5520.577691] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5521.519127] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5522.384079] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5523.355455] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5524.267505] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5525.039687] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5525.779700] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5526.559355] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5527.271418] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5528.150894] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5528.862911] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5529.621335] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5530.434394] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5531.236838] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5531.997887] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5532.823470] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5533.660632] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5534.609135] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5535.511330] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5536.415131] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5537.341131] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5538.224063] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5539.114898] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5539.911636] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5540.691773] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5541.359459] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5542.061039] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5542.874675] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5543.842542] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5544.674389] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5545.459639] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5546.269978] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5547.066383] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5547.832964] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5548.578387] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5549.385697] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5550.245537] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5551.124435] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5551.931069] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5552.701450] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5553.446848] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5554.344841] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5555.156442] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5556.047410] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5556.907257] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5557.882579] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5558.798672] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5559.654771] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5560.492297] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5561.410206] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5562.195217] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5562.933806] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5563.732966] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5564.628571] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5565.429210] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5566.091395] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5566.872234] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5567.667881] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5568.331975] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5569.166286] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5570.081326] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5571.040895] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5571.903899] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5572.682657] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5573.476304] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5574.266079] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5574.992703] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5575.706942] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5576.408396] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5577.224239] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5577.983224] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5578.684056] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5579.297388] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5580.175526] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5580.892459] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5581.608201] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5582.292405] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5583.001835] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5583.707762] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5584.373244] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5585.269255] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5586.165940] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5587.250351] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5588.309976] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5589.138948] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5590.228937] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5591.492039] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5592.629371] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5593.905904] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5595.062627] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5596.190777] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5597.174198] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5598.133629] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5598.922779] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5599.688252] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5600.603627] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5601.354409] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5602.454704] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5603.497736] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5604.530977] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5605.260758] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5606.278301] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5607.104234] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5607.879030] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5609.142802] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5610.169110] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5611.065432] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5612.257111] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5613.151900] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5613.994919] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5614.815527] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5615.873795] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5616.926470] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5617.815500] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5618.650727] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5619.366663] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5620.241560] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5621.418522] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5622.765960] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5624.001199] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5625.161746] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5626.166721] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5626.921684] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5627.990028] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5628.795389] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5629.597597] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5630.512709] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5631.362587] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5632.162332] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5633.044429] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5633.976168] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5634.959704] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5635.905248] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5636.685810] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5637.628273] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5638.539277] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5639.511646] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5640.467660] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5641.495561] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5642.306019] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5643.291092] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5644.131749] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5645.010839] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5645.818867] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5646.690728] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5647.555785] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5648.453734] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5649.253593] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5650.209844] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5651.183019] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5652.099508] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5652.942442] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5653.839696] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5654.676614] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5655.461641] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5656.253930] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5657.225240] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6046.614224] LustreError: 173989:0:(ofd_dev.c:1780:ofd_create_hdl()) lustre-OST0000: unable to precreate: rc = -28 [ 6046.625135] LustreError: 171999:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -28 [ 6679.014639] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6679.017137] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6679.018210] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 6679.025924] Lustre: Skipped 378 previous similar messages [ 6679.067093] Lustre: Skipped 1 previous similar message [ 6683.535647] Lustre: server umount lustre-OST0000 complete [ 6689.252315] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6689.257786] Lustre: Skipped 1 previous similar message [ 6693.259409] Lustre: server umount lustre-MDT0000 complete [ 6694.373329] LustreError: 226105:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6694.387923] LustreError: 226105:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 6696.369598] LustreError: 171962:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788316315 with bad export cookie 12577047817050737158 [ 6696.374036] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6696.376866] LustreError: 171962:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 6696.679637] Lustre: server umount lustre-MDT0001 complete [ 6706.978649] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing unload_modules_local [ 6710.005785] Key type lgssc unregistered [ 6710.287716] LNet: 227227:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6710.292635] LNetError: 227227:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6711.335654] LNet: Removed LNI 192.168.206.108@tcp [ 6712.297362] Key type .llcrypt unregistered [ 6712.300429] Key type ._llcrypt unregistered [ 6738.719601] Key type ._llcrypt registered [ 6738.724770] Key type .llcrypt registered [ 6738.887675] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [ 6740.195918] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6740.329136] alg: No test for adler32 (adler32-zlib) [ 6741.507667] Lustre: Lustre: Build Version: 2.17.57_45_g07d9be3 [ 6741.775726] LNet: Added LNI 192.168.206.108@tcp [8/256/0/180] [ 6743.447624] Key type lgssc registered [ 6745.072477] Lustre: Echo OBD driver; http://www.lustre.org/ [ 6753.580325] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 6753.590498] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6754.864348] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6758.983047] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 6765.032236] LustreError: 228644:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6765.041521] LustreError: 228644:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 6767.066426] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6767.598071] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6772.501968] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 6781.516588] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 6787.734841] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 6794.079118] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6794.340819] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6800.515131] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49665 to 0x280000401:49696) [ 6800.609269] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 6807.800237] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 6815.631398] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 6817.131796] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6817.142791] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 6817.151127] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6817.160504] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 6817.163085] LustreError: 228664:0:(osp_precreate.c:1268:osp_precreate_thread()) cfs_fail_timeout id 2107 sleeping for 20000ms [ 6819.876801] Lustre: lustre-OST0000: Not available for connect from 192.168.206.8@tcp (stopping) [ 6823.398329] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6823.398906] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 6823.408532] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6823.420480] Lustre: Skipped 1 previous similar message [ 6824.914554] Lustre: server umount lustre-OST0000 complete [ 6837.231282] LustreError: 228664:0:(osp_precreate.c:1268:osp_precreate_thread()) cfs_fail_timeout id 2107 awake [ 6858.480936] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6858.750911] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6863.911937] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6863.921173] LustreError: lustre-OST0000-osc-MDT0001: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6863.923702] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 6864.434382] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 6871.160993] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 6872.529214] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec [ 6877.002526] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff94cef0d37000.ost_server_uuid 50 [ 6878.197305] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff94cef0d37000.ost_server_uuid in FULL state after 0 sec [ 6883.817354] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 6883.829957] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6883.845695] Lustre: Skipped 1 previous similar message [ 6883.859265] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6884.597047] Lustre: server umount lustre-OST0000 complete [ 6889.442819] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6889.444912] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6889.449298] Lustre: Skipped 2 previous similar messages [ 6889.451787] Lustre: Skipped 2 previous similar messages [ 6894.561793] LustreError: 228641:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6894.577253] LustreError: 228641:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 6894.609569] Lustre: server umount lustre-MDT0000 complete [ 6898.400088] LustreError: 228625:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788316517 with bad export cookie 12799696853904695078 [ 6898.421411] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6898.430662] LustreError: 228625:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 6899.178647] Lustre: server umount lustre-MDT0001 complete [ 6909.622859] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing unload_modules_local [ 6912.261230] Key type lgssc unregistered [ 6912.504433] LNet: 233852:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6912.517238] LNetError: 233852:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6913.575255] LNet: Removed LNI 192.168.206.108@tcp [ 6914.251330] Key type .llcrypt unregistered [ 6914.254144] Key type ._llcrypt unregistered [ 6943.928254] Key type ._llcrypt registered [ 6943.931133] Key type .llcrypt registered [ 6944.066644] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [ 6944.775824] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6944.824877] alg: No test for adler32 (adler32-zlib) [ 6945.944733] Lustre: Lustre: Build Version: 2.17.57_45_g07d9be3 [ 6946.194292] LNet: Added LNI 192.168.206.108@tcp [8/256/0/180] [ 6947.872236] Key type lgssc registered [ 6948.897880] Lustre: Echo OBD driver; http://www.lustre.org/ [ 6956.350643] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 6956.387195] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6957.835400] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6962.362703] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 6967.272896] LustreError: 235595:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6967.287323] LustreError: 235595:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 6970.103251] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6970.527322] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6974.930847] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 6978.117929] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 6985.987858] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6986.488759] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6992.761517] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 7001.413960] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7001.601276] Lustre: lustre-OST0001: new disk, initializing [ 7001.605092] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 7001.609986] Lustre: 237902:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 7001.691369] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 7002.738721] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49728) [ 7007.162181] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 7010.394594] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 7010.406567] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 7010.533154] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 7016.547050] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 7022.490742] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 7034.718336] Lustre: server umount lustre-MDT0000 complete [ 7034.852949] LustreError: lustre-MDT0000-osp-MDT0001: operation out_update to node 0@lo failed: rc = -107 [ 7034.859702] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7034.870723] LustreError: 235595:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7036.389725] LustreError: 237573:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7036.395296] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7036.415286] Lustre: Skipped 1 previous similar message [ 7037.640633] LustreError: 236331:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0000-osp-MDT0001: osp_attr_get update error [0x200001b72:0x1:0x0]: rc = -5 [ 7037.641932] LustreError: 235575:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788316656 with bad export cookie 5291851691471652294 [ 7037.643904] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7037.660085] LustreError: 235575:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 7038.009307] Lustre: server umount lustre-MDT0001 complete [ 7051.827242] Lustre: server umount lustre-OST0000 complete [ 7065.618933] Lustre: server umount lustre-OST0001 complete [ 7083.766656] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [ 7091.634259] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7091.917055] LustreError: 241009:0:(ldlm_lib.c:1190:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7091.945292] LustreError: 241009:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [ 7091.997644] Lustre: mylustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7095.777703] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 7097.326473] LustreError: 241010:0:(ldlm_lib.c:1190:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7102.956043] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7103.232496] Lustre: mylustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7106.595403] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 7108.806974] Lustre: 242151:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 7114.672753] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7117.034088] LustreError: 242688:0:(ldlm_lib.c:1190:target_handle_connect()) mylustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7117.047897] Lustre: mylustre-OST0000: new connection from mylustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49760) [ 7117.051355] LustreError: 242688:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 7119.961118] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 7126.927075] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7127.159256] Lustre: mylustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 7127.165298] Lustre: Skipped 1 previous similar message [ 7128.205953] Lustre: mylustre-OST0000: new connection from mylustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:100 to 0x280000400:129) [ 7131.865746] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 7138.783416] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 7142.568837] Lustre: 244020:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 7154.158893] Lustre: mylustre-MDT0000-osp-MDT0001: Connection to mylustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7154.162781] Lustre: mylustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7154.174914] Lustre: Skipped 4 previous similar messages [ 7154.184984] Lustre: Skipped 2 previous similar messages [ 7159.266655] LustreError: 241009:0:(ldlm_lib.c:1190:target_handle_connect()) mylustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7159.280262] LustreError: 241009:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 7160.778852] Lustre: server umount mylustre-MDT0000 complete [ 7164.258511] LustreError: 240986:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788316783 with bad export cookie 5291851691471655150 [ 7164.265349] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7164.273479] LustreError: 240986:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 7164.386120] Lustre: mylustre-MDT0001-lwp-OST0000: Connection to mylustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7164.389197] Lustre: mylustre-MDT0001: Not available for connect from 0@lo (stopping) [ 7164.393421] Lustre: Skipped 1 previous similar message [ 7164.398971] Lustre: Skipped 1 previous similar message [ 7164.522461] Lustre: server umount mylustre-MDT0001 complete [ 7170.771707] Lustre: server umount mylustre-OST0000 complete [ 7174.746321] Lustre: server umount mylustre-OST0001 complete [ 7197.058559] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [ 7207.090130] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7207.437806] LustreError: 246328:0:(ldlm_lib.c:1190:target_handle_connect()) tfs-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7207.454349] LustreError: 246328:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 7207.501712] Lustre: tfs-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7212.363567] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 7222.503567] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7222.754048] Lustre: tfs-MDT0001: Not available for connect from 0@lo (not set up) [ 7228.539129] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 7231.588946] Lustre: 247470:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 7238.564844] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7244.472138] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 7247.085290] Lustre: tfs-OST0000: new connection from tfs-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:100 to 0x280000400:161) [ 7251.501979] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7252.760725] Lustre: tfs-OST0000: new connection from tfs-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49792) [ 7252.768137] Lustre: tfs-OST0001: new connection from tfs-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:35 to 0x2c0000400:65) [ 7257.503379] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 7265.298706] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 7269.169117] Lustre: 249341:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 7278.566552] Lustre: tfs-MDT0000-lwp-OST0000: Connection to tfs-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7278.579269] Lustre: tfs-MDT0000: Not available for connect from 0@lo (stopping) [ 7278.595715] Lustre: Skipped 2 previous similar messages [ 7278.607913] Lustre: Skipped 2 previous similar messages [ 7283.286363] Lustre: server umount tfs-MDT0000 complete [ 7283.710804] LustreError: 246329:0:(ldlm_lib.c:1190:target_handle_connect()) tfs-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7283.721960] LustreError: 246329:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 6 previous similar messages [ 7287.062314] LustreError: 247072:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788316906 with bad export cookie 5291851691471657103 [ 7287.065813] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7287.078536] LustreError: 247072:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 7287.460594] Lustre: server umount tfs-MDT0001 complete [ 7301.837222] Lustre: server umount tfs-OST0000 complete [ 7304.161269] Lustre: 234860:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788316907/real 1788316907] req@ffff959d1e8a8e00 x1875185830661248/t0(0) o400->tfs-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788316923 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 7304.200678] Lustre: tfs-MDT0001-lwp-OST0001: Connection to tfs-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7304.215715] Lustre: Skipped 1 previous similar message [ 7305.444874] Lustre: server umount tfs-OST0001 complete [ 7325.063740] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [ 7333.861233] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7334.270041] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7334.274606] Lustre: Skipped 3 previous similar messages [ 7337.817818] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 7344.812419] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7349.295347] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 7352.055887] Lustre: 252736:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 7357.806405] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7359.101107] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49824) [ 7363.184452] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 7370.763137] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:100 to 0x280000400:193) [ 7371.127944] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7376.892881] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:35 to 0x2c0000400:97) [ 7377.342129] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 7384.212864] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 7387.290947] Lustre: 254604:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 7394.202748] Lustre: DEBUG MARKER: == conf-sanity test 104a: Make sure user defined options are reflected in mount ========================================================== 22:43:31 (1788317011) [ 7411.683446] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7411.702358] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7411.727491] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7416.587391] Lustre: server umount lustre-MDT0000 complete [ 7417.832207] LustreError: 251590:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7417.848828] LustreError: 251590:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 11 previous similar messages [ 7420.268095] LustreError: 251568:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788317039 with bad export cookie 5291851691471659021 [ 7420.271912] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7420.279150] LustreError: 251568:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 7422.947831] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 7422.960666] Lustre: Skipped 5 previous similar messages [ 7426.651459] Lustre: server umount lustre-MDT0001 complete [ 7436.113901] Lustre: server umount lustre-OST0000 complete [ 7445.400867] Lustre: server umount lustre-OST0001 complete [ 7451.422378] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_hostid [ 7460.755099] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [ 7494.973832] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7495.209906] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 7495.255225] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 7495.349271] Lustre: lustre-MDT0000: new disk, initializing [ 7495.485165] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 188-180 [ 7495.497277] Lustre: Skipped 3 previous similar messages [ 7495.517425] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 7500.391417] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 7511.938879] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7512.079390] Lustre: 257790:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 7512.141600] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 7512.146507] Lustre: Skipped 1 previous similar message [ 7512.245564] Lustre: lustre-MDT0001: new disk, initializing [ 7512.411526] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 7512.426222] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 7516.846278] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 7527.475106] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7527.777404] Lustre: lustre-OST0000: new disk, initializing [ 7527.786075] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 7527.795952] Lustre: 259371:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 7529.276952] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 7529.295272] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 7529.426894] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 7533.593418] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 7543.588756] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7543.811637] Lustre: lustre-OST0001: new disk, initializing [ 7543.819631] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 7543.827357] Lustre: 260241:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 7545.386338] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 7545.402606] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 7545.536036] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 7550.637915] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 7563.430239] Lustre: DEBUG MARKER: == conf-sanity test 104b: Mount uses last flock argument ========================================================== 22:46:21 (1788317181) [ 7578.889878] Lustre: DEBUG MARKER: == conf-sanity test 105: check file creation for ro and rw bind mnt pt ========================================================== 22:46:36 (1788317196) [ 7596.003587] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 7596.010592] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7596.016502] LustreError: Skipped 1 previous similar message [ 7596.042461] Lustre: Skipped 5 previous similar messages [ 7596.057382] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7596.066312] Lustre: Skipped 3 previous similar messages [ 7599.663805] Lustre: server umount lustre-OST0000 complete [ 7604.709077] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7609.307989] Lustre: server umount lustre-MDT0000 complete [ 7612.792751] LustreError: 257780:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788317231 with bad export cookie 5291851691471660799 [ 7612.800231] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7612.809260] LustreError: 257780:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 7627.231140] Lustre: lustre-MDT0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 7627.458479] Lustre: server umount lustre-MDT0001 complete [ 7638.455676] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing unload_modules_local [ 7710.334752] Lustre: server umount lustre-OST0001 complete [ 7716.314337] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_hostid [ 7731.363884] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [ 7764.922592] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7765.110835] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 7765.149264] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 7765.236265] Lustre: lustre-MDT0000: new disk, initializing [ 7765.327836] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7765.334640] Lustre: Skipped 3 previous similar messages [ 7765.360774] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 7769.031721] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 7779.675103] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7779.779223] Lustre: 265092:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 7780.048093] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 7785.549416] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 7796.509832] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 7802.318548] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 7808.578817] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7808.864228] Lustre: lustre-OST0000: new disk, initializing [ 7808.866621] Lustre: Skipped 1 previous similar message [ 7808.870133] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 7808.873575] Lustre: Skipped 2 previous similar messages [ 7808.879758] Lustre: 267060:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 7810.765462] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 7810.781782] Lustre: Skipped 1 previous similar message [ 7810.796962] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 7810.879421] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 7814.790640] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 7822.864955] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 7831.524541] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 7831.532913] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7831.537152] LustreError: Skipped 1 previous similar message [ 7831.541676] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7831.551073] Lustre: Skipped 6 previous similar messages [ 7831.555899] Lustre: Skipped 8 previous similar messages [ 7834.885461] Lustre: server umount lustre-OST0000 complete [ 7841.762235] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7844.291899] Lustre: server umount lustre-MDT0000 complete [ 7846.883993] LustreError: 265098:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7846.902900] LustreError: 265098:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 14 previous similar messages [ 7847.410069] LustreError: 265084:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788317466 with bad export cookie 5291851691471662262 [ 7847.414958] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7847.419297] LustreError: 265084:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 5 previous similar messages [ 7847.671865] Lustre: server umount lustre-MDT0001 complete [ 7857.763545] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing unload_modules_local [ 7860.176667] Key type lgssc unregistered [ 7860.452697] LNet: 268824:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7860.457714] LNetError: 268824:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7861.480513] LNet: Removed LNI 192.168.206.108@tcp [ 7862.273292] Key type .llcrypt unregistered [ 7862.279828] Key type ._llcrypt unregistered [ 7886.577148] Key type ._llcrypt registered [ 7886.579439] Key type .llcrypt registered [ 7886.725030] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [ 7887.519599] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7887.539792] alg: No test for adler32 (adler32-zlib) [ 7888.790712] Lustre: Lustre: Build Version: 2.17.57_45_g07d9be3 [ 7888.978317] LNet: Added LNI 192.168.206.108@tcp [8/256/0/180] [ 7890.663150] Key type lgssc registered [ 7891.717805] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7898.634620] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7898.659458] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7900.147659] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7904.713039] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 7910.377758] LustreError: 270280:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7910.392137] LustreError: 270280:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 7914.006459] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7914.385173] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7919.087252] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 7926.922520] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 7933.799852] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 7941.289694] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7941.602309] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7945.714640] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:33) [ 7947.570887] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 7954.128778] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 7955.359532] Lustre: Setting parameter lustre-OST0000.ost.unknown_param=50 in log lustre-OST0000 [ 7960.229151] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7960.237310] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7960.250924] Lustre: Skipped 1 previous similar message [ 7963.380286] Lustre: server umount lustre-OST0000 complete [ 7970.785144] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7970.785258] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7970.790068] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7970.803945] Lustre: Skipped 1 previous similar message [ 7973.151341] Lustre: server umount lustre-MDT0000 complete [ 7975.906363] LustreError: 270275:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7975.934718] LustreError: 270275:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 7977.344852] LustreError: 272810:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788317596 with bad export cookie 10452523061688132740 [ 7977.354287] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7977.364905] LustreError: 272810:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 7977.948390] Lustre: server umount lustre-MDT0001 complete [ 7989.616618] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing unload_modules_local [ 7992.430526] Key type lgssc unregistered [ 7992.746974] LNet: 273874:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7992.757788] LNetError: 273874:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7992.775812] LNet: Removed LNI 192.168.206.108@tcp [ 7993.506966] Key type .llcrypt unregistered [ 7993.508879] Key type ._llcrypt unregistered [ 8008.566466] Key type ._llcrypt registered [ 8008.569240] Key type .llcrypt registered [ 8008.670521] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [ 8009.594748] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8009.661373] alg: No test for adler32 (adler32-zlib) [ 8010.798633] Lustre: Lustre: Build Version: 2.17.57_45_g07d9be3 [ 8011.059127] LNet: Added LNI 192.168.206.108@tcp [8/256/0/180] [ 8012.735211] Key type lgssc registered [ 8013.646410] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8021.893174] Lustre: lustre-OST0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 8021.917901] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8037.472925] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 8042.591539] LustreError: 275067:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.206.108@tcp: failed processing log, type 4: rc = -110 [ 8069.215176] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8074.837809] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 8080.827617] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 8082.680343] Lustre: server umount lustre-OST0000 complete [ 8098.400169] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing unload_modules_local [ 8100.619697] Key type lgssc unregistered [ 8100.898811] LNet: 276702:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8100.908602] LNetError: 276702:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8100.920737] LNet: Removed LNI 192.168.206.108@tcp [ 8101.589638] Key type .llcrypt unregistered [ 8101.592341] Key type ._llcrypt unregistered [ 8139.331189] Key type ._llcrypt registered [ 8139.333416] Key type .llcrypt registered [ 8139.420547] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [ 8140.496694] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8140.507627] alg: No test for adler32 (adler32-zlib) [ 8141.510663] Lustre: Lustre: Build Version: 2.17.57_45_g07d9be3 [ 8141.765410] LNet: Added LNI 192.168.206.108@tcp [8/256/0/180] [ 8143.457044] Key type lgssc registered [ 8144.707938] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8157.123037] loop0: detected capacity change from 0 to 204800000 [ 8157.390291] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8157.402376] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8157.753921] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8158.839602] loop0: detected capacity change from 0 to 204800000 [ 8159.047446] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8159.060143] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8159.299510] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8160.178768] loop0: detected capacity change from 0 to 204800000 [ 8160.359063] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8160.380317] blk_update_request: operation not supported error, dev loop0, sector 8224 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8160.513651] blk_update_request: operation not supported error, dev loop0, sector 58264 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8161.561859] loop0: detected capacity change from 0 to 204800000 [ 8161.735106] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8162.939112] loop0: detected capacity change from 0 to 204800000 [ 8162.966351] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 8166.996539] loop0: detected capacity change from 0 to 204800000 [ 8167.035114] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 8170.423366] loop0: detected capacity change from 0 to 204800000 [ 8170.456102] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 8173.699535] loop0: detected capacity change from 0 to 204800000 [ 8173.738959] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 8177.299695] loop0: detected capacity change from 0 to 204800000 [ 8177.429620] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 8177.518943] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8177.597254] Lustre: 280116:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 8177.607440] Lustre: 280116:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000003:0xb:0x0]: rc = 0 [ 8177.626496] Lustre: 280116:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000-MDT0000' with [0x200000005:0x3:0x0]: rc = 0 [ 8177.640602] Lustre: 280116:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000003:0xc:0x0]: rc = 0 [ 8177.650728] Lustre: 280116:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000-MDT0000' with [0x200000005:0x2:0x0]: rc = 0 [ 8177.662522] Lustre: 280116:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000-MDT0000' with [0x200000005:0x1:0x0]: rc = 0 [ 8177.671396] Lustre: 280116:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000003:0xa:0x0]: rc = 0 [ 8177.680380] Lustre: 280116:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index 'nodemap' with [0x200000003:0x3:0x0]: rc = 0 [ 8177.688590] Lustre: 280116:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2020000' with [0x200000006:0x2020000:0x0]: rc = 0 [ 8177.698400] Lustre: 280116:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x20000' with [0x200000006:0x20000:0x0]: rc = 0 [ 8177.706575] Lustre: 280116:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1020000' with [0x200000006:0x1020000:0x0]: rc = 0 [ 8177.715658] Lustre: 280116:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000006:0x1010000:0x0]: rc = 0 [ 8177.724511] Lustre: 280116:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000006:0x2010000:0x0]: rc = 0 [ 8177.734634] Lustre: 280116:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000006:0x10000:0x0]: rc = 0 [ 8183.132946] Lustre: server umount MGS complete [ 8183.842641] loop0: detected capacity change from 0 to 204800000 [ 8183.884807] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8184.509952] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8184.569187] Lustre: lustre-MDT0000: Aborting client recovery [ 8185.469993] loop1: detected capacity change from 0 to 204800000 [ 8185.637242] LDISKFS-fs (loop1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8185.680477] Lustre: 280548:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 8185.689589] Lustre: 280548:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x1010000' with [0x200000003:0x5:0x0]: rc = 0 [ 8185.702722] Lustre: 280548:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x2010000' with [0x200000003:0x6:0x0]: rc = 0 [ 8185.718569] Lustre: 280548:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x2010000-MDT0001' with [0x200000005:0x3:0x0]: rc = 0 [ 8185.731482] Lustre: 280548:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x1010000-MDT0001' with [0x200000005:0x2:0x0]: rc = 0 [ 8185.746638] Lustre: 280548:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x10000' with [0x200000003:0x4:0x0]: rc = 0 [ 8185.754646] Lustre: 280548:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x10000-MDT0001' with [0x200000005:0x1:0x0]: rc = 0 [ 8185.776048] Lustre: Found index 1 for lustre-MDT0001, updating log [ 8185.926217] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8185.996838] Lustre: lustre-MDT0001: Aborting client recovery [ 8186.750512] loop2: detected capacity change from 0 to 204800000 [ 8186.859610] LDISKFS-fs (loop2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8186.907898] Lustre: 280626:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 8186.917731] Lustre: 280626:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 8186.927558] Lustre: 280626:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x20000-OST0000' with [0x200000005:0x1:0x0]: rc = 0 [ 8186.938443] Lustre: 280626:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 8186.946529] Lustre: 280626:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x2020000-OST0000' with [0x200000005:0x3:0x0]: rc = 0 [ 8186.956077] Lustre: 280626:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 8186.965351] Lustre: 280626:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x1020000-OST0000' with [0x200000005:0x2:0x0]: rc = 0 [ 8187.054737] Lustre: Found index 0 for lustre-OST0000, updating log [ 8187.093429] Lustre: 280645:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8187.144677] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8187.156644] Lustre: lustre-OST0000: Aborting recovery [ 8187.977243] loop3: detected capacity change from 0 to 204800000 [ 8188.103841] LDISKFS-fs (loop3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8188.177540] Lustre: 280710:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 8188.183572] Lustre: 280710:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 8188.189188] Lustre: 280710:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x1020000-OST0001' with [0x200000005:0x2:0x0]: rc = 0 [ 8188.197628] Lustre: 280710:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 8188.212534] Lustre: 280710:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 8188.223214] Lustre: 280710:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x2020000-OST0001' with [0x200000005:0x3:0x0]: rc = 0 [ 8188.242751] Lustre: 280710:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x20000-OST0001' with [0x200000005:0x1:0x0]: rc = 0 [ 8188.273103] Lustre: Found index 1 for lustre-OST0001, updating log [ 8188.305556] Lustre: 280715:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8188.385659] Lustre: lustre-OST0001: Aborting recovery [ 8193.534137] LustreError: 280492:0:(lod_dev.c:511:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 9, retries 0, failed: rc = -108 [ 8194.541576] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 8194.543374] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 8194.637168] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000bd0 [ 8194.666436] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000bd0 [ 8195.558408] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:5 to 0x2c0000400:33) [ 8195.560779] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:5 to 0x280000400:33) [ 8196.899980] LustreError: 280459:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0000: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0000 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0000/identity_upcall, time 163us: rc = -2 [ 8197.411772] LustreError: 280457:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0000: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0000 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0000/identity_upcall, time 2710us: rc = -2 [ 8197.438422] LustreError: 280457:0:(mdt_identity.c:115:mdt_identity_do_upcall()) Skipped 18 previous similar messages [ 8210.912557] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8210.913032] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8210.932586] Lustre: Skipped 3 previous similar messages [ 8210.945524] Lustre: Skipped 3 previous similar messages [ 8216.031823] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8216.040523] Lustre: Skipped 2 previous similar messages [ 8218.398889] Lustre: server umount lustre-MDT0000 complete [ 8219.221483] LustreError: 280442:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788317838 with bad export cookie 13046562085640871586 [ 8219.227307] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8219.235586] LustreError: 280442:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 8221.152386] LustreError: 280950:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8221.155780] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8221.156440] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 8221.169591] LustreError: 280950:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [ 8221.184302] Lustre: Skipped 1 previous similar message [ 8224.161877] LustreError: 280457:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8224.161885] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 8224.161896] Lustre: Skipped 1 previous similar message [ 8225.638151] Lustre: server umount lustre-MDT0001 complete [ 8232.824563] Lustre: server umount lustre-OST0000 complete [ 8239.844348] Lustre: server umount lustre-OST0001 complete [ 8247.352473] Lustre: DEBUG MARKER: == conf-sanity test 109a: test lctl clear_conf fsname ==== 22:57:45 (1788317865) [ 8272.293065] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_hostid [ 8281.909301] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [ 8315.138805] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8315.325885] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 8315.345652] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 8315.399887] Lustre: lustre-MDT0000: new disk, initializing [ 8315.454773] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8315.459819] Lustre: Skipped 1 previous similar message [ 8315.475178] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 8319.210940] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 8328.356831] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8328.489885] Lustre: 284782:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8328.536614] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 8328.540689] Lustre: Skipped 1 previous similar message [ 8328.625809] Lustre: lustre-MDT0001: new disk, initializing [ 8328.727217] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8328.827639] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 8328.841296] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 8332.692280] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 8341.333775] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 8346.351987] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 8353.010968] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8353.260426] Lustre: lustre-OST0000: new disk, initializing [ 8353.264535] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 8353.271176] Lustre: 286752:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8353.355253] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8358.735647] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 8361.023484] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 8361.049596] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 8361.144119] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 8367.062886] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 8371.427791] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 8383.430819] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 8388.408736] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 8392.773643] Lustre: Modifying parameter lustre-client.llite.max_read_ahead_mb=64 in log lustre-client [ 8438.243744] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8438.250640] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 8438.259785] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8438.273260] Lustre: Skipped 1 previous similar message [ 8439.375442] Lustre: server umount lustre-OST0000 complete [ 8443.384513] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8443.407600] Lustre: Skipped 2 previous similar messages [ 8448.480655] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8448.485249] Lustre: Skipped 3 previous similar messages [ 8448.938506] Lustre: server umount lustre-MDT0000 complete [ 8451.951159] LustreError: 284776:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788318070 with bad export cookie 13046562085640874302 [ 8451.953580] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8451.968680] LustreError: 284776:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 8452.293178] Lustre: server umount lustre-MDT0001 complete [ 8459.341607] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8463.232510] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 8467.245817] Lustre: server umount MGS complete [ 8476.663592] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8477.144604] LustreError: 290674:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8477.166372] LustreError: 290674:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 8477.173865] LustreError: 290687:0:(qmt_pool.c:1639:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 8477.240659] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8481.024614] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 8482.272262] LustreError: 290675:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8487.397133] LustreError: 290674:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8488.803514] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8492.803973] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 8499.828319] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 8505.959681] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 8514.270675] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8514.591765] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8514.595880] Lustre: Skipped 1 previous similar message [ 8520.553222] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 8526.799889] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 8548.325600] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8548.332939] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 8548.340566] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8548.341724] LustreError: Skipped 2 previous similar messages [ 8549.450840] Lustre: server umount lustre-OST0000 complete [ 8567.263792] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 8567.510801] Lustre: server umount lustre-MDT0000 complete [ 8568.813184] LustreError: 290669:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8568.836991] LustreError: 290669:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 8571.306368] LustreError: 293509:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788318190 with bad export cookie 13046562085640876143 [ 8571.311309] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8571.315898] LustreError: 293509:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 8571.600434] Lustre: server umount lustre-MDT0001 complete [ 8583.043679] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing unload_modules_local [ 8585.746923] Key type lgssc unregistered [ 8586.116531] LNet: 294622:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8586.122584] LNetError: 294622:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8586.136076] LNet: Removed LNI 192.168.206.108@tcp [ 8587.029984] Key type .llcrypt unregistered [ 8587.036444] Key type ._llcrypt unregistered [ 8619.187919] Key type ._llcrypt registered [ 8619.191265] Key type .llcrypt registered [ 8619.280167] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_hostid [ 8631.753083] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [ 8632.593984] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8632.669388] alg: No test for adler32 (adler32-zlib) [ 8633.686123] Lustre: Lustre: Build Version: 2.17.57_45_g07d9be3 [ 8633.897115] LNet: Added LNI 192.168.206.108@tcp [8/256/0/180] [ 8635.559268] Key type lgssc registered [ 8636.779762] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8667.114072] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 8667.139126] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8668.455247] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 8668.489330] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 8668.580096] Lustre: lustre-MDT0000: new disk, initializing [ 8668.662539] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8668.680357] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 8672.784642] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 8681.898229] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8682.063384] Lustre: 298558:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8682.153068] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 8682.159054] Lustre: Skipped 1 previous similar message [ 8682.238913] Lustre: lustre-MDT0001: new disk, initializing [ 8682.343291] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8682.420237] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 8682.432947] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 8686.346554] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 8695.160145] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 8700.280624] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 8706.415202] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8706.691908] Lustre: lustre-OST0000: new disk, initializing [ 8706.697934] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 8706.710634] Lustre: 300526:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8706.812782] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8712.541155] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 8715.840100] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 8715.850912] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 8715.952501] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 8722.019259] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 8729.494181] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 8742.791585] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 8748.150896] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 8787.936713] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 8787.939353] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8787.948409] LustreError: Skipped 1 previous similar message [ 8787.950406] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8787.971555] Lustre: Skipped 1 previous similar message [ 8787.987234] Lustre: Skipped 1 previous similar message [ 8791.493677] Lustre: server umount lustre-OST0000 complete [ 8798.182606] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8798.183631] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8798.198996] Lustre: Skipped 1 previous similar message [ 8801.527445] Lustre: server umount lustre-MDT0000 complete [ 8805.601499] LustreError: 299362:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788318424 with bad export cookie 2414755385992755903 [ 8805.605319] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8805.610068] LustreError: 299362:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 8805.993438] Lustre: server umount lustre-MDT0001 complete [ 8814.152719] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8819.258572] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 8823.936343] Lustre: server umount MGS complete [ 8835.448520] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8835.810297] LustreError: 304437:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8835.834777] LustreError: 304437:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [ 8835.837291] LustreError: 304450:0:(qmt_pool.c:1639:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 8835.930725] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8839.938549] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 8841.188520] LustreError: 304438:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8845.284265] LustreError: 304437:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8848.759675] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8849.122036] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8853.240782] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 8859.916977] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 8864.749732] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 8871.032129] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8871.429989] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8877.410281] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 8884.979725] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 8916.453465] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8916.455336] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 8916.467469] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8916.487987] Lustre: Skipped 2 previous similar messages [ 8921.580020] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8921.599890] Lustre: Skipped 1 previous similar message [ 8921.817454] Lustre: server umount lustre-OST0000 complete [ 8926.176489] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8926.190976] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8926.209054] Lustre: Skipped 1 previous similar message [ 8926.213833] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8931.291219] Lustre: server umount lustre-MDT0000 complete [ 8931.808664] LustreError: 304433:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8931.818822] LustreError: 304433:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 8935.123178] LustreError: 307163:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788318554 with bad export cookie 2414755385992757744 [ 8935.125929] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8935.134526] LustreError: 307163:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 8935.340946] Lustre: server umount lustre-MDT0001 complete [ 8945.800244] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing unload_modules_local [ 8947.900948] Key type lgssc unregistered [ 8948.112606] LNet: 308383:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8948.122599] LNetError: 308383:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8948.155923] LNet: Removed LNI 192.168.206.108@tcp [ 8948.977339] Key type .llcrypt unregistered [ 8948.979749] Key type ._llcrypt unregistered [ 8966.146661] Key type ._llcrypt registered [ 8966.148905] Key type .llcrypt registered [ 8966.236317] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_hostid [ 8977.199461] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [ 8978.201814] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8978.213561] alg: No test for adler32 (adler32-zlib) [ 8979.265425] Lustre: Lustre: Build Version: 2.17.57_45_g07d9be3 [ 8979.491237] LNet: Added LNI 192.168.206.108@tcp [8/256/0/180] [ 8981.199172] Key type lgssc registered [ 8982.313512] Lustre: Echo OBD driver; http://www.lustre.org/ [ 9002.586853] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [ 9014.958060] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 9014.988381] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9016.189629] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 9016.234468] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 9016.336853] Lustre: lustre-MDT0000: new disk, initializing [ 9016.407920] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9016.431789] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 9019.986372] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 9030.005759] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9030.377303] Lustre: lustre-OST0000: new disk, initializing [ 9030.378905] Lustre: lustre-OST0000: Not available for connect from 0@lo (not set up) [ 9030.386304] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 9030.386312] Lustre: Skipped 1 previous similar message [ 9030.387578] Lustre: 312415:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 9030.461031] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9035.851217] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 9035.860820] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 9035.902877] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 9036.657417] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [ 9916.387060] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9916.432945] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9920.027824] Lustre: server umount lustre-MDT0000 complete [ 9923.238300] LustreError: 311598:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788319542 with bad export cookie 10297010464292779181 [ 9923.244740] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9923.262083] LustreError: 311598:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 9923.519170] Lustre: server umount lustre-OST0000 complete [ 9953.300770] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_hostid [ 9965.596188] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [10003.135276] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10003.389697] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [10003.421757] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [10003.483799] Lustre: lustre-MDT0000: new disk, initializing [10003.589279] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10003.604858] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [10007.857099] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [10017.531428] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10017.646042] Lustre: 316758:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [10017.701199] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [10017.706106] Lustre: Skipped 1 previous similar message [10017.781760] Lustre: lustre-MDT0001: new disk, initializing [10017.862268] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [10017.892717] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [10017.907411] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [10021.770234] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [10030.742796] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [10036.647647] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [10043.622895] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10043.902813] Lustre: lustre-OST0000: new disk, initializing [10043.906609] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [10043.913574] Lustre: 318727:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [10043.985653] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [10049.066954] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [10051.106688] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [10051.125716] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [10051.250626] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [10058.130311] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [10062.900480] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [10063.112849] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [10067.986428] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [10068.245929] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [10072.035763] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [10072.044088] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10072.059163] LustreError: Skipped 1 previous similar message [10072.074223] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [10072.078706] Lustre: Skipped 1 previous similar message [10072.112282] Lustre: Skipped 1 previous similar message [10077.169151] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [10077.172490] Lustre: Skipped 1 previous similar message [10082.292730] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [10082.298861] Lustre: Skipped 1 previous similar message [10084.321203] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [10084.598108] Lustre: server umount lustre-OST0000 complete [10092.513889] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10092.518233] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10092.536792] Lustre: Skipped 1 previous similar message [10092.551781] Lustre: Skipped 1 previous similar message [10096.117576] Lustre: server umount lustre-MDT0000 complete [10099.887132] LustreError: 317552:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788319718 with bad export cookie 10297010464295719993 [10099.890224] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [10099.906372] LustreError: 317552:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [10100.369282] Lustre: server umount lustre-MDT0001 complete [10104.533658] Lustre: DEBUG MARKER: SKIP: conf-sanity test_111 skipping SLOW test 111 [10105.950632] Lustre: DEBUG MARKER: == conf-sanity test 112a: mount OST with no_create option ========================================================== 23:28:44 (1788319724) [10112.438970] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10112.847728] LustreError: 321040:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10112.863671] LustreError: 321040:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [10112.909105] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10116.720039] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [10118.116916] LustreError: 321041:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10122.222217] LustreError: 321040:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10126.071098] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10126.375235] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [10130.506296] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [10140.330837] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [10147.610644] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [10156.030574] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10156.281192] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [10163.257532] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [10170.748648] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [10177.756822] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10177.895937] Lustre: lustre-OST0001: new disk, initializing [10177.900759] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [10177.907447] Lustre: 323877:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [10177.981657] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [10183.266886] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [10183.271903] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [10183.327775] LustreError: 324171:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [10184.332339] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [10184.361721] LustreError: 324171:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [10184.374989] LustreError: 324171:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 1 previous similar message [10185.451823] LustreError: 324171:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [10185.461629] LustreError: 324171:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 1 previous similar message [10187.491030] LustreError: 324177:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [10187.504724] LustreError: 324177:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 2 previous similar messages [10191.656154] LustreError: 324177:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [10191.664357] LustreError: 324177:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 8 previous similar messages [10194.093393] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [10194.364671] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [10199.853349] LustreError: 324171:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [10199.871066] LustreError: 324171:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 14 previous similar messages [10200.029957] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff94cef15f8000.ost_server_uuid 50 [10201.624436] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff94cef15f8000.ost_server_uuid in FULL state after 0 sec [10207.346248] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff94cef15f8000.ost_server_uuid 50 [10209.083314] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-ffff94cef15f8000.ost_server_uuid in FULL state after 0 sec [10211.263170] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [10225.181897] Lustre: lustre-OST0001: Not available for connect from 192.168.206.8@tcp (stopping) [10226.656834] LustreError: lustre-OST0001-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [10226.660602] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10226.671555] LustreError: Skipped 1 previous similar message [10231.355749] Lustre: server umount lustre-OST0001 complete [10234.866061] LustreError: 324304:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10234.895191] LustreError: 324304:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [10238.435371] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [10238.441765] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10238.453390] Lustre: Skipped 1 previous similar message [10239.986916] LustreError: 322864:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10240.017513] LustreError: 322864:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [10243.795786] Lustre: server umount lustre-OST0000 complete [10249.186605] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [10249.195028] LustreError: Skipped 1 previous similar message [10249.200831] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10249.219190] Lustre: Skipped 1 previous similar message [10249.232629] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10249.239929] Lustre: Skipped 8 previous similar messages [10254.335447] Lustre: server umount lustre-MDT0000 complete [10255.340937] LustreError: 321768:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10255.361552] LustreError: 321768:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [10257.895325] LustreError: 321022:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788319876 with bad export cookie 10297010464295720882 [10257.905607] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [10257.908646] LustreError: 321022:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [10258.445942] Lustre: server umount lustre-MDT0001 complete [10268.862479] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing unload_modules_local [10271.429499] Key type lgssc unregistered [10271.731765] LNet: 326565:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [10271.746825] LNetError: 326565:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [10271.776418] LNet: Removed LNI 192.168.206.108@tcp [10272.614723] Key type .llcrypt unregistered [10272.616947] Key type ._llcrypt unregistered [10296.900087] Key type ._llcrypt registered [10296.903713] Key type .llcrypt registered [10297.017469] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [10297.909032] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [10298.029760] alg: No test for adler32 (adler32-zlib) [10299.095675] Lustre: Lustre: Build Version: 2.17.57_45_g07d9be3 [10299.289139] LNet: Added LNI 192.168.206.108@tcp [8/256/0/180] [10300.959180] Key type lgssc registered [10301.971702] Lustre: Echo OBD driver; http://www.lustre.org/ [10309.193980] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [10309.211888] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10310.571435] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10314.555948] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [10320.865421] LustreError: 327987:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10320.882133] LustreError: 327987:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [10322.224470] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [10325.988268] LustreError: 327986:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10330.435661] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10330.749415] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [10335.375235] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [10344.325025] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10344.598686] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [10350.512648] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [10355.874459] LustreError: 329667:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10355.893231] LustreError: 329667:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [10355.896152] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:65) [10358.366589] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [10361.326757] LustreError: 330288:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10361.341701] LustreError: 330288:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [10364.863050] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10365.088992] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [10370.571125] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:33) [10371.794631] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [10379.585792] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [10386.762840] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing wait_import_state (FULL|IDLE) os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [10387.021610] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [10493.416178] LustreError: lustre-OST0001-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [10493.418280] Lustre: lustre-OST0001-osc-MDT0001: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10493.427312] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [10493.450506] LustreError: Skipped 1 previous similar message [10493.471850] Lustre: Skipped 1 previous similar message [10498.555517] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [10498.561360] Lustre: Skipped 2 previous similar messages [10503.660637] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [10503.672994] Lustre: Skipped 1 previous similar message [10504.159149] Lustre: lustre-OST0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [10504.331704] Lustre: server umount lustre-OST0001 complete [10508.774793] LustreError: 329666:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10508.794914] LustreError: 329666:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [10513.898777] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10513.916438] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [10513.923823] Lustre: Skipped 1 previous similar message [10516.320186] Lustre: server umount lustre-OST0000 complete [10520.040656] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [10520.047790] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10520.061733] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10520.073670] Lustre: Skipped 1 previous similar message [10524.153397] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10529.250109] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10529.267146] Lustre: Skipped 3 previous similar messages [10534.373686] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [10534.606522] Lustre: server umount lustre-MDT0000 complete [10538.591812] LustreError: 327968:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788320157 with bad export cookie 3844541016923564378 [10538.594605] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [10538.599227] LustreError: 327968:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [10539.180468] Lustre: server umount lustre-MDT0001 complete [10551.241905] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing unload_modules_local [10554.740662] Key type lgssc unregistered [10555.154319] LNet: 332934:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [10555.174602] LNetError: 332934:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [10556.205316] LNet: Removed LNI 192.168.206.108@tcp [10557.215218] Key type .llcrypt unregistered [10557.221230] Key type ._llcrypt unregistered [10601.318972] Key type ._llcrypt registered [10601.322609] Key type .llcrypt registered [10601.437938] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [10602.334014] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [10602.565620] alg: No test for adler32 (adler32-zlib) [10603.576179] Lustre: Lustre: Build Version: 2.17.57_45_g07d9be3 [10603.804398] LNet: Added LNI 192.168.206.108@tcp [8/256/0/180] [10605.482673] Key type lgssc registered [10606.588468] Lustre: Echo OBD driver; http://www.lustre.org/ [10616.371389] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [10616.406457] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10617.919227] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10621.659888] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [10627.052102] LustreError: 335244:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10627.073289] LustreError: 335244:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [10629.388352] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10629.658752] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [10634.586570] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [10637.210612] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [10644.714868] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10645.337881] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [10652.425431] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [10654.567474] LustreError: 336733:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10659.820187] LustreError: 336735:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10661.113896] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10661.450419] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [10662.521202] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:97) [10662.533200] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:65) [10667.729686] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [10677.640980] Lustre: DEBUG MARKER: Using TIMEOUT=20 [10689.115767] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [10701.282531] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [10701.287537] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10701.295893] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10703.848348] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10703.850037] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10703.861503] Lustre: Skipped 2 previous similar messages [10703.870267] Lustre: Skipped 2 previous similar messages [10705.852932] Lustre: server umount lustre-MDT0000 complete [10708.963229] LustreError: 335238:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10708.978386] LustreError: 335238:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [10709.059410] LustreError: 335224:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788320328 with bad export cookie 4365888156190048672 [10709.060276] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [10709.070467] LustreError: 335224:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [10709.318539] Lustre: server umount lustre-MDT0001 complete [10722.457208] Lustre: server umount lustre-OST0000 complete [10736.600336] Lustre: server umount lustre-OST0001 complete [10753.830306] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [10762.634520] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10762.998501] LustreError: 340511:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10763.089764] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10767.029139] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [10773.476663] LustreError: 340511:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10773.500288] LustreError: 340511:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [10775.581034] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10776.154360] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [10780.612942] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [10783.640901] Lustre: 341654:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [10790.686952] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10798.539340] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [10801.340755] LustreError: 342008:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10807.693771] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10808.098703] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [10808.108154] Lustre: Skipped 1 previous similar message [10809.157266] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:97) [10809.171151] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:129) [10815.052928] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [10822.882509] Lustre: DEBUG MARKER: Using TIMEOUT=20 [10826.467267] Lustre: 343524:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [10832.354305] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [10832.371595] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10832.389187] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10834.915176] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10834.915276] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10834.940592] Lustre: Skipped 2 previous similar messages [10837.242621] Lustre: server umount lustre-MDT0000 complete [10840.036103] LustreError: 340511:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10840.060943] LustreError: 340511:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 4 previous similar messages [10840.703173] LustreError: 340493:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788320459 with bad export cookie 4365888156190050373 [10840.708659] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [10840.717791] LustreError: 340493:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [10841.035223] Lustre: server umount lustre-MDT0001 complete [10854.477780] Lustre: server umount lustre-OST0000 complete [10867.298337] Lustre: server umount lustre-OST0001 complete [10870.503206] Lustre: DEBUG MARKER: SKIP: conf-sanity test_114 skipping SLOW test 114 [10871.892932] Lustre: DEBUG MARKER: SKIP: conf-sanity test_115 skipping excluded test 115 [10873.707759] Lustre: DEBUG MARKER: == conf-sanity test 116: big size MDT support ============ 23:41:31 (1788320491) [10893.945799] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [10904.830045] loop0: detected capacity change from 0 to 1099511627776 [10905.495787] SGI XFS with ACLs, security attributes, quota, no debug enabled [10905.501522] *** VALIDATE xfs *** [10905.510933] XFS (loop0): Mounting V5 Filesystem [10905.531411] XFS (loop0): Ending clean mount [10907.182829] loop1: detected capacity change from 0 to 18691697672192 [10995.582985] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_hostid [11004.303886] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [11042.112183] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11042.400170] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [11042.453341] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [11042.509685] Lustre: lustre-MDT0000: new disk, initializing [11042.618471] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [11042.640865] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [11046.778218] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [11058.176282] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11058.329862] Lustre: 348653:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [11058.457743] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [11058.471671] Lustre: Skipped 1 previous similar message [11058.592400] Lustre: lustre-MDT0001: new disk, initializing [11058.787216] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [11058.801420] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [11063.352697] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [11073.764865] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [11080.234430] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [11088.231626] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11088.680323] Lustre: lustre-OST0000: new disk, initializing [11088.695504] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [11088.708541] Lustre: 350625:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [11090.622390] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [11090.641347] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [11090.804452] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [11096.099424] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [11105.261631] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [11109.880724] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [11110.146820] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [11115.113451] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [11115.349581] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [11121.648614] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [11121.650155] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11121.657199] LustreError: Skipped 1 previous similar message [11121.658563] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [11121.671752] Lustre: Skipped 1 previous similar message [11121.694078] Lustre: Skipped 4 previous similar messages [11123.751294] Lustre: server umount lustre-OST0000 complete [11130.348817] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [11130.351408] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11130.367051] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [11141.089179] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [11141.292730] Lustre: server umount lustre-MDT0000 complete [11145.024534] LustreError: 348646:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788320764 with bad export cookie 4365888156190051927 [11145.035614] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [11145.040317] LustreError: 348646:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [11145.312417] Lustre: server umount lustre-MDT0001 complete [11153.135138] XFS (loop0): Unmounting Filesystem [11157.997394] Lustre: DEBUG MARKER: == conf-sanity test 117: lctl get_param return errors properly ========================================================== 23:46:15 (1788320775) [11165.942737] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11166.471553] LustreError: 353182:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11166.666210] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [11166.668728] Lustre: Skipped 2 previous similar messages [11171.734291] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [11180.313426] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11185.024923] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [11191.821629] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [11197.808930] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [11204.968970] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11212.216782] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [11220.401478] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [11232.245538] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [11232.246015] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11232.267804] LustreError: Skipped 1 previous similar message [11232.269486] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [11232.269494] Lustre: Skipped 6 previous similar messages [11232.318402] Lustre: Skipped 2 previous similar messages [11235.559548] Lustre: server umount lustre-OST0000 complete [11242.467699] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [11254.239326] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [11254.408936] Lustre: server umount lustre-MDT0000 complete [11259.020447] LustreError: 353163:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788320878 with bad export cookie 4365888156190052809 [11259.031217] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [11259.037502] LustreError: 353163:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [11259.434496] Lustre: server umount lustre-MDT0001 complete [11271.024721] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing unload_modules_local [11273.729982] Key type lgssc unregistered [11273.997669] LNet: 356817:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [11274.003616] LNetError: 356817:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [11274.023187] LNet: Removed LNI 192.168.206.108@tcp [11274.894066] Key type .llcrypt unregistered [11274.896432] Key type ._llcrypt unregistered [11302.932432] Key type ._llcrypt registered [11302.935919] Key type .llcrypt registered [11303.059912] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [11304.322361] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [11304.363592] alg: No test for adler32 (adler32-zlib) [11305.526296] Lustre: Lustre: Build Version: 2.17.57_45_g07d9be3 [11305.939703] LNet: Added LNI 192.168.206.108@tcp [8/256/0/180] [11307.647147] Key type lgssc registered [11308.826932] Lustre: Echo OBD driver; http://www.lustre.org/ [11316.891676] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [11316.930555] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11318.290857] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [11323.113125] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [11328.483492] LustreError: 358387:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11328.516315] LustreError: 358387:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [11331.400319] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11331.697960] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [11335.853172] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [11343.855606] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [11349.028915] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [11355.832724] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11356.233531] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [11362.393836] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [11370.557970] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [11378.146954] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [11378.158894] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11378.175912] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [11379.172913] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [11379.173179] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11382.302640] Lustre: lustre-MDT0001: Not available for connect from 192.168.206.8@tcp (stopping) [11382.308257] Lustre: Skipped 1 previous similar message [11383.454266] Lustre: server umount lustre-MDT0001 complete [11384.297851] LustreError: 358387:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11384.323263] LustreError: 358387:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [11387.407855] LustreError: 358382:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.206.8@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [11389.419602] LustreError: 358381:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11389.446512] LustreError: 358381:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [11394.354951] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11394.461688] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [11394.465198] Lustre: Found index 1 for lustre-MDT0001, updating log [11394.487559] Lustre: 358374:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [11394.528867] LustreError: 358387:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11394.546836] LustreError: 358387:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [11394.839737] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [11399.517532] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [11400.174642] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [11402.742834] LustreError: 361986:0:(obd_mount.c:234:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [11402.755718] LustreError: 361986:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [11402.775613] LustreError: 358378:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [11402.845865] LustreError: 361989:0:(obd_config.c:2102:class_config_llog_handler()) MGC192.168.206.108@tcp: cfg command failed: rc = -17 [11402.858995] Lustre: cmd=cf001 0:lustre-MDT0001-osp-MDT0000 1:osp 2:lustre-MDT0000-mdtlov_UUID [11402.858995] [11707.365259] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11707.368509] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [11707.385930] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [11707.397520] Lustre: Skipped 1 previous similar message [11711.478422] Lustre: server umount lustre-MDT0001 complete [11712.479980] LustreError: 358386:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11712.494625] LustreError: 358386:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [11721.103428] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11721.261735] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [11721.271428] Lustre: Found index 1 for lustre-MDT0001, updating log [11721.341632] Lustre: 358373:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [11721.618365] Lustre: lustre-MDT0001: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [11725.396549] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [11726.827308] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [11729.910308] LustreError: 370973:0:(obd_mount.c:234:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [11729.917682] LustreError: 370973:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [11729.926381] LustreError: 358378:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [11729.933727] LustreError: 358378:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [11729.993223] LustreError: 370976:0:(obd_config.c:761:class_setup()) osp: device 8 already setup: rc = -17 [11729.998175] LustreError: 370976:0:(obd_config.c:866:class_detach()) OBD device 8 still set up [11730.006896] LustreError: 370976:0:(obd_config.c:2102:class_config_llog_handler()) MGC192.168.206.108@tcp: cfg command failed: rc = -17 [11730.017832] Lustre: cmd=cf003 0:lustre-MDT0001-osp-MDT0000 1:lustre-MDT0001_UUID 2:192.168.206.108@tcp [11730.017832] [12032.544571] Lustre: lustre-MDT0001: Not available for connect from 192.168.206.8@tcp (stopping) [12032.554119] Lustre: Skipped 1 previous similar message [12034.021951] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [12034.047408] Lustre: Skipped 1 previous similar message [12034.055297] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [12036.388773] Lustre: server umount lustre-MDT0001 complete [12037.647957] LustreError: 358382:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.206.8@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [12037.666617] LustreError: 358382:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 4 previous similar messages [12046.221548] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12046.313811] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [12046.320445] Lustre: Found index 1 for lustre-MDT0001, updating log [12046.371782] Lustre: 358374:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [12046.686138] Lustre: lustre-MDT0001: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [12050.945470] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [12051.970789] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [12056.571932] LustreError: 379962:0:(obd_mount.c:234:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [12056.586918] LustreError: 379962:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [12056.594599] LustreError: 358378:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [12056.598994] LustreError: 358378:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [12056.675667] LustreError: 379965:0:(lod_lov.c:208:lod_add_device()) lustre-MDT0001-osp-MDT0000: cannot connect to next dev lustre-MDT0001_UUID (-114) [12056.708152] LustreError: 379965:0:(obd_config.c:2102:class_config_llog_handler()) MGC192.168.206.108@tcp: cfg command failed: rc = -114 [12056.726138] Lustre: cmd=cf014 0:lustre-MDT0000-mdtlov 1:lustre-MDT0001_UUID 2:1 3:1 [12056.726138] [12374.498385] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [12374.499889] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [12374.502308] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [12374.502318] Lustre: Skipped 2 previous similar messages [12374.509963] Lustre: Skipped 2 previous similar messages [12386.273688] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [12386.451158] Lustre: server umount lustre-MDT0000 complete [12389.859265] LustreError: 377115:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [12389.875504] LustreError: 377115:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 7 previous similar messages [12390.107816] LustreError: 358366:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788322009 with bad export cookie 18129278496418611866 [12390.109868] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [12390.119106] LustreError: 358366:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [12394.981624] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [12395.003635] Lustre: Skipped 1 previous similar message [12395.011037] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [12395.014965] Lustre: Skipped 8 previous similar messages [12396.512851] Lustre: server umount lustre-MDT0001 complete [12400.314245] Lustre: server umount lustre-OST0000 complete [12408.930402] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_hostid [12417.889430] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [12450.747650] Lustre: DEBUG MARKER: == conf-sanity test 120: cross-target rename should not create bad symlinks ========================================================== 00:07:48 (1788322068) [12457.026941] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12457.263834] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [12457.292045] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [12457.362439] Lustre: lustre-MDT0000: new disk, initializing [12457.459852] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [12457.475863] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [12461.970365] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [12472.520162] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12472.599882] Lustre: 391083:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [12472.691887] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [12472.695757] Lustre: Skipped 1 previous similar message [12472.809307] Lustre: lustre-MDT0001: new disk, initializing [12472.919693] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [12472.985536] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [12472.999206] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [12478.458756] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [12488.341942] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [12494.459382] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [12502.150558] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [12502.543625] Lustre: lustre-OST0000: new disk, initializing [12502.553885] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [12502.563336] Lustre: 393049:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [12502.677530] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [12509.265124] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [12509.270306] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [12509.387229] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [12509.949224] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_default_debug -1 all [12519.891510] Lustre: DEBUG MARKER: oleg608-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [12529.122664] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [12529.136371] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [12529.167253] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [12529.178735] Lustre: Skipped 1 previous similar message [12532.970524] Lustre: server umount lustre-MDT0000 complete [12535.264981] LustreError: 391093:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [12535.274969] LustreError: 391093:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [12536.705133] LustreError: 391075:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788322155 with bad export cookie 18129278496418613819 [12536.709390] LustreError: MGC192.168.206.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [12536.713707] LustreError: 391075:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [12536.999676] Lustre: server umount lustre-MDT0001 complete [12550.595383] Lustre: server umount lustre-OST0000 complete [12585.794927] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing set_hostid [12597.297773] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing load_modules_local [12633.559734] Lustre: DEBUG MARKER: == conf-sanity test complete, duration 12358 sec ========= 00:10:50 (1788322250) [12635.629227] Lustre: DEBUG MARKER: === conf-sanity: start cleanup 00:10:52 (1788322252) === [12640.424959] Lustre: DEBUG MARKER: === conf-sanity: finish cleanup 00:10:57 (1788322257) === [12683.770395] Lustre: DEBUG MARKER: oleg608-server.virtnet: executing unload_modules_local [12687.727955] Key type lgssc unregistered [12688.304118] LNet: 399424:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [12688.312783] LNetError: 399424:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [12688.366350] LNet: Removed LNI 192.168.206.108@tcp [12689.920446] Key type .llcrypt unregistered [12689.922270] Key type ._llcrypt unregistered