[ 0.000000] Linux version 4.18.0rh8.10-debug (green@maintenance) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-26) (GCC)) #2 SMP Mon Jul 14 01:24:22 EDT 2025 [ 0.000000] Command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffcdfff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffce000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x0000000146dfffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.8 present. [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 [ 0.000000] Hypervisor detected: KVM [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 832518730 cycles [ 0.000000] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns [ 0.000000] tsc: Detected 2400.000 MHz processor [ 0.000000] last_pfn = 0x146e00 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0xbffce max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000f54b0-0x000f54bf] [ 0.000000] RAMDISK: [mem 0xbcc54000-0xbffbffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F52D0 000014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 0x00000000BFFE247C 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 0x00000000BFFE2318 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 0x00000000BFFE0040 0022D8 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 0x00000000BFFE0000 000040 [ 0.000000] ACPI: APIC 0x00000000BFFE238C 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: HPET 0x00000000BFFE241C 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: WAET 0x00000000BFFE2454 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0xbffe2318-0xbffe238b] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe2317] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0xbffe238c-0xbffe241b] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0xbffe241c-0xbffe2453] [ 0.000000] ACPI: Reserving WAET table memory at [mem 0xbffe2454-0xbffe247b] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x0000000146dfffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x1465a3000-0x1465cdfff] [ 0.000000] Reserving 256MB of memory at 2752MB for crashkernel (System RAM: 4205MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009efff] [ 0.000000] node 0: [mem 0x0000000000100000-0x00000000bffcdfff] [ 0.000000] node 0: [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Zeroed struct page in unavailable ranges: 4756 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x0000000146dfffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] TSC deadline timer available [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] kvm-guest: KVM setup pv remote TLB flush [ 0.000000] kvm-guest: setup PV sched yield [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbffce000-0xbfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.000000] [mem 0xc0000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u524288 [ 0.000000] kvm-guest: PV spinlocks enabled [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1059606 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] audit: disabled (until reboot) [ 0.000000] software IO TLB: area num 4. [ 0.000000] Memory: 2829652K/4306352K available (18435K kernel code, 11221K rwdata, 7248K rodata, 2908K init, 18040K bss, 524580K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] ftrace: allocating 41240 entries in 162 pages [ 0.000000] ftrace: allocated 162 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU event tracing is enabled. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=4. [ 0.000000] rcu: RCU callback double-/use-after-free debug enabled. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 [ 0.000000] NR_IRQS: 524544, nr_irqs: 456, preallocated irqs: 16 [ 0.000000] random: get_random_bytes called from start_kernel+0x622/0x9a8 with crng_init=0 [ 0.001000] Console: colour *CGA 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns [ 0.001014] APIC: Switch to symmetric I/O mode setup [ 0.002318] x2apic enabled [ 0.003008] Switched APIC routing to physical x2apic. [ 0.004015] kvm-guest: setup PV IPIs [ 0.007829] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.008000] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x22983777dd9, max_idle_ns: 440795300422 ns [ 0.008025] Calibrating delay loop (skipped) preset value.. 4800.00 BogoMIPS (lpj=2400000) [ 0.009013] pid_max: default: 32768 minimum: 301 [ 0.010134] LSM: Security Framework initializing [ 0.011059] Yama: becoming mindful. [ 0.012043] SELinux: Initializing. [ 0.014077] *** VALIDATE selinux *** [ 0.023371] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, vmalloc) [ 0.029073] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc) [ 0.030169] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.031128] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.032125] *** VALIDATE tmpfs *** [ 0.034161] *** VALIDATE proc *** [ 0.035269] *** VALIDATE cgroup *** [ 0.036013] *** VALIDATE cgroup2 *** [ 0.037297] x86/cpu: User Mode Instruction Prevention (UMIP) activated [ 0.038176] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.039012] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 [ 0.040031] Spectre V2 : User space: Vulnerable [ 0.041011] Speculative Store Bypass: Vulnerable [ 0.044336] debug: unmapping init [mem 0xffffffffa4059000-0xffffffffa4060fff] [ 0.047212] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (family: 0x6, model: 0x3e, stepping: 0x4) [ 0.048812] Performance Events: IvyBridge events, full-width counters, Intel PMU driver. [ 0.049023] ... version: 2 [ 0.050014] ... bit width: 48 [ 0.051010] ... generic registers: 4 [ 0.052015] ... value mask: 0000ffffffffffff [ 0.053016] ... max period: 00007fffffffffff [ 0.054016] ... fixed-purpose events: 3 [ 0.055013] ... event mask: 000000070000000f [ 0.056407] rcu: Hierarchical SRCU implementation. [ 0.058665] smp: Bringing up secondary CPUs ... [ 0.059731] x86: Booting SMP configuration: [ 0.060035] .... node #0, CPUs: #1 #2 #3 [ 0.073266] smp: Brought up 1 node, 4 CPUs [ 0.075016] smpboot: Max logical packages: 1 [ 0.076017] smpboot: Total of 4 processors activated (19200.00 BogoMIPS) [ 0.121774] node 0 deferred pages initialised in 43ms [ 0.126161] devtmpfs: initialized [ 0.127237] x86/mm: Memory block size: 128MB [ 0.131252] gcov: version magic: 0x41383552 [ 0.133484] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.134123] futex hash table entries: 1024 (order: 4, 65536 bytes, vmalloc) [ 0.135268] pinctrl core: initialized pinctrl subsystem [ 0.136249] [ 0.137012] ************************************************************* [ 0.138019] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.139018] ** ** [ 0.140152] ** IOMMU DebugFS SUPPORT HAS BEEN ENABLED IN THIS KERNEL ** [ 0.141017] ** ** [ 0.142019] ** This means that this kernel is built to expose internal ** [ 0.143019] ** IOMMU data structures, which may compromise security on ** [ 0.144022] ** your system. ** [ 0.145017] ** ** [ 0.146015] ** If you see this message and you are not debugging the ** [ 0.147083] ** kernel, report this immediately to your vendor! ** [ 0.148016] ** ** [ 0.149017] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.150020] ************************************************************* [ 0.153098] NET: Registered protocol family 16 [ 0.155026] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations [ 0.156086] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.161074] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.168184] cpuidle: using governor menu [ 0.171284] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.181081] PCI: Using configuration type 1 for base access [ 0.184830] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.201096] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.204031] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.213670] cryptd: max_cpu_qlen set to 1000 [ 0.214408] ACPI: Added _OSI(Module Device) [ 0.218018] ACPI: Added _OSI(Processor Device) [ 0.220016] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.223016] ACPI: Added _OSI(Processor Aggregator Device) [ 0.233363] ACPI: 1 ACPI AML tables successfully acquired and loaded [ 0.245458] ACPI: Interpreter enabled [ 0.246092] ACPI: PM: (supports S0 S3 S4 S5) [ 0.247023] ACPI: Using IOAPIC for interrupt routing [ 0.248111] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.250176] ACPI: Enabled 2 GPEs in block 00 to 0F [ 0.282844] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.283055] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3] [ 0.284937] acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI] [ 0.285092] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.289411] acpiphp: Slot [2] registered [ 0.290540] acpiphp: Slot [5] registered [ 0.291231] acpiphp: Slot [6] registered [ 0.293293] acpiphp: Slot [7] registered [ 0.294289] acpiphp: Slot [8] registered [ 0.296091] acpiphp: Slot [9] registered [ 0.297150] acpiphp: Slot [10] registered [ 0.298282] acpiphp: Slot [3] registered [ 0.299133] acpiphp: Slot [4] registered [ 0.300147] acpiphp: Slot [11] registered [ 0.301113] acpiphp: Slot [12] registered [ 0.302139] acpiphp: Slot [13] registered [ 0.303148] acpiphp: Slot [14] registered [ 0.304166] acpiphp: Slot [15] registered [ 0.305136] acpiphp: Slot [16] registered [ 0.306123] acpiphp: Slot [17] registered [ 0.307077] acpiphp: Slot [18] registered [ 0.308136] acpiphp: Slot [19] registered [ 0.310121] acpiphp: Slot [20] registered [ 0.315147] acpiphp: Slot [21] registered [ 0.317547] acpiphp: Slot [22] registered [ 0.320139] acpiphp: Slot [23] registered [ 0.323173] acpiphp: Slot [24] registered [ 0.325333] acpiphp: Slot [25] registered [ 0.327157] acpiphp: Slot [26] registered [ 0.329135] acpiphp: Slot [27] registered [ 0.332248] acpiphp: Slot [28] registered [ 0.334192] acpiphp: Slot [29] registered [ 0.337122] acpiphp: Slot [30] registered [ 0.339128] acpiphp: Slot [31] registered [ 0.341291] PCI host bridge to bus 0000:00 [ 0.343024] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.350026] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.354059] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.361037] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 0.366126] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] [ 0.370027] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.372385] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.376504] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.381942] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 0.397018] pci 0000:00:01.1: reg 0x20: [io 0xc320-0xc32f] [ 0.406069] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.411021] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.413021] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.417021] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.421841] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 0.426314] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 0.430542] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 0.437527] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 [ 0.448018] pci 0000:00:02.0: reg 0x10: [io 0xc300-0xc31f] [ 0.475018] pci 0000:00:02.0: reg 0x20: [mem 0xe0000000000-0xe0000003fff 64bit pref] [ 0.485016] pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 0.495050] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 [ 0.508017] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] [ 0.544016] pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] [ 0.598018] pci 0000:00:05.0: reg 0x20: [mem 0xe0000004000-0xe0000007fff 64bit pref] [ 0.624798] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 [ 0.638018] pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] [ 0.648017] pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 0.676019] pci 0000:00:06.0: reg 0x20: [mem 0xe0000008000-0xe000000bfff 64bit pref] [ 0.699294] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 [ 0.711017] pci 0000:00:07.0: reg 0x10: [io 0xc100-0xc17f] [ 0.726016] pci 0000:00:07.0: reg 0x14: [mem 0xfebc2000-0xfebc2fff] [ 0.768017] pci 0000:00:07.0: reg 0x20: [mem 0xe000000c000-0xe000000ffff 64bit pref] [ 0.793391] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 [ 0.809029] pci 0000:00:08.0: reg 0x10: [io 0xc180-0xc1ff] [ 0.821018] pci 0000:00:08.0: reg 0x14: [mem 0xfebc3000-0xfebc3fff] [ 0.846021] pci 0000:00:08.0: reg 0x20: [mem 0xe0000010000-0xe0000013fff 64bit pref] [ 0.863015] pci 0000:00:09.0: [1af4:1001] type 00 class 0x010000 [ 0.880017] pci 0000:00:09.0: reg 0x10: [io 0xc200-0xc27f] [ 0.895018] pci 0000:00:09.0: reg 0x14: [mem 0xfebc4000-0xfebc4fff] [ 0.921021] pci 0000:00:09.0: reg 0x20: [mem 0xe0000014000-0xe0000017fff 64bit pref] [ 0.941886] pci 0000:00:0a.0: [1af4:1001] type 00 class 0x010000 [ 0.950015] pci 0000:00:0a.0: reg 0x10: [io 0xc280-0xc2ff] [ 0.961016] pci 0000:00:0a.0: reg 0x14: [mem 0xfebc5000-0xfebc5fff] [ 0.984029] pci 0000:00:0a.0: reg 0x20: [mem 0xe0000018000-0xe000001bfff 64bit pref] [ 1.009000] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 [ 1.011583] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.012000] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 [ 1.015812] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.020336] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 [ 1.025218] iommu: Default domain type: Passthrough [ 1.029514] SCSI subsystem initialized [ 1.032198] ACPI: bus type USB registered [ 1.035151] usbcore: registered new interface driver usbfs [ 1.037116] usbcore: registered new interface driver hub [ 1.040115] usbcore: registered new device driver usb [ 1.043450] pps_core: LinuxPPS API ver. 1 registered [ 1.046014] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 1.052063] PTP clock support registered [ 1.055327] EDAC MC: Ver: 3.0.0 [ 1.060184] PCI: Using ACPI for IRQ routing [ 1.063266] NetLabel: Initializing [ 1.067016] NetLabel: domain hash size = 128 [ 1.068016] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 1.071108] NetLabel: unlabeled traffic allowed by default [ 1.077076] vgaarb: loaded [ 1.079460] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 1.084020] hpet0: 3 comparators, 64-bit 100.000000 MHz counter [ 1.095648] clocksource: Switched to clocksource kvm-clock [ 1.368281] VFS: Disk quotas dquot_6.6.0 [ 1.378931] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 1.397883] *** VALIDATE ramfs *** [ 1.404607] *** VALIDATE hugetlbfs *** [ 1.411115] pnp: PnP ACPI init [ 1.420585] pnp: PnP ACPI: found 6 devices [ 1.476812] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 1.487622] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 1.495194] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 1.500466] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 1.507270] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 1.513760] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] [ 1.522304] NET: Registered protocol family 2 [ 1.526877] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, vmalloc) [ 1.537624] tcp_listen_portaddr_hash hash table entries: 4096 (order: 5, 163840 bytes, vmalloc) [ 1.546923] TCP established hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 1.561539] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc) [ 1.570903] TCP: Hash tables configured (established 65536 bind 65536) [ 1.576769] MPTCP token hash table entries: 8192 (order: 6, 393216 bytes, vmalloc) [ 1.581897] UDP hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 1.586223] UDP-Lite hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 1.591193] NET: Registered protocol family 1 [ 1.595303] RPC: Registered named UNIX socket transport module. [ 1.598800] RPC: Registered udp transport module. [ 1.601212] RPC: Registered tcp transport module. [ 1.603636] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 1.607418] NET: Registered protocol family 44 [ 1.610027] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 1.613454] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 1.616965] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 1.621582] PCI: CLS 0 bytes, default 64 [ 1.624943] Unpacking initramfs... [ 4.262906] debug: unmapping init [mem 0xffff966f3cc54000-0xffff966f3ffbffff] [ 4.271487] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 4.278187] software IO TLB: mapped [mem 0x00000000a8000000-0x00000000ac000000] (64MB) [ 4.286399] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x22983777dd9, max_idle_ns: 440795300422 ns [ 5.642898] Initialise system trusted keyrings [ 5.645258] Key type blacklist registered [ 5.647537] workingset: timestamp_bits=36 max_order=20 bucket_order=0 [ 5.659743] zbud: loaded [ 5.663824] *** VALIDATE nfs *** [ 5.665373] *** VALIDATE nfs4 *** [ 5.667489] pstore: using deflate compression [ 5.672777] Platform Keyring initialized [ 5.840813] NET: Registered protocol family 38 [ 5.843579] Key type asymmetric registered [ 5.847858] Asymmetric key parser 'x509' registered [ 5.852964] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 5.858354] io scheduler mq-deadline registered [ 5.862837] io scheduler kyber registered [ 5.866471] io scheduler bfq registered [ 5.870364] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 5.875739] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 5.883586] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 5.888862] ACPI: Power Button [PWRF] [ 5.899817] ACPI: \_SB_.LNKB: Enabled at IRQ 10 [ 5.911994] ACPI: \_SB_.LNKA: Enabled at IRQ 11 [ 5.946449] ACPI: \_SB_.LNKC: Enabled at IRQ 11 [ 5.966422] ACPI: \_SB_.LNKD: Enabled at IRQ 10 [ 6.010155] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 6.058770] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 6.101873] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 6.109623] Non-volatile memory driver v1.3 [ 6.111662] Linux agpgart interface v0.103 [ 6.175134] virtio_blk virtio1: [vda] 145928 512-byte logical blocks (74.7 MB/71.3 MiB) [ 6.180104] vda: detected capacity change from 0 to 74715136 [ 6.217653] virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) [ 6.224993] vdb: detected capacity change from 0 to 1073741824 [ 6.281060] virtio_blk virtio3: [vdc] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 6.292519] vdc: detected capacity change from 0 to 2621440000 [ 6.333452] virtio_blk virtio4: [vdd] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 6.339358] vdd: detected capacity change from 0 to 2621440000 [ 6.366784] virtio_blk virtio5: [vde] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 6.372365] vde: detected capacity change from 0 to 4294967296 [ 6.402753] virtio_blk virtio6: [vdf] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 6.410140] vdf: detected capacity change from 0 to 4294967296 [ 6.421947] libphy: Fixed MDIO Bus: probed [ 6.433572] usbcore: registered new interface driver usbserial_generic [ 6.442777] usbserial: USB Serial support registered for generic [ 6.448389] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 6.457162] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 6.460781] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 6.466335] mousedev: PS/2 mouse device common for all mice [ 6.474676] rtc_cmos 00:05: RTC can wake from S4 [ 6.480764] rtc_cmos 00:05: registered as rtc0 [ 6.484590] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 6.489509] intel_pstate: CPU model not supported [ 6.495167] hid: raw HID events driver (C) Jiri Kosina [ 6.496231] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 6.503729] usbcore: registered new interface driver usbhid [ 6.512408] usbhid: USB HID core driver [ 6.516137] drop_monitor: Initializing network drop monitor service [ 6.519905] Initializing XFRM netlink socket [ 6.521913] NET: Registered protocol family 10 [ 6.528921] Segment Routing with IPv6 [ 6.531478] NET: Registered protocol family 17 [ 6.536897] mpls_gso: MPLS GSO support [ 6.539411] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 [ 6.558714] RAS: Correctable Errors collector initialized. [ 6.564583] AVX version of gcm_enc/dec engaged. [ 6.566368] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 [ 6.569644] AES CTR mode by8 optimization enabled [ 6.690494] sched_clock: Marking stable (6690403099, 0)->(8534230772, -1843827673) [ 6.694751] registered taskstats version 1 [ 6.699746] Loading compiled-in X.509 certificates [ 6.702621] zswap: loaded using pool lzo/zbud [ 6.740849] Key type big_key registered [ 6.757650] Key type encrypted registered [ 6.759839] ima: No TPM chip found, activating TPM-bypass! [ 6.762845] ima: Allocated hash algorithm: sha1 [ 6.765192] ima: No architecture policies found [ 6.767447] evm: Initialising EVM extended attributes: [ 6.769773] evm: security.selinux [ 6.771508] evm: security.ima [ 6.773140] evm: security.capability [ 6.774837] evm: HMAC attrs: 0x1 [ 6.777978] rtc_cmos 00:05: setting system clock to 2026-08-07 11:31:38 UTC (1786102298) [ 6.786383] debug: unmapping init [mem 0xffffffffa5003000-0xffffffffa51fffff] [ 6.791946] debug: unmapping init [mem 0xffffffffa3d82000-0xffffffffa4058fff] [ 6.802298] Write protecting the kernel read-only data: 28672k [ 6.808074] debug: unmapping init [mem 0xffffffffa2403000-0xffffffffa25fffff] [ 6.813610] debug: unmapping init [mem 0xffffffffa2d14000-0xffffffffa2dfffff] [ 6.869503] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 6.879958] systemd[1]: Detected virtualization kvm. [ 6.881873] systemd[1]: Detected architecture x86-64. [ 6.883837] systemd[1]: Running in initial RAM disk. Welcome to Rocky Linux 8.10 (Green Obsidian) dracut-049-233.git20240115.el8 (Initramfs)! [ 6.920867] systemd[1]: No hostname configured. [ 6.924765] systemd[1]: Set hostname to . [ 6.931626] random: systemd: uninitialized urandom read (16 bytes read) [ 6.935502] systemd[1]: Initializing machine ID from random generator. [ 7.112578] random: ln: uninitialized urandom read (6 bytes read) [ 7.314075] hrtimer: interrupt took 4067923 ns [ 7.432694] random: systemd: uninitialized urandom read (16 bytes read) [ 7.441717] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ 7.467649] systemd[1]: Reached target Swap. [ OK ] Reached target Swap. [ 7.480800] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. Starting Setup Virtual Console... [ OK ] Reached target Local File Systems. [ OK ] Reached target Timers. [ OK ] Started Memstrack Anylazing Service. Starting Create Volatile Files and Directories... [ OK ] Listening on Journal Socket (/dev/log). Starting Create list of required st…ce nodes for the current kernel... [ OK ] Reached target Initrd Root Device. Starting Journal Service... [ OK ] Reached target Slices. [ OK ] Reached target Paths. [ OK ] Listening on udev Kernel Socket. Starting Apply Kernel Variables... [ OK ] Reached target Local Encrypted Volumes. [ OK ] Listening on udev Control Socket. [ OK ] Reached target Sockets. [ OK ] Started Setup Virtual Console. [ OK ] Started Create Volatile Files and Directories. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Apply Kernel Variables. Starting Create Static Device Nodes in /dev... Starting dracut cmdline hook... [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started Journal Service. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ 9.825936] device-mapper: uevent: version 1.0.3 [ 9.831829] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting dracut pre-trigger hook... [ OK ] Started dracut pre-trigger hook. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. [ OK ] Reached target System Initialization. [ OK ] Reached target Basic System. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. [ 11.807595] random: fast init done Starting dracut initqueue hook... [ 12.049808] virtio_net virtio0 ens2: renamed from eth0 [ 12.832980] scsi host0: ata_piix [ 13.110288] scsi host1: ata_piix [ 13.112703] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc320 irq 14 [ 13.125529] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc328 irq 15 [ 18.310961] random: crng init done [ 18.318702] random: 7 urandom warning(s) missed due to ratelimiting [ 21.811209] dracut-initqueue[591]: RTNETLINK answers: File exists Starting nbd nbd0... [ OK ] Started nbd nbd0. [ OK ] Started dracut initqueue hook. Mounting /sysroot... [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. [ 24.179690] EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Timers. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped dracut initqueue hook. Stopping Hardware RNG Entropy Gatherer Daemon... [ OK ] Stopped Hardware RNG Entropy Gatherer Daemon. [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped target Basic System. [ OK ] Stopped target Slices. [ OK ] Stopped target Sockets. [ OK ] Stopped target System Initialization. [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped target Swap. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped dracut pre-trigger hook. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped target Local File Systems. Stopping udev Kernel Device Manager... [ OK ] Stopped target Local Encrypted Volumes. [ OK ] Stopped target Paths. [ OK ] Stopped Dispatch Password Requests to Console Directory Watch. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Reached target Switch Root. Starting Switch Root... [ 28.915590] printk: systemd: 26 output lines suppressed due to ratelimiting [ 29.949928] SELinux: Disabled at runtime. [ 30.092937] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 30.124724] systemd[1]: Detected virtualization kvm. [ 30.137662] systemd[1]: Detected architecture x86-64. Welcome to Rocky Linux 8.10 (Green Obsidian)! [ 32.871799] systemd[1]: initrd-switch-root.service: Succeeded. [ 32.882133] systemd[1]: Stopped Switch Root. [ OK ] Stopped Switch Root. [ 32.900973] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. [ 32.915668] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 32.929341] systemd[1]: Stopped Journal Service. [ OK ] Stopped Journal Service. [ 32.963162] systemd[1]: Starting Journal Service... Starting Journal Service... [ 32.989129] systemd[1]: Reached target rpc_pipefs.target. [ OK ] Reached target rpc_pipefs.target. Mounting Kernel Debug File System... [ OK ] Created slice system-serial\x2dgetty.slice. [ OK ] Created slice User and Session Slice. Starting Create list of required st…ce nodes for the current kernel... Mounting POSIX Message Queue File System... [FAILED] Failed to set up automount Arbitrar…rmats File System Automount Point. See 'systemctl status proc-sys-fs-binfmt_misc.automount' for details. Activating swap /dev/disk/by-label/SWAP... [ OK ] Reached target Slices. [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Listening on initctl Compatibility Named Pipe. Starting Apply Kernel Variables... [ OK ] Created slice system-getty.slice. [ 33.461047] Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Reached target Paths. [ OK ] Reached target Local Encrypted Volumes. Mounting Huge Pages File System... [ OK ] Created slice system-sshd\x2dkeygen.slice. [ OK ] Listening on udev Kernel Socket. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. Starting Remount Root and Kernel File Systems... [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd File Systems. [ OK ] Listening on Process Core Dump Socket. [ OK ] Listening on udev Control Socket. Starting udev Coldplug all Devices... [ OK ] Stopped target Initrd Root File System. [ OK ] Started Journal Service. [ OK ] Mounted Kernel Debug File System. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Activated swap /dev/disk/by-label/SWAP. [ OK ] Started Apply Kernel Variables. [ OK ] Mounted Huge Pages File System. [FAILED] Failed to start Remount Root and Kernel File Systems. See 'systemctl status systemd-remount-fs.service' for details. Starting Configure read-only root support... [ OK ] Reached target Swap. Starting Create Static Device Nodes in /dev... Starting Flush Journal to Persistent Storage... [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started udev Coldplug all Devices. [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Reached target Local File Systems (Pre). Mounting /home/green/git/lustre-release... Mounting /mnt... Starting udev Kernel Device Manager... [ OK ] Mounted /mnt. [ 35.276189] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ OK ] Mounted /home/green/git/lustre-release. [ OK ] Started udev Kernel Device Manager. [ 36.975269] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 37.138738] input: PC Speaker as /devices/platform/pcspkr/input/input5 [ 37.681529] RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer [ 37.847492] EDAC sbridge: Ver: 1.1.2 [* ] A start job is running for Configur…-only root support (8s / no limit) [** ] A start job is running for Configur…-only root support (9s / no limit) [*** ] A start job is running for Configur…-only root support (9s / no limit) [ *** ] A start job is running for Configur…only root support (10s / no limit) [ *** ] A start job is running for Configur…only root support (10s / no limit)[ 43.919367] Key type dns_resolver registered [ ***] A start job is running for Configur…only root support (11s / no limit) [ **] A start job is running for Configur…only root support (12s / no limit)[ 44.957670] NFS: Registering the id_resolver key type [ 44.963698] Key type id_resolver registered [ 44.967928] Key type id_legacy registered [ *] A start job is running for Configur…only root support (12s / no limit) [ OK ] Started Configure read-only root support. Starting Load/Save Random Seed... [ OK ] Reached target Local File Systems. Starting Rebuild Dynamic Linker Cache... Starting Mark the need to relabel after reboot... Starting Create Volatile Files and Directories... [ OK ] Started Load/Save Random Seed. [ OK ] Started Mark the need to relabel after reboot. [ OK ] Started Create Volatile Files and Directories. Starting RPC Bind... Starting Update UTMP about System Boot/Shutdown... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Started RPC Bind. [ OK ] Started Rebuild Dynamic Linker Cache. Starting Update is Completed... [ OK ] Started Update is Completed. [ OK ] Reached target System Initialization. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. [ OK ] Reached target sshd-keygen.target. Starting Restore /run/initramfs on shutdown... Starting Login Service... [ OK ] Started D-Bus System Message Bus. Starting Network Manager... [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. [ OK ] Started dnf makecache --timer. [ OK ] Reached target Timers. [ OK ] Started irqbalance daemon. [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting Dynamic System Tuning Daemon... Starting OpenSSH server daemon... Starting GSSAPI Proxy Daemon... Starting Network Manager Wait Online... [ OK ] Started Login Service. Starting Hostname Service... [ OK ] Started OpenSSH server daemon. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Started Permit User Sessions. [ OK ] Started Getty on tty1. [ OK ] Started Serial Getty on ttyS0. [ OK ] Started Command Scheduler. [ OK ] Started Serial Getty on ttyS1. [ OK ] Reached target Login Prompts. [ OK ] Started Hostname Service. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting System Logging Service... Starting Crash recovery kernel arming... Starting Notify NFS peers of a restart... [ OK ] Started Notify NFS peers of a restart. [ OK ] Started System Logging Service. Rocky Linux 8.10 (Green Obsidian) Kernel 4.18.0rh8.10-debug on an x86_64 oleg406-server login: [ 114.696730] libcfs: loading out-of-tree module taints kernel. [ 114.749375] Key type ._llcrypt registered [ 114.751821] Key type .llcrypt registered [ 114.881656] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_hostid [ 140.090714] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local [ 143.283358] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 143.294806] alg: No test for adler32 (adler32-zlib) [ 145.133149] Lustre: Lustre: Build Version: 2.17.56_50_gf5ff674 [ 145.970104] LNet: Added LNI 192.168.204.106@tcp [8/256/0/180] [ 147.832206] Key type lgssc registered [ 150.397082] Lustre: Echo OBD driver; http://www.lustre.org/ [ 173.352844] ZFS: Loaded module v2.3.2-1, ZFS pool version 5000, ZFS filesystem version 5 [ 229.134388] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local [ 246.426385] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 246.500146] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 247.689420] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 247.723200] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 247.791714] Lustre: lustre-MDT0000: new disk, initializing [ 247.854341] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 247.868825] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 253.776661] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 270.113838] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 270.321333] Lustre: 6542:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 270.370549] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 270.378710] Lustre: Skipped 1 previous similar message [ 270.491676] Lustre: lustre-MDT0001: new disk, initializing [ 270.561637] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 270.588097] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 270.618631] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 275.828380] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 281.301716] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 292.874632] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 293.373824] Lustre: lustre-OST0000: new disk, initializing [ 293.381820] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 293.389721] Lustre: 8482:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 293.455309] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 300.771746] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 303.135935] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 303.143590] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 303.213229] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 317.023121] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 317.179578] Lustre: lustre-OST0001: new disk, initializing [ 317.182531] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 317.193245] Lustre: 9555:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 317.266730] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 324.154821] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 325.306440] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 325.329824] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 325.461465] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 338.070865] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 346.461075] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 354.159356] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing check_logdir /tmp/testlogs/ [ 360.992912] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing yml_node [ 367.535270] Lustre: DEBUG MARKER: Client: 2.17.56.50 [ 370.984323] Lustre: DEBUG MARKER: MDS: 2.17.56.50 [ 374.343416] Lustre: DEBUG MARKER: OSS: 2.17.56.50 [ 376.785031] Lustre: DEBUG MARKER: -----============= acceptance-small: conf-sanity ============----- Fri Aug 7 07:37:45 EDT 2026 [ 395.892947] Lustre: DEBUG MARKER: excepting tests: 102 106 115 32newtarball [ 398.114824] Lustre: DEBUG MARKER: skipping tests SLOW=no: 45 69 106 111 114 [ 417.769818] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 417.775736] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 417.783433] Lustre: Skipped 1 previous similar message [ 421.238166] Lustre: server umount lustre-MDT0000 complete [ 425.065978] LustreError: 6533:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786102716 with bad export cookie 18365172507073651833 [ 425.066557] LustreError: MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 425.074303] LustreError: 6533:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 428.001302] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 428.002297] LustreError: 6548:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 428.002673] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 428.002677] Lustre: Skipped 3 previous similar messages [ 428.008875] Lustre: Skipped 3 previous similar messages [ 428.039296] LustreError: 6548:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 6 previous similar messages [ 431.009980] LustreError: 10160:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 431.015319] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 431.039598] LustreError: 10160:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 431.060303] Lustre: Skipped 2 previous similar messages [ 431.526988] Lustre: server umount lustre-MDT0001 complete [ 436.124127] Lustre: server umount lustre-OST0000 complete [ 440.616049] Lustre: server umount lustre-OST0001 complete [ 449.141706] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_hostid [ 462.802660] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local [ 504.875366] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 505.068493] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 505.089683] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 505.141327] Lustre: lustre-MDT0000: new disk, initializing [ 505.205569] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 505.223818] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 511.287557] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 524.290996] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 524.408786] Lustre: 15112:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 524.482392] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 524.487233] Lustre: Skipped 1 previous similar message [ 524.558568] Lustre: lustre-MDT0001: new disk, initializing [ 524.656464] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 524.694624] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 524.708238] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 530.584761] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 541.704269] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 549.034573] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 557.010735] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 557.290633] Lustre: lustre-OST0000: new disk, initializing [ 557.294691] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 557.304684] Lustre: 17079:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 557.397029] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 558.740764] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 558.755429] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 564.217679] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 564.761615] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 576.188937] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 581.719861] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 582.001175] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 587.151976] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 587.599348] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 589.805744] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 589.808333] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 589.814724] LustreError: Skipped 1 previous similar message [ 589.845494] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 589.857683] Lustre: Skipped 1 previous similar message [ 594.921821] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 594.933076] Lustre: Skipped 1 previous similar message [ 595.960555] Lustre: server umount lustre-OST0000 complete [ 601.576065] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 601.582771] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 601.607836] Lustre: Skipped 1 previous similar message [ 605.156294] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 605.170588] Lustre: Skipped 2 previous similar messages [ 606.736497] Lustre: server umount lustre-MDT0000 complete [ 610.281147] LustreError: 15123:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 610.305470] LustreError: 15123:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 610.896950] LustreError: 15103:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786102902 with bad export cookie 18365172507073653359 [ 610.902419] LustreError: MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 610.906069] LustreError: 15103:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 611.163869] Lustre: server umount lustre-MDT0001 complete [ 617.866741] Lustre: DEBUG MARKER: == conf-sanity test 76a: set permanent params with lctl across mounts ========================================================== 07:41:47 (1786102907) [ 625.582686] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 626.052038] LustreError: 19345:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 626.148696] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 631.268688] LustreError: 19346:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 631.614852] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 640.492984] LustreError: 19345:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 640.517064] LustreError: 19345:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 640.944434] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 646.032958] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 654.267361] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 662.107546] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 669.917222] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 677.396396] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 687.151817] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 692.211119] Lustre: Modifying parameter general.osc.*.max_dirty_mb=452 in log params [ 697.827650] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 697.843416] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 697.858540] Lustre: Skipped 1 previous similar message [ 697.867972] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 704.188456] Lustre: server umount lustre-MDT0000 complete [ 706.020679] LustreError: 19346:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 706.057958] LustreError: 19346:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 709.003207] LustreError: 19326:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786103000 with bad export cookie 18365172507073654248 [ 709.021850] LustreError: MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 709.033165] LustreError: 19326:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 709.432488] Lustre: server umount lustre-MDT0001 complete [ 725.153850] Lustre: server umount lustre-OST0000 complete [ 755.541886] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local [ 767.960185] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 768.386115] LustreError: 23752:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 768.507735] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 768.531971] Lustre: Skipped 2 previous similar messages [ 775.380218] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 787.439091] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 793.558132] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 796.878330] Lustre: Setting parameter general.debug_raw_pointers=Y in log params [ 805.349238] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 814.275625] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 824.142641] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 824.476793] Lustre: lustre-OST0001: new disk, initializing [ 824.485564] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 824.499712] Lustre: 26070:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 826.202549] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 826.212868] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 826.362968] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 832.002735] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 842.922508] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 846.967365] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 862.192990] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 862.194066] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 862.213891] Lustre: Skipped 5 previous similar messages [ 862.238022] Lustre: Skipped 6 previous similar messages [ 866.205628] Lustre: server umount lustre-MDT0000 complete [ 867.321539] LustreError: 23749:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 867.374040] LustreError: 23749:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 6 previous similar messages [ 871.064954] LustreError: 23734:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786103162 with bad export cookie 18365172507073655095 [ 871.073873] LustreError: MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 871.077199] LustreError: 23734:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 871.560873] Lustre: server umount lustre-MDT0001 complete [ 886.293693] Lustre: server umount lustre-OST0000 complete [ 888.544107] Lustre: 3653:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786103164/real 1786103164] req@ffff966fad53bb80 x1872864149235328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1786103180 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 888.589683] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 891.075585] Lustre: server umount lustre-OST0001 complete [ 910.292128] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local [ 921.860311] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 922.205123] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 922.208834] Lustre: Skipped 3 previous similar messages [ 927.443346] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 937.392457] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 942.946574] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 946.333880] Lustre: 30239:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 954.342611] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 962.045173] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 972.253654] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 980.213095] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 989.625375] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 994.387901] Lustre: 32118:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 1003.502371] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1003.507227] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1003.517503] Lustre: Skipped 3 previous similar messages [ 1003.544415] Lustre: Skipped 3 previous similar messages [ 1007.586655] Lustre: server umount lustre-MDT0000 complete [ 1008.623333] LustreError: 29091:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1008.664658] LustreError: 29091:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 12 previous similar messages [ 1012.023915] LustreError: 29072:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786103303 with bad export cookie 18365172507073656390 [ 1012.029752] LustreError: MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1012.044845] LustreError: 29072:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 1012.366795] Lustre: server umount lustre-MDT0001 complete [ 1027.772526] Lustre: server umount lustre-OST0000 complete [ 1030.112267] Lustre: 3655:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786103305/real 1786103305] req@ffff966e8336e680 x1872864149288320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1786103321 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 1032.145772] Lustre: server umount lustre-OST0001 complete [ 1043.096614] Lustre: DEBUG MARKER: == conf-sanity test 76b: verify params log setup correctly ========================================================== 07:48:52 (1786103332) [ 1074.984796] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local [ 1088.340562] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1094.536590] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 1103.749772] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1109.457542] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 1112.982658] Lustre: 36083:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 1121.551608] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1129.935482] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 1140.352251] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1148.231994] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 1157.337275] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1161.924135] Lustre: 37962:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 1170.916965] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1170.929107] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1170.953776] Lustre: Skipped 1 previous similar message [ 1170.963615] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1173.538277] Lustre: server umount lustre-MDT0000 complete [ 1177.896837] LustreError: 34914:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786103469 with bad export cookie 18365172507073657496 [ 1177.902584] LustreError: MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1177.907325] LustreError: 34914:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 1178.224948] Lustre: server umount lustre-MDT0001 complete [ 1191.599568] Lustre: server umount lustre-OST0000 complete [ 1205.641710] Lustre: server umount lustre-OST0001 complete [ 1217.051107] Lustre: DEBUG MARKER: == conf-sanity test 76c: verify changelog_mask is applied with lctl set_param -P ========================================================== 07:51:46 (1786103506) [ 1234.891569] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local [ 1246.865660] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1247.234278] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1247.244078] Lustre: Skipped 7 previous similar messages [ 1252.309954] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 1261.960502] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1267.377244] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 1270.608985] Lustre: 41251:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 1276.837734] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1283.248200] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 1287.546562] LustreError: 41606:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1287.561593] LustreError: 41606:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 16 previous similar messages [ 1291.986909] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1298.490685] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 1305.942626] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1310.154434] Lustre: 43128:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 1311.029764] Lustre: Setting parameter general.mdd.*.changelog_mask=-CLOSE in log params [ 1311.034312] Lustre: Skipped 1 previous similar message [ 1318.881497] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1318.897847] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1318.913890] Lustre: Skipped 3 previous similar messages [ 1322.837450] Lustre: server umount lustre-MDT0000 complete [ 1326.894857] LustreError: 40083:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786103618 with bad export cookie 18365172507073658602 [ 1326.906334] LustreError: MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1333.287319] Lustre: server umount lustre-MDT0001 complete [ 1342.732305] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1352.161216] LustreError: 3651:0:(client.c:1391:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff966e83443b80 x1872864149393024/t0(0) o250->MGC192.168.204.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 1357.693049] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 1362.943203] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 1369.012402] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1375.244419] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 1375.267032] Lustre: Skipped 1 previous similar message [ 1375.656771] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 1384.318531] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1386.501517] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 1393.080624] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 1394.916126] Lustre: DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec [ 1405.415914] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1406.880693] Lustre: server umount lustre-MDT0000 complete [ 1411.099597] LustreError: 41633:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786103702 with bad export cookie 18365172507073659729 [ 1411.109112] LustreError: 41633:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 1411.131014] LustreError: MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1411.604254] Lustre: server umount lustre-MDT0001 complete [ 1425.457068] Lustre: server umount lustre-OST0000 complete [ 1439.573581] Lustre: server umount lustre-OST0001 complete [ 1451.935926] Lustre: DEBUG MARKER: == conf-sanity test 76d: verify llite.*.xattr_cache can be set by 'lctl set_param -P' correctly ========================================================== 07:55:41 (1786103741) [ 1467.655448] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local [ 1478.856994] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1483.097257] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 1491.904837] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1497.380966] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 1500.732215] Lustre: 48896:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 1506.844401] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1513.013322] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 1520.921303] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1527.560132] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 1535.059688] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1539.393865] Lustre: Setting parameter general.llite.*.xattr_cache=0 in log params [ 1548.769657] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1548.783306] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1548.791773] Lustre: Skipped 23 previous similar messages [ 1554.953046] Lustre: server umount lustre-MDT0000 complete [ 1558.391066] LustreError: 48499:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786103850 with bad export cookie 18365172507073660527 [ 1558.404394] LustreError: MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1558.415977] LustreError: 48499:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 6 previous similar messages [ 1558.698734] Lustre: server umount lustre-MDT0001 complete [ 1572.101125] Lustre: server umount lustre-OST0000 complete [ 1586.056734] Lustre: server umount lustre-OST0001 complete [ 1595.949185] Lustre: DEBUG MARKER: == conf-sanity test 77: comma-separated MGS NIDs and failover node NIDs ========================================================== 07:58:05 (1786103885) [ 1598.433464] Lustre: DEBUG MARKER: SKIP: conf-sanity test_77 mixed loopback and real device not working [ 1600.718449] Lustre: DEBUG MARKER: == conf-sanity test 78: run resize2fs on MDT and OST filesystems ========================================================== 07:58:10 (1786103890) [ 1613.496494] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_hostid [ 1624.665444] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local [ 1649.992703] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1650.208305] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1650.282913] Lustre: lustre-MDT0000: new disk, initializing [ 1650.387949] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1654.509500] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 1663.874181] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1670.527169] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1670.791539] Lustre: lustre-OST0000: new disk, initializing [ 1670.795261] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1670.799431] Lustre: Skipped 1 previous similar message [ 1670.803879] Lustre: 54972:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1672.871174] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 1672.887095] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 1672.942181] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 1676.907724] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 1685.573920] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1687.925745] Lustre: DEBUG MARKER: create test files [ 1724.389706] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1724.401193] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1724.439372] Lustre: Skipped 13 previous similar messages [ 1728.861379] Lustre: server umount lustre-OST0000 complete [ 1735.361213] Lustre: server umount lustre-MDT0000 complete [ 1756.187449] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing unload_modules_local [ 1760.276071] Key type lgssc unregistered [ 1760.733888] LNet: 56632:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1760.741621] LNetError: 56632:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1760.756983] LNet: Removed LNI 192.168.204.106@tcp [ 1762.790989] Key type .llcrypt unregistered [ 1762.793820] Key type ._llcrypt unregistered [ 1805.712667] Key type ._llcrypt registered [ 1805.715643] Key type .llcrypt registered [ 1805.886764] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local [ 1807.517911] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1807.798625] alg: No test for adler32 (adler32-zlib) [ 1808.971274] Lustre: Lustre: Build Version: 2.17.56_50_gf5ff674 [ 1809.378461] LNet: Added LNI 192.168.204.106@tcp [8/256/0/180] [ 1811.120128] Key type lgssc registered [ 1812.786362] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1821.414354] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1821.428302] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1822.890667] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1828.218130] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 1837.795345] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1846.039972] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1846.336525] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1847.387482] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:102 to 0x240000400:129) [ 1847.662277] Lustre: 59398:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 510 < left 544, rollback = 9 [ 1847.698479] Lustre: 59398:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 32/128/5, destroy: 0/0/0 [ 1847.726444] Lustre: 59398:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 1847.755996] Lustre: 59398:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/18/1, punch: 0/0/0, quota 1/3/0 [ 1847.776983] Lustre: 59398:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 1847.802925] Lustre: 59398:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 1854.446556] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 1864.193130] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1870.806412] Lustre: DEBUG MARKER: check files after expanding the MDT and OST filesystems [ 1877.437337] Lustre: DEBUG MARKER: create more files after expanding the MDT and OST filesystems [ 1886.063538] Lustre: server umount lustre-OST0000 complete [ 1899.647795] Lustre: server umount lustre-MDT0000 complete [ 1914.225949] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing unload_modules_local [ 1917.532561] Key type lgssc unregistered [ 1917.872699] LNet: 61011:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1917.881403] LNetError: 61011:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1917.895316] LNet: Removed LNI 192.168.204.106@tcp [ 1919.145325] Key type .llcrypt unregistered [ 1919.147279] Key type ._llcrypt unregistered [ 1955.980940] Key type ._llcrypt registered [ 1955.984444] Key type .llcrypt registered [ 1956.091356] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local [ 1957.777529] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1957.864111] alg: No test for adler32 (adler32-zlib) [ 1959.005467] Lustre: Lustre: Build Version: 2.17.56_50_gf5ff674 [ 1959.249745] LNet: Added LNI 192.168.204.106@tcp [8/256/0/180] [ 1960.929362] Key type lgssc registered [ 1962.224564] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1972.052839] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1972.087723] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1973.440286] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1981.066084] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 1990.831598] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1999.633676] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1999.929467] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2006.574584] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 2016.071939] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2019.328805] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:140 to 0x240000400:161) [ 2019.401836] Lustre: 63846:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 509 < left 544, rollback = 9 [ 2019.408180] Lustre: 63846:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 32/128/6, destroy: 0/0/0 [ 2019.414052] Lustre: 63846:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 2019.419821] Lustre: 63846:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/18/1, punch: 0/0/0, quota 1/3/0 [ 2019.427380] Lustre: 63846:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 2019.435210] Lustre: 63846:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 2029.180671] Lustre: DEBUG MARKER: check files after shrinking the MDT and OST filesystems [ 2044.905910] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2044.906868] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2044.947152] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2046.240240] Lustre: server umount lustre-OST0000 complete [ 2051.925474] Lustre: server umount lustre-MDT0000 complete [ 2066.577394] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing unload_modules_local [ 2070.325892] Key type lgssc unregistered [ 2070.758374] LNet: 65430:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2070.771723] LNetError: 65430:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2070.789133] LNet: Removed LNI 192.168.204.106@tcp [ 2071.960992] Key type .llcrypt unregistered [ 2071.964447] Key type ._llcrypt unregistered [ 2095.829662] Key type ._llcrypt registered [ 2095.831723] Key type .llcrypt registered [ 2095.970875] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_hostid [ 2116.757482] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local [ 2119.063014] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2119.174773] alg: No test for adler32 (adler32-zlib) [ 2120.632401] Lustre: Lustre: Build Version: 2.17.56_50_gf5ff674 [ 2120.986900] LNet: Added LNI 192.168.204.106@tcp [8/256/0/180] [ 2122.776229] Key type lgssc registered [ 2124.344083] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2168.542235] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2168.634950] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2170.085566] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2170.187257] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2170.248383] Lustre: lustre-MDT0000: new disk, initializing [ 2170.318340] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2170.335756] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2175.775915] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 2189.227968] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2189.341285] Lustre: 68588:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2189.388527] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 2189.392434] Lustre: Skipped 1 previous similar message [ 2189.451413] Lustre: lustre-MDT0001: new disk, initializing [ 2189.559685] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2189.615313] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 2189.634982] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2194.684726] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 2206.281394] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2213.206980] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2222.083434] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2222.296814] Lustre: lustre-OST0000: new disk, initializing [ 2222.303980] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 2222.310051] Lustre: 70558:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2222.406028] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2228.407087] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 2228.452118] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2228.813030] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2232.691555] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 2244.633794] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2250.288749] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2250.739868] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2256.782888] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2257.013358] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2264.559606] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2264.565512] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2264.566996] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2264.574152] LustreError: Skipped 1 previous similar message [ 2264.583442] Lustre: Skipped 1 previous similar message [ 2269.678716] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2269.691075] Lustre: Skipped 2 previous similar messages [ 2274.272526] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2274.546894] Lustre: server umount lustre-OST0000 complete [ 2279.922072] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2279.943297] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2279.978029] Lustre: Skipped 1 previous similar message [ 2286.055339] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2286.076372] Lustre: Skipped 4 previous similar messages [ 2286.470862] Lustre: server umount lustre-MDT0000 complete [ 2292.123953] LustreError: 68579:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786104583 with bad export cookie 1712856960201225953 [ 2292.137572] LustreError: 68579:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 2292.148104] LustreError: MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2292.486595] Lustre: server umount lustre-MDT0001 complete [ 2306.539464] Lustre: DEBUG MARKER: == conf-sanity test 79: format MDT/OST without mgs option (should return errors) ========================================================== 08:09:54 (1786104594) [ 2326.124193] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local [ 2378.293429] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_hostid [ 2391.740182] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local [ 2437.015711] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2437.376499] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2437.408899] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2437.511807] Lustre: lustre-MDT0000: new disk, initializing [ 2437.645125] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2437.684641] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2444.540209] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 2457.125494] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2457.277657] Lustre: 76611:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2457.364540] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 2457.372692] Lustre: Skipped 1 previous similar message [ 2457.503668] Lustre: lustre-MDT0001: new disk, initializing [ 2457.680054] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2457.749817] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 2457.769740] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2464.302527] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 2476.610217] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2483.687645] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2491.492810] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2491.832661] Lustre: lustre-OST0000: new disk, initializing [ 2491.840945] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 2491.860604] Lustre: 78579:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2491.958171] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2499.192584] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 2499.218744] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2499.529474] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2500.420446] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 2513.334546] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2519.549617] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2519.869082] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2525.655392] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2526.102924] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2530.275880] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2530.290989] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2530.309565] LustreError: Skipped 1 previous similar message [ 2530.343194] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2535.367201] Lustre: server umount lustre-OST0000 complete [ 2544.611813] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2544.627971] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2544.640541] Lustre: Skipped 1 previous similar message [ 2544.647959] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2544.662679] Lustre: Skipped 1 previous similar message [ 2555.360150] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2555.619881] Lustre: server umount lustre-MDT0000 complete [ 2556.391764] LustreError: 77774:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2556.428218] LustreError: 77774:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 4 previous similar messages [ 2561.094325] LustreError: 76604:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786104852 with bad export cookie 1712856960201226835 [ 2561.101204] LustreError: MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2561.105359] LustreError: 76604:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 7 previous similar messages [ 2561.574051] Lustre: server umount lustre-MDT0001 complete [ 2574.028534] Lustre: DEBUG MARKER: == conf-sanity test 80: mgc import reconnect race ======== 08:14:23 (1786104863) [ 2583.062396] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2583.657591] LustreError: 80995:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2583.806079] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2589.165604] LustreError: 80996:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2590.727544] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 2594.281584] LustreError: 80995:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2599.395492] LustreError: 80996:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2601.495542] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2608.156517] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 2619.103983] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2627.771411] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2636.715103] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2637.014672] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2637.026166] Lustre: Skipped 1 previous similar message [ 2645.213825] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 2654.434688] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2658.610629] Lustre: 83672:0:(genops.c:1795:obd_export_evict_by_uuid()) MGS: evicting fdb2bd4c-4efa-459c-ba35-ead1fc2efd21 at adminstrative request [ 2659.821721] LustreError: MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2659.848800] Lustre: *** cfs_fail_loc=906, val=2147483648*** [ 2670.055872] Lustre: MGS: Client fdb2bd4c-4efa-459c-ba35-ead1fc2efd21 (at 0@lo) reconnecting [ 2670.076298] Lustre: Evicted from MGS (at 0@lo) after server handle changed from 0x17c54a5487d97dc5 to 0x17c54a5487d98065 [ 2670.099108] Lustre: MGC192.168.204.106@tcp: Connection restored to 0@lo (at 0@lo) [ 2698.217210] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2698.351982] Lustre: lustre-OST0001: new disk, initializing [ 2698.354913] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 2698.360283] Lustre: 84069:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2705.954884] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 2707.068093] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 2707.087233] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 2707.209679] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 2717.961388] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2722.785771] LustreError: lustre-OST0001-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2722.789361] Lustre: lustre-OST0001-osc-MDT0001: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2722.802737] LustreError: Skipped 1 previous similar message [ 2722.803520] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 2722.803524] Lustre: Skipped 4 previous similar messages [ 2722.836381] Lustre: Skipped 2 previous similar messages [ 2727.671156] Lustre: server umount lustre-OST0001 complete [ 2727.920864] LustreError: 84477:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2727.939185] LustreError: 84477:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 2733.031977] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2733.043670] Lustre: Skipped 1 previous similar message [ 2738.500471] Lustre: server umount lustre-OST0000 complete [ 2745.314604] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2749.965678] Lustre: server umount lustre-MDT0000 complete [ 2753.506398] LustreError: 80996:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2753.540913] LustreError: 80996:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 5 previous similar messages [ 2754.996871] LustreError: 80976:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786105046 with bad export cookie 1712856960201228389 [ 2755.024983] LustreError: MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2755.030105] LustreError: 80976:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 2755.623601] Lustre: server umount lustre-MDT0001 complete [ 2768.540616] Lustre: DEBUG MARKER: == conf-sanity test 81: sparse OST indexing ============== 08:17:37 (1786105057) [ 2770.636645] Lustre: DEBUG MARKER: SKIP: conf-sanity test_81 needs >= 3 OSTs [ 2773.525786] Lustre: DEBUG MARKER: == conf-sanity test 82a: specify OSTs for file (succeed) or directory (succeed) ========================================================== 08:17:42 (1786105062) [ 2776.214766] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82a needs >= 3 OSTs [ 2778.651837] Lustre: DEBUG MARKER: == conf-sanity test 82b: specify OSTs for file with --pool and --ost-list options ========================================================== 08:17:48 (1786105068) [ 2781.320184] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82b needs >= 4 OSTs [ 2783.748079] Lustre: DEBUG MARKER: == conf-sanity test 82c: specify sparse OSTs for setstripe (should not crash) ========================================================== 08:17:53 (1786105073) [ 2785.776956] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82c needs >= 4 OSTs [ 2788.030715] Lustre: DEBUG MARKER: == conf-sanity test 83: ENOSPACE on OST doesn't cause message VFS: Busy inodes after unmount ... ========================================================== 08:17:57 (1786105077) [ 2790.709995] Lustre: DEBUG MARKER: mount the OST /dev/mapper/ost1_flakey as a ldiskfs filesystem [ 2798.070418] loop: module loaded [ 2798.080241] loop0: detected capacity change from 0 to 4294967296 [ 2798.117404] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 2799.897234] Lustre: DEBUG MARKER: run llverfs in partial mode on the OST ldiskfs /mnt/lustre-ost1 [ 2804.244339] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing run_llverfs /mnt/lustre-ost1 -vpl no [ 2809.189172] Lustre: DEBUG MARKER: unmount the OST /dev/mapper/ost1_flakey [ 2841.672814] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2841.719745] LustreError: 88210:0:(obd_config.c:845:class_setup()) setup lustre-OST0000-osd failed (-28) [ 2841.738127] LustreError: 88210:0:(obd_mount.c:259:lustre_start_simple()) lustre-OST0000-osd setup error -28 [ 2841.758446] LustreError: 88210:0:(tgt_mount.c:2579:server_fill_super()) Unable to start osd on /dev/mapper/ost1_flakey: -28 [ 2841.772159] LustreError: 88210:0:(super25.c:178:lustre_fill_super()) llite: Unable to mount : rc = -28 [ 2865.508950] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_hostid [ 2879.991559] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local [ 2933.953685] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2934.244738] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2934.280349] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2934.348905] Lustre: lustre-MDT0000: new disk, initializing [ 2934.444362] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2934.449950] Lustre: Skipped 1 previous similar message [ 2934.466371] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2939.310478] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 2952.867535] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2952.980389] Lustre: 91095:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2953.197976] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2960.292057] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 2972.951348] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2980.693963] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2988.002457] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2988.464189] Lustre: 93061:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2996.987824] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 2997.331067] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2997.420425] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 3007.345440] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3012.816183] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 3013.267373] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 3018.695893] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 3018.949756] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 3023.350509] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3023.361293] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3023.384951] Lustre: Skipped 2 previous similar messages [ 3023.397698] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3023.411754] Lustre: Skipped 9 previous similar messages [ 3027.626791] Lustre: server umount lustre-OST0000 complete [ 3047.392400] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 3047.630962] Lustre: server umount lustre-MDT0000 complete [ 3048.931460] LustreError: 91105:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3048.978346] LustreError: 91105:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 3052.372989] LustreError: 91086:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786105344 with bad export cookie 1712856960201229005 [ 3052.382293] LustreError: MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3052.382254] LustreError: 91086:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 3052.708500] Lustre: server umount lustre-MDT0001 complete [ 3064.327593] Lustre: DEBUG MARKER: == conf-sanity test 84: check recovery_hard_time ========= 08:22:33 (1786105353) [ 3071.856497] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3072.523246] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-60 [ 3072.527365] Lustre: Skipped 2 previous similar messages [ 3078.375577] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 3088.513934] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3095.340866] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 3105.050385] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3112.366870] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3121.019908] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3129.515802] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 3138.093662] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3143.347489] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 3143.613500] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 3150.273786] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 3150.556238] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 3157.642784] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3157.883813] Lustre: lustre-OST0001: new disk, initializing [ 3157.889844] Lustre: Skipped 2 previous similar messages [ 3157.897420] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 3157.902379] Lustre: Skipped 3 previous similar messages [ 3157.908299] Lustre: 98851:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3163.255228] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 3163.263753] Lustre: Skipped 2 previous similar messages [ 3163.274338] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 3163.376660] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 3165.127660] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 3176.775439] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3183.097925] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid 50 [ 3183.486192] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 3188.827687] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [ 3189.098138] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 3210.335526] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 3235.910613] Lustre: Failing over lustre-MDT0000 [ 3236.542702] Lustre: server umount lustre-MDT0000 complete [ 3237.347778] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3237.356603] LustreError: Skipped 1 previous similar message [ 3237.359314] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3237.382666] Lustre: Skipped 3 previous similar messages [ 3237.391546] LustreError: 95480:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3237.412115] LustreError: 95480:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 4 previous similar messages [ 3256.802044] Lustre: 66814:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786105532/real 1786105532] req@000000009663196a x1872866220214400/t0(0) o400->MGC192.168.204.106@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1786105548 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 3256.864697] LustreError: MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3261.939191] LDISKFS-fs (dm-0): 4 truncates cleaned up [ 3261.942175] LDISKFS-fs (dm-0): recovery complete [ 3261.947746] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3267.067382] Lustre: Evicted from MGS (at 0@lo) after server handle changed from 0x0 to 0x17c54a5487da4ae0 [ 3267.079633] Lustre: MGC192.168.204.106@tcp: Connection restored to 0@lo (at 0@lo) [ 3267.507972] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 3269.552478] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 3269.553409] Lustre: 95477:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 3272.686202] Lustre: 96404:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 3272.700946] Lustre: 96404:0:(ldlm_lib.c:2085:extend_recovery_timer()) Skipped 1 previous similar message [ 3272.714798] Lustre: lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 3272.812855] LustreError: 101701:0:(ldlm_lib.c:2698:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 3273.145264] LustreError: 101701:0:(ldlm_lib.c:2698:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 3273.487824] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 3273.493329] LustreError: 101701:0:(ldlm_lib.c:2698:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 3273.524925] LustreError: 101701:0:(ldlm_lib.c:2698:replay_request_or_update()) Skipped 1 previous similar message [ 3273.875667] LustreError: 101701:0:(ldlm_lib.c:2698:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 3273.893835] LustreError: 101701:0:(ldlm_lib.c:2698:replay_request_or_update()) Skipped 1 previous similar message [ 3273.937817] Lustre: 101701:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 3273.964130] Lustre: 101701:0:(ldlm_lib.c:2085:extend_recovery_timer()) Skipped 7 previous similar messages [ 3274.669594] LustreError: 101701:0:(ldlm_lib.c:2698:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 3274.688559] LustreError: 101701:0:(ldlm_lib.c:2698:replay_request_or_update()) Skipped 2 previous similar messages [ 3275.016212] LustreError: 101701:0:(ldlm_lib.c:2698:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 3275.023022] LustreError: 101701:0:(ldlm_lib.c:2698:replay_request_or_update()) Skipped 2 previous similar messages [ 3276.002603] Lustre: 101701:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 3276.031888] Lustre: 101701:0:(ldlm_lib.c:2085:extend_recovery_timer()) Skipped 5 previous similar messages [ 3276.673232] LustreError: 101701:0:(ldlm_lib.c:2698:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 3276.684577] LustreError: 101701:0:(ldlm_lib.c:2698:replay_request_or_update()) Skipped 5 previous similar messages [ 3277.328123] LustreError: 101701:0:(ldlm_lib.c:2698:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 3277.338171] LustreError: 101701:0:(ldlm_lib.c:2698:replay_request_or_update()) Skipped 6 previous similar messages [ 3280.206683] Lustre: 101701:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 3280.221324] Lustre: 101701:0:(ldlm_lib.c:2085:extend_recovery_timer()) Skipped 12 previous similar messages [ 3280.868410] LustreError: 101701:0:(ldlm_lib.c:2698:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 3280.882476] LustreError: 101701:0:(ldlm_lib.c:2698:replay_request_or_update()) Skipped 12 previous similar messages [ 3281.520122] LustreError: 101701:0:(ldlm_lib.c:2698:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 3281.529272] LustreError: 101701:0:(ldlm_lib.c:2698:replay_request_or_update()) Skipped 12 previous similar messages [ 3288.502548] Lustre: 101701:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 3288.516211] Lustre: 101701:0:(ldlm_lib.c:2085:extend_recovery_timer()) Skipped 25 previous similar messages [ 3289.154635] LustreError: 101701:0:(ldlm_lib.c:2698:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 3289.173635] LustreError: 101701:0:(ldlm_lib.c:2698:replay_request_or_update()) Skipped 25 previous similar messages [ 3289.816150] LustreError: 101701:0:(ldlm_lib.c:2698:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 3289.823049] LustreError: 101701:0:(ldlm_lib.c:2698:replay_request_or_update()) Skipped 25 previous similar messages [ 3304.704977] Lustre: 101701:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 3304.724430] Lustre: 101701:0:(ldlm_lib.c:2085:extend_recovery_timer()) Skipped 50 previous similar messages [ 3305.369161] LustreError: 101701:0:(ldlm_lib.c:2698:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 3305.387801] LustreError: 101701:0:(ldlm_lib.c:2698:replay_request_or_update()) Skipped 50 previous similar messages [ 3306.040134] LustreError: 101701:0:(ldlm_lib.c:2698:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 3306.046444] LustreError: 101701:0:(ldlm_lib.c:2698:replay_request_or_update()) Skipped 50 previous similar messages [ 3329.144148] Lustre: 101701:0:(ldlm_lib.c:2394:target_recovery_overseer()) lustre-MDT0000 recovery is aborted by hard timeout [ 3329.157271] Lustre: 101701:0:(ldlm_lib.c:2404:target_recovery_overseer()) recovery is aborted, evict exports in recovery [ 3329.170144] Lustre: 101701:0:(genops.c:1622:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client 1969a306-6769-428f-8b99-c8763c70b4f6@192.168.204.6@tcp [ 3329.187970] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 3329.199250] Lustre: 101701:0:(ldlm_lib.c:1914:abort_req_replay_queue()) @@@ aborted: req@0000000037c5b21d x1872866196918912/t0(8589934773) o101->1969a306-6769-428f-8b99-c8763c70b4f6@192.168.204.6@tcp:621/0 lens 592/0 e 0 to 0 dl 1786105631 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:0 [ 3329.252274] Lustre: lustre-MDT0000-osd: cancel update llog [0x200000400:0x1:0x0] [ 3329.267151] Lustre: lustre-MDT0000: Denying connection for new client 1969a306-6769-428f-8b99-c8763c70b4f6 (at 192.168.204.6@tcp), waiting for 3 known clients (2 recovered, 0 in progress, and 1 evicted) to recover in 0:00 [ 3329.310220] Lustre: lustre-MDT0001-osp-MDT0000: cancel update llog [0x240000401:0x1:0x0] [ 3329.360076] Lustre: lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 3329.378180] Lustre: lustre-MDT0000: Recovery over after 1:00, of 3 clients 2 recovered and 1 was evicted. [ 3329.381458] Lustre: Skipped 2 previous similar messages [ 3329.460782] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:46 to 0x2c0000401:545) [ 3329.464924] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:78 to 0x280000401:577) [ 3345.900092] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3345.914713] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3345.933987] Lustre: Skipped 3 previous similar messages [ 3345.941931] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3345.954372] Lustre: Skipped 6 previous similar messages [ 3351.761895] Lustre: server umount lustre-OST0000 complete [ 3362.581694] Lustre: server umount lustre-OST0001 complete [ 3373.587315] Lustre: server umount lustre-MDT0000 complete [ 3375.074052] LustreError: 95481:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3375.113578] LustreError: 95481:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 47 previous similar messages [ 3378.030088] LustreError: 95460:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786105669 with bad export cookie 1712856960201280224 [ 3378.041687] LustreError: 95460:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 3378.044677] LustreError: MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3378.511920] Lustre: server umount lustre-MDT0001 complete [ 3389.588689] Lustre: DEBUG MARKER: == conf-sanity test 85: osd_ost init: fail ea_fid_set ==== 08:27:58 (1786105678) [ 3399.247439] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3399.257630] Lustre: *** cfs_fail_loc=197, val=0*** [ 3414.816719] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 3419.937769] LustreError: 103677:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.204.106@tcp: failed processing log, type 4: rc = -110 [ 3425.108595] Lustre: *** cfs_fail_loc=197, val=0*** [ 3425.115077] Lustre: Skipped 65 previous similar messages [ 3445.665381] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3445.676867] Lustre: Skipped 4 previous similar messages [ 3452.724588] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 3460.738588] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3462.826924] Lustre: server umount lustre-OST0000 complete [ 3472.695062] Lustre: DEBUG MARKER: == conf-sanity test 86: Replacing mkfs.lustre -G option == 08:29:22 (1786105762) [ 3496.531905] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3502.493964] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 3512.959243] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3517.364232] LustreError: 105328:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x200000009:0x1:0x0]: rc = -5 [ 3517.379552] LustreError: 105328:0:(lod_sub_object.c:917:lod_sub_prep_llog()) lustre-MDT0000-mdtlov: can't get id from catalogs: rc = -5 [ 3517.408129] LustreError: 105328:0:(lod_dev.c:511:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 21, retries 0, failed: rc = -5 [ 3517.830354] Lustre: server umount lustre-MDT0000 complete [ 3556.744680] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_hostid [ 3570.486259] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local [ 3614.484497] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3614.866513] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3614.919275] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3615.057851] Lustre: lustre-MDT0000: new disk, initializing [ 3615.174747] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3620.153517] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 3631.598772] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3631.810361] Lustre: 109507:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 3632.087338] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 3637.686467] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 3648.324191] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3655.546213] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3663.294701] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3663.675079] Lustre: 111475:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3670.780442] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 3672.301862] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 3680.518960] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3685.848730] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 3686.023207] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 3691.166320] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 3691.368313] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 3698.155809] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3698.156627] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3698.173114] LustreError: Skipped 3 previous similar messages [ 3698.177469] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3698.180670] Lustre: Skipped 6 previous similar messages [ 3698.217162] Lustre: Skipped 9 previous similar messages [ 3699.781534] Lustre: server umount lustre-OST0000 complete [ 3710.365384] Lustre: server umount lustre-MDT0000 complete [ 3713.518308] LustreError: 109513:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3713.545347] LustreError: 109513:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 6 previous similar messages [ 3714.663651] LustreError: 109498:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786106006 with bad export cookie 1712856960201290843 [ 3714.673931] LustreError: MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3714.681218] LustreError: 109498:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 3715.107993] Lustre: server umount lustre-MDT0001 complete [ 3726.374983] Lustre: DEBUG MARKER: == conf-sanity test 87: check if MDT inode can hold EAs with N stripes properly ========================================================== 08:33:35 (1786106015) [ 3737.306859] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing unload_modules_local [ 3740.693318] Key type lgssc unregistered [ 3740.982537] LNet: 113965:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3740.993353] LNetError: 113965:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3741.008494] LNet: Removed LNI 192.168.204.106@tcp [ 3742.142530] Key type .llcrypt unregistered [ 3742.146819] Key type ._llcrypt unregistered [ 3763.278415] Key type ._llcrypt registered [ 3763.281702] Key type .llcrypt registered [ 3763.376564] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_hostid [ 3780.608450] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local [ 3782.644106] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3782.777195] alg: No test for adler32 (adler32-zlib) [ 3783.899758] Lustre: Lustre: Build Version: 2.17.56_50_gf5ff674 [ 3784.300086] LNet: Added LNI 192.168.204.106@tcp [8/256/0/180] [ 3786.104162] Key type lgssc registered [ 3787.658601] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3836.187596] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3836.212211] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3837.580375] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3837.649754] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3837.792158] Lustre: lustre-MDT0000: new disk, initializing [ 3837.963107] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3837.991906] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3844.641403] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 3856.311707] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3856.637762] Lustre: lustre-OST0000: new disk, initializing [ 3856.640939] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3856.644299] Lustre: Skipped 1 previous similar message [ 3856.648803] Lustre: 118145:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3856.703884] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3862.941954] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 3865.769675] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 3865.788867] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 3865.837211] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 3875.864303] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3876.038162] Lustre: lustre-OST0001: new disk, initializing [ 3876.042050] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 3876.048588] Lustre: 119008:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3876.148224] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 3883.352403] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 3884.160983] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost [ 3884.167907] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] [ 3884.206126] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 [ 3894.242264] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3894.249148] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3894.269022] Lustre: Skipped 1 previous similar message [ 3898.738974] Lustre: server umount lustre-MDT0000 complete [ 3905.115508] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null) [ 3909.734355] LustreError: 117329:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786106201 with bad export cookie 7617265101056321864 [ 3909.748540] LustreError: MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3909.750288] LustreError: 117329:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 3909.839401] Lustre: server umount lustre-OST0000 complete [ 3914.411261] Lustre: server umount lustre-OST0001 complete [ 3923.937622] Lustre: DEBUG MARKER: == conf-sanity test 88a: tunefs.lustre persists a --mountfsoptions-only change ========================================================== 08:36:53 (1786106213) [ 3950.568378] Lustre: DEBUG MARKER: == conf-sanity test 88b: check the default mount options can be overridden ========================================================== 08:37:19 (1786106239) [ 3963.118383] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local [ 3990.784404] Lustre: DEBUG MARKER: == conf-sanity test 89: check tunefs --param and --erase-param{s} options ========================================================== 08:38:00 (1786106280) [ 4036.553924] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_hostid [ 4051.018243] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local [ 4095.234490] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4095.673562] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 4095.710976] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 4095.774395] Lustre: lustre-MDT0000: new disk, initializing [ 4095.851092] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4095.870283] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 4101.411812] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 4113.219751] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4113.416677] Lustre: 126782:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 4113.494104] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 4113.501329] Lustre: Skipped 1 previous similar message [ 4113.567333] Lustre: lustre-MDT0001: new disk, initializing [ 4113.676384] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4113.724381] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 4113.744898] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 4119.461683] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 4131.615984] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 4138.488951] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 4146.736719] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4147.032847] Lustre: lustre-OST0000: new disk, initializing [ 4147.037270] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 4147.046708] Lustre: 128751:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 4147.168706] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4153.922684] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 4153.995566] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 4154.010552] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 4154.201201] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 4165.823708] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount (FULL|IDLE) failover.node=192.0.2.254@tcp0,osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 4171.750396] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 4172.082631] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 4178.758419] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 4179.195715] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 4185.058600] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4185.059460] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4185.069729] LustreError: Skipped 1 previous similar message [ 4185.092236] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4185.104782] Lustre: Skipped 2 previous similar messages [ 4187.541850] Lustre: server umount lustre-OST0000 complete [ 4195.299097] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4195.310607] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4195.325868] Lustre: Skipped 2 previous similar messages [ 4198.814677] Lustre: server umount lustre-MDT0000 complete [ 4202.742231] LustreError: 126773:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786106494 with bad export cookie 7617265101056323089 [ 4202.748056] LustreError: MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4202.758629] LustreError: 126773:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4203.181869] Lustre: server umount lustre-MDT0001 complete [ 4215.423747] Lustre: DEBUG MARKER: == conf-sanity test 90a: check max_mod_rpcs_in_flight is enforced ========================================================== 08:41:44 (1786106504) [ 4222.785788] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4223.305959] LustreError: 131164:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4223.330335] LustreError: 131164:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [ 4223.379690] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4228.526852] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 4228.588412] LustreError: 131165:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4233.713342] LustreError: 131164:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4238.685939] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4244.824758] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 4254.336494] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 4262.418408] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 4271.212399] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4271.564151] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4271.570143] Lustre: Skipped 1 previous similar message [ 4280.420372] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 4291.185388] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 4304.016656] Lustre: *** cfs_fail_loc=159, val=0*** [ 4320.234370] Lustre: lustre-MDT0000: Client 6f96dc81-1ca6-4ab3-8dbd-cd57cd7a8992 (at 192.168.204.6@tcp) reconnecting [ 4322.086469] Lustre: *** cfs_fail_loc=159, val=0*** [ 4322.100040] Lustre: Skipped 5 previous similar messages [ 4338.722125] Lustre: lustre-MDT0000: Client 6f96dc81-1ca6-4ab3-8dbd-cd57cd7a8992 (at 192.168.204.6@tcp) reconnecting [ 4345.316034] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4345.326821] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4345.353377] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4345.363576] Lustre: Skipped 1 previous similar message [ 4346.243758] Lustre: server umount lustre-OST0000 complete [ 4351.460747] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4351.463765] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4351.479545] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4351.494194] Lustre: Skipped 1 previous similar message [ 4360.792642] Lustre: server umount lustre-MDT0000 complete [ 4361.701347] LustreError: 131892:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4361.723897] LustreError: 131892:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 4364.976385] LustreError: 131144:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786106656 with bad export cookie 7617265101056323971 [ 4364.983723] LustreError: MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4364.987856] LustreError: 131144:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 4365.516603] Lustre: server umount lustre-MDT0001 complete [ 4379.521167] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing unload_modules_local [ 4384.049883] Key type lgssc unregistered [ 4384.517384] LNet: 134963:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4384.526845] LNetError: 134963:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4384.553777] LNet: Removed LNI 192.168.204.106@tcp [ 4385.974962] Key type .llcrypt unregistered [ 4385.979101] Key type ._llcrypt unregistered [ 4420.088559] Key type ._llcrypt registered [ 4420.094628] Key type .llcrypt registered [ 4420.356493] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local [ 4423.939738] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4424.011899] alg: No test for adler32 (adler32-zlib) [ 4425.117828] Lustre: Lustre: Build Version: 2.17.56_50_gf5ff674 [ 4425.455568] LNet: Added LNI 192.168.204.106@tcp [8/256/0/180] [ 4427.152231] Key type lgssc registered [ 4428.887418] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4439.635808] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4439.657749] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4441.239806] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4446.793504] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 4450.791710] LustreError: 136380:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4450.807571] LustreError: 136380:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 4455.912580] LustreError: 136381:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4457.825818] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4458.222443] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4464.601868] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 4474.665718] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 4482.688405] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 4490.436876] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4491.159923] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4499.167550] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 4509.341624] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 4510.590269] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:42 to 0x280000401:65) [ 4524.254549] Lustre: *** cfs_fail_loc=159, val=0*** [ 4539.861933] Lustre: lustre-MDT0000: Client 7f96ebf0-9485-4c3b-8ae3-dea980fa8712 (at 192.168.204.6@tcp) reconnecting [ 4542.504758] Lustre: *** cfs_fail_loc=159, val=0*** [ 4542.514972] Lustre: Skipped 1 previous similar message [ 4557.837352] Lustre: lustre-MDT0001: Client 7f96ebf0-9485-4c3b-8ae3-dea980fa8712 (at 192.168.204.6@tcp) reconnecting [ 4560.887377] Lustre: *** cfs_fail_loc=159, val=0*** [ 4560.891182] Lustre: Skipped 1 previous similar message [ 4577.299448] Lustre: lustre-MDT0001: Client 7f96ebf0-9485-4c3b-8ae3-dea980fa8712 (at 192.168.204.6@tcp) reconnecting [ 4594.029334] Lustre: 139441:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 4598.054948] Lustre: *** cfs_fail_loc=159, val=0*** [ 4598.062157] Lustre: Skipped 4 previous similar messages [ 4614.153045] Lustre: lustre-MDT0000: Client baf7922a-eb43-4929-88d9-9206777409ad (at 192.168.204.6@tcp) reconnecting [ 4618.232724] Lustre: *** cfs_fail_loc=159, val=0*** [ 4618.259656] Lustre: Skipped 14 previous similar messages [ 4634.129455] Lustre: lustre-MDT0000: Client baf7922a-eb43-4929-88d9-9206777409ad (at 192.168.204.6@tcp) reconnecting [ 4636.773846] Lustre: 139738:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 4654.052719] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4654.056433] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4654.068389] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4654.073571] Lustre: Skipped 1 previous similar message [ 4658.671907] Lustre: server umount lustre-OST0000 complete [ 4663.265565] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4663.273231] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4663.287758] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4663.295601] Lustre: Skipped 1 previous similar message [ 4664.293457] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4664.295123] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4669.323447] Lustre: server umount lustre-MDT0000 complete [ 4669.418818] LustreError: 139628:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4669.439870] LustreError: 139628:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 4673.510453] LustreError: 139561:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4673.565534] LustreError: 139561:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 4673.993907] LustreError: 136360:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786106965 with bad export cookie 9240384318910179877 [ 4673.997878] LustreError: MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4674.023563] LustreError: 136360:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 4674.469335] Lustre: server umount lustre-MDT0001 complete [ 4688.280752] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing unload_modules_local [ 4692.797808] Key type lgssc unregistered [ 4693.357517] LNet: 140819:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4693.363961] LNetError: 140819:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4693.382346] LNet: Removed LNI 192.168.204.106@tcp [ 4694.706079] Key type .llcrypt unregistered [ 4694.708268] Key type ._llcrypt unregistered [ 4728.779234] Key type ._llcrypt registered [ 4728.781079] Key type .llcrypt registered [ 4728.915788] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local [ 4730.306236] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4730.649284] alg: No test for adler32 (adler32-zlib) [ 4731.817654] Lustre: Lustre: Build Version: 2.17.56_50_gf5ff674 [ 4732.402235] LNet: Added LNI 192.168.204.106@tcp [8/256/0/180] [ 4734.217254] Key type lgssc registered [ 4735.690163] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4745.452538] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4745.481157] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4747.066659] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4752.682812] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 4756.457473] LustreError: 142236:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4756.491167] LustreError: 142236:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 4761.571109] LustreError: 142235:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4762.423799] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4762.711031] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4768.254287] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 4777.450422] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 4785.071669] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 4794.098380] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4794.419485] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4802.102607] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 4807.751842] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:97) [ 4810.797668] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 4817.991258] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:129) [ 4824.959377] Lustre: 144836:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 4828.325588] Lustre: 144885:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 4829.980257] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 in log params [ 4831.238274] Lustre: Setting parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=8 in log params [ 4835.590507] Lustre: 145031:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre/mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 (mode = 0) failed: rc = -17 [ 4837.342577] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=7 in log params [ 4838.361729] Lustre: 145139:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 4843.489203] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4843.498255] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4843.518292] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4843.535026] Lustre: Skipped 1 previous similar message [ 4848.628070] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4848.630848] Lustre: Skipped 1 previous similar message [ 4848.934759] Lustre: server umount lustre-OST0000 complete [ 4854.756588] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4854.766575] LustreError: Skipped 1 previous similar message [ 4854.770492] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4854.781174] Lustre: Skipped 1 previous similar message [ 4854.784990] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4858.852698] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4858.855748] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4858.903635] Lustre: Skipped 1 previous similar message [ 4860.416488] Lustre: server umount lustre-MDT0000 complete [ 4863.969419] LustreError: 142236:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4863.998506] LustreError: 142236:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 4865.267184] LustreError: 144848:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786107156 with bad export cookie 3263665049099696686 [ 4865.285275] LustreError: MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4865.904868] Lustre: server umount lustre-MDT0001 complete [ 4882.292496] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing unload_modules_local [ 4886.719142] Key type lgssc unregistered [ 4887.092246] LNet: 146202:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4887.103918] LNetError: 146202:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4887.124530] LNet: Removed LNI 192.168.204.106@tcp [ 4888.081480] Key type .llcrypt unregistered [ 4888.083545] Key type ._llcrypt unregistered [ 4921.891538] Key type ._llcrypt registered [ 4921.895861] Key type .llcrypt registered [ 4922.047438] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local [ 4923.943805] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4924.011304] alg: No test for adler32 (adler32-zlib) [ 4925.566617] Lustre: Lustre: Build Version: 2.17.56_50_gf5ff674 [ 4925.793328] LNet: Added LNI 192.168.204.106@tcp [8/256/0/180] [ 4927.464203] Key type lgssc registered [ 4929.233714] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4937.837434] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4937.900358] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4939.680148] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4946.257911] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 4949.992817] LustreError: 147616:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4950.019754] LustreError: 147616:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 4955.122630] LustreError: 147617:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4956.314560] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4956.704441] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4961.918051] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 4970.558697] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 4978.007348] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 4987.029056] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4987.449083] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4995.865759] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 5001.830483] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:129) [ 5005.511788] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 5010.012818] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:161) [ 5016.659047] Lustre: *** cfs_fail_loc=159, val=0*** [ 5031.918319] Lustre: lustre-MDT0000: Client c33541de-f77c-4e07-848e-c3721d9a4a78 (at 192.168.204.6@tcp) reconnecting [ 5038.049871] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 5038.067352] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5038.076164] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5038.102671] Lustre: Skipped 1 previous similar message [ 5040.623628] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5040.634223] Lustre: Skipped 2 previous similar messages [ 5045.734227] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5045.745242] Lustre: Skipped 1 previous similar message [ 5050.851374] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5050.860841] Lustre: Skipped 1 previous similar message [ 5052.384598] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 5052.656450] Lustre: server umount lustre-OST0000 complete [ 5057.328475] LustreError: 146927:0:(client.c:1381:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@00000000b885017b x1872869161210112/t0(0) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 0 ref 1 fl Rpc:EWQU/200/ffffffff rc -5/-1 job:'' uid:0 gid:0 projid:4294967295 [ 5059.044838] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5059.051808] LustreError: Skipped 6 previous similar messages [ 5059.059506] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5059.079510] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5061.098225] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5063.799567] Lustre: server umount lustre-MDT0000 complete [ 5066.223391] LustreError: 147613:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5066.272729] LustreError: 147613:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 5068.570890] LustreError: 147595:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786107360 with bad export cookie 6833315135782557743 [ 5068.577370] LustreError: MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5068.589152] LustreError: 147595:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 5069.170700] Lustre: server umount lustre-MDT0001 complete [ 5084.000446] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing unload_modules_local [ 5087.658091] Key type lgssc unregistered [ 5088.019326] LNet: 151287:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5088.033270] LNetError: 151287:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5088.062285] LNet: Removed LNI 192.168.204.106@tcp [ 5089.321944] Key type .llcrypt unregistered [ 5089.324093] Key type ._llcrypt unregistered [ 5126.633243] Key type ._llcrypt registered [ 5126.636968] Key type .llcrypt registered [ 5126.866551] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local [ 5128.445992] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5128.510547] alg: No test for adler32 (adler32-zlib) [ 5129.943724] Lustre: Lustre: Build Version: 2.17.56_50_gf5ff674 [ 5130.236556] LNet: Added LNI 192.168.204.106@tcp [8/256/0/180] [ 5132.008172] Key type lgssc registered [ 5133.649740] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5143.369766] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5143.406699] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5144.896495] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5151.204926] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 5155.301126] LustreError: 152707:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5155.335846] LustreError: 152707:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 5160.437488] LustreError: 152706:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5161.985929] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5162.558987] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5167.386931] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 5176.397554] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 5184.105273] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 5192.139433] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5192.785347] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5201.408378] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 5208.114218] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:161) [ 5210.968863] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 5216.324463] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:170 to 0x280000401:193) [ 5239.005245] Lustre: lustre-MDT0001: evicting 634635b0-c37d-45f7-94f3-89af4e136e06 (at 192.168.204.6@tcp) by administrative request [ 5239.027357] Lustre: Skipped 1 previous similar message [ 5269.477265] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 5269.487919] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5269.513287] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5272.544900] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 5272.557905] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5272.561673] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5272.594847] Lustre: Skipped 1 previous similar message [ 5274.596237] Lustre: server umount lustre-OST0000 complete [ 5280.227082] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5280.237180] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5280.255237] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5282.787052] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5282.787873] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5282.808210] Lustre: Skipped 1 previous similar message [ 5285.728044] Lustre: server umount lustre-MDT0000 complete [ 5287.906117] LustreError: 152707:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5287.923417] LustreError: 152707:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 5290.448524] LustreError: 152686:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786107582 with bad export cookie 17238026213390410355 [ 5290.460849] LustreError: MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5290.901981] Lustre: server umount lustre-MDT0001 complete [ 5303.648916] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing unload_modules_local [ 5306.748795] Key type lgssc unregistered [ 5307.209345] LNet: 156786:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5307.223335] LNetError: 156786:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5307.241384] LNet: Removed LNI 192.168.204.106@tcp [ 5308.624876] Key type .llcrypt unregistered [ 5308.629289] Key type ._llcrypt unregistered [ 5396.377131] Key type ._llcrypt registered [ 5396.381229] Key type .llcrypt registered [ 5396.479922] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local [ 5397.418607] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5397.440207] alg: No test for adler32 (adler32-zlib) [ 5398.776942] Lustre: Lustre: Build Version: 2.17.56_50_gf5ff674 [ 5399.218452] LNet: Added LNI 192.168.204.106@tcp [8/256/0/180] [ 5401.048191] Key type lgssc registered [ 5402.647921] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5410.811777] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5410.835773] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5412.242930] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5417.841888] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 5421.540878] LustreError: 159288:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5421.568738] LustreError: 159288:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 5426.657833] LustreError: 159289:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5428.199434] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5428.664964] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5433.689409] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 5443.580224] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 5450.954738] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 5458.689582] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5459.256986] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5466.918388] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 5473.591234] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:193) [ 5475.941300] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 5481.784870] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:195 to 0x280000401:225) [ 5492.202832] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5492.220449] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5492.233970] Lustre: Skipped 1 previous similar message [ 5492.237909] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 5492.240386] Lustre: Skipped 1 previous similar message [ 5495.517805] Lustre: server umount lustre-OST0000 complete [ 5500.387046] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5500.400515] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5500.432496] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5502.436697] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5502.439436] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5506.752770] Lustre: server umount lustre-MDT0000 complete [ 5507.556651] LustreError: 160019:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5507.595305] LustreError: 160019:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 5510.538539] LustreError: 159268:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786107802 with bad export cookie 11586097899953615309 [ 5510.549396] LustreError: MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5510.550708] LustreError: 159268:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 5510.826772] Lustre: server umount lustre-MDT0001 complete [ 5525.103535] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing unload_modules_local [ 5528.681555] Key type lgssc unregistered [ 5529.091936] LNet: 162857:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5529.113256] LNetError: 162857:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5529.130721] LNet: Removed LNI 192.168.204.106@tcp [ 5530.626176] Key type .llcrypt unregistered [ 5530.628774] Key type ._llcrypt unregistered [ 5563.662531] Key type ._llcrypt registered [ 5563.664825] Key type .llcrypt registered [ 5563.907534] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local [ 5565.050625] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5565.196267] alg: No test for adler32 (adler32-zlib) [ 5566.305695] Lustre: Lustre: Build Version: 2.17.56_50_gf5ff674 [ 5566.744305] LNet: Added LNI 192.168.204.106@tcp [8/256/0/180] [ 5568.448259] Key type lgssc registered [ 5569.455985] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5588.367485] Lustre: DEBUG MARKER: == conf-sanity test 100: check lshowmount lists MGS, MDT, OST and 0@lo ========================================================== 09:04:37 (1786107877) [ 5608.459781] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_hostid [ 5620.553857] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local [ 5664.096629] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5664.129897] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5665.405061] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 5665.470838] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 5665.591840] Lustre: lustre-MDT0000: new disk, initializing [ 5665.665172] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5665.691166] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 5672.259735] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 5684.830979] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5685.060127] Lustre: 167122:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 5685.195712] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 5685.204839] Lustre: Skipped 1 previous similar message [ 5685.269677] Lustre: lustre-MDT0001: new disk, initializing [ 5685.385530] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5685.436697] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 5685.457942] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 5691.039401] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 5701.629609] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 5707.969367] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 5717.675069] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5718.117949] Lustre: lustre-OST0000: new disk, initializing [ 5718.124421] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 5718.133963] Lustre: 169097:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 5718.332752] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5726.919431] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 5726.941878] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 5727.390662] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 5729.498718] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 5744.117248] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 5757.929805] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 5757.937094] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5757.945919] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5757.958460] LustreError: Skipped 1 previous similar message [ 5757.972261] Lustre: Skipped 1 previous similar message [ 5763.043614] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5763.066709] Lustre: Skipped 2 previous similar messages [ 5763.797319] Lustre: server umount lustre-OST0000 complete [ 5772.259507] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5772.268726] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5772.288587] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5773.282400] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5774.607235] Lustre: server umount lustre-MDT0000 complete [ 5779.288623] LustreError: 167919:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786108071 with bad export cookie 6212622859730933728 [ 5779.293554] LustreError: MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5779.309238] LustreError: 167919:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 5780.015182] Lustre: server umount lustre-MDT0001 complete [ 5797.175330] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing unload_modules_local [ 5801.128643] Key type lgssc unregistered [ 5801.723959] LNet: 171007:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5801.744454] LNetError: 171007:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5801.777513] LNet: Removed LNI 192.168.204.106@tcp [ 5802.917397] Key type .llcrypt unregistered [ 5802.923535] Key type ._llcrypt unregistered [ 5846.843252] Key type ._llcrypt registered [ 5846.851799] Key type .llcrypt registered [ 5847.054441] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local [ 5850.450126] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5850.505898] alg: No test for adler32 (adler32-zlib) [ 5852.091437] Lustre: Lustre: Build Version: 2.17.56_50_gf5ff674 [ 5852.505087] LNet: Added LNI 192.168.204.106@tcp [8/256/0/180] [ 5854.288734] Key type lgssc registered [ 5855.934177] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5869.197647] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5869.257883] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5870.967633] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5878.768884] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 5880.295493] LustreError: 172425:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5880.333911] LustreError: 172425:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 5885.428223] LustreError: 172426:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5890.541439] LustreError: 172425:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5891.808548] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5892.536152] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5901.241666] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 5912.151406] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 5920.712210] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 5930.065516] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5930.540556] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5939.834646] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 5940.846071] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:33) [ 5951.638690] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 5959.471752] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5959.503485] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5959.522868] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5959.534616] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5959.558626] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5961.066091] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5961.098563] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5961.134043] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5961.150556] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5961.226560] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5962.353792] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5962.378078] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5962.391631] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5962.401121] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5962.409470] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5963.297952] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5964.564606] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5964.571571] Lustre: Skipped 1 previous similar message [ 5964.597067] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5964.612517] Lustre: Skipped 1 previous similar message [ 5964.617719] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5964.623540] Lustre: Skipped 1 previous similar message [ 5964.627056] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5964.639648] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5964.651021] Lustre: Skipped 1 previous similar message [ 5965.829163] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5966.896985] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5968.153555] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5969.346540] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5969.355575] Lustre: Skipped 3 previous similar messages [ 5969.381862] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5969.399837] Lustre: Skipped 3 previous similar messages [ 5969.403930] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5969.408184] Lustre: Skipped 3 previous similar messages [ 5969.412094] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5969.419923] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5969.426884] Lustre: Skipped 3 previous similar messages [ 5970.592313] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5972.375075] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5973.721745] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5975.055717] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5976.010473] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5977.446639] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5977.451449] Lustre: Skipped 5 previous similar messages [ 5977.476967] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5977.511313] Lustre: Skipped 5 previous similar messages [ 5977.523287] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5977.528422] Lustre: Skipped 5 previous similar messages [ 5977.539198] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5977.557139] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5977.569024] Lustre: Skipped 5 previous similar messages [ 5979.074053] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5980.685126] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5981.689650] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5983.298659] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5984.631664] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5986.276509] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5987.461538] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5988.844223] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5990.035842] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5991.451980] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5993.103885] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5994.208243] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5994.214485] Lustre: Skipped 11 previous similar messages [ 5994.231224] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5994.238643] Lustre: Skipped 11 previous similar messages [ 5994.243043] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5994.246410] Lustre: Skipped 11 previous similar messages [ 5994.252702] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5994.264475] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5994.274236] Lustre: Skipped 11 previous similar messages [ 5995.601154] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5997.031336] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5998.786292] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6000.621175] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6001.896900] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6003.441918] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6004.871278] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6006.291640] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6007.845851] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6009.960608] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6011.262722] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6012.593210] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6013.974751] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6015.251737] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6016.768239] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6018.561622] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6020.319125] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6021.793884] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6022.981971] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6024.182504] LustreError: 172445:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 6024.203072] LustreError: 172445:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 6024.216786] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6025.428499] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6026.866882] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 6026.887778] Lustre: Skipped 21 previous similar messages [ 6026.982988] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6027.067500] Lustre: Skipped 21 previous similar messages [ 6027.088600] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 6027.106990] Lustre: Skipped 21 previous similar messages [ 6027.117455] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6027.147500] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 6027.169497] Lustre: Skipped 21 previous similar messages [ 6029.269290] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6031.073606] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6032.180683] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6033.257342] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6034.539615] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6036.114912] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6037.718144] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6039.455625] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6040.737810] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6041.878033] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6043.406349] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6044.552712] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6046.330897] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6048.155941] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6049.927147] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6051.436968] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6052.813415] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6054.538374] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6055.609904] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6056.907609] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6058.375313] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6060.162324] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6061.460941] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6062.378306] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6063.914766] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6064.972471] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6066.230453] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6067.218628] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6068.942737] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6070.434648] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6071.873461] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6073.208679] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6074.807663] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6076.293449] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6077.511750] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6078.806192] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6080.454271] LustreError: 172445:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 6080.468476] LustreError: 172445:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 6080.494524] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6081.471168] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6082.791751] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6084.230173] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6085.470121] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6087.261211] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6088.882407] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6090.204090] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6091.317812] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 6091.328043] Lustre: Skipped 44 previous similar messages [ 6091.344053] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6091.356310] Lustre: Skipped 44 previous similar messages [ 6091.363208] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 6091.368506] Lustre: Skipped 44 previous similar messages [ 6091.372141] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6091.399582] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 6091.407468] Lustre: Skipped 44 previous similar messages [ 6092.679385] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6093.993321] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6095.373032] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6096.943594] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6098.011768] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6099.198754] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6100.724331] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6102.312319] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6103.916736] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6105.498617] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6106.758847] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6109.007784] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6110.608470] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6111.860888] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6113.853247] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6115.444844] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6117.132494] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6118.738786] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6119.888633] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6121.288546] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6122.719877] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6123.946823] LustreError: 172445:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 6123.959829] LustreError: 172445:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 6123.974399] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6125.006114] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6126.092799] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6127.787411] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6129.663739] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6131.312063] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6133.027601] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6134.587766] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6135.881184] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6136.866520] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6138.385340] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6139.850636] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6141.322407] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6142.656428] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6143.900771] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6145.260374] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6146.750994] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6148.380361] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6149.793583] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6151.197093] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6152.772412] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6154.199938] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6155.482931] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6156.631618] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6158.146163] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6159.839734] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6161.171831] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6162.424896] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6163.790693] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6165.298261] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6166.454218] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6167.973413] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6169.206184] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6170.573873] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6171.756839] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6173.327076] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6174.811419] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6176.058585] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6177.357628] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6178.799243] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6179.796721] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6180.864480] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6181.720724] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6183.018316] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6184.627363] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6186.347112] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6187.378485] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6188.509505] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6190.001809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6191.748681] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6193.600380] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6194.555689] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6196.341545] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6197.631358] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6198.898541] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6199.903048] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6201.094605] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6202.133272] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6203.313822] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6204.345642] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6205.639793] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6206.765653] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6208.160859] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6209.288504] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6210.482296] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6211.892523] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6213.181861] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6214.667629] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6216.385072] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6217.659840] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6219.092399] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6220.623814] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 6220.642760] Lustre: Skipped 92 previous similar messages [ 6220.683357] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6220.700096] Lustre: Skipped 92 previous similar messages [ 6220.709746] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 6220.720613] Lustre: Skipped 92 previous similar messages [ 6220.729418] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6220.737955] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 6220.745577] Lustre: Skipped 92 previous similar messages [ 6222.486778] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6223.735856] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6225.056673] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6226.456792] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6227.678684] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6228.786228] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6229.733285] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6230.960202] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6232.563941] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6234.245985] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6235.605326] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6236.934176] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6238.325774] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6239.644830] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6240.916688] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6242.367197] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6243.490590] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6244.352551] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6245.813887] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6246.866971] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6248.149258] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6249.467504] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6250.873990] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6252.216745] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6253.818271] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6255.045881] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6256.616320] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6258.262520] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6259.740721] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6260.871308] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6262.617785] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6264.147850] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6265.225227] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6266.279848] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6267.488939] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6268.904115] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6270.251045] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6271.521838] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6272.568193] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6273.805889] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6275.524891] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6276.949991] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6277.998844] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6279.269225] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6280.899528] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6282.288948] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6283.820378] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6285.074135] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6286.525783] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6288.464338] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6289.468872] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6291.105161] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6292.368353] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6293.963762] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6295.364401] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6296.921398] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6298.206474] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6299.630322] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6300.722589] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6301.872710] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6303.384922] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6305.007131] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6306.165264] LustreError: 172445:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 6306.175523] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6306.178135] LustreError: 172445:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 6307.947380] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6309.284812] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6310.768898] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6312.247935] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6313.402854] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6314.608638] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6315.869821] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6316.988900] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6318.269106] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6319.907888] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6321.334505] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6322.781874] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6324.269375] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6325.867750] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6327.673827] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6329.301201] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6331.208690] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6332.886946] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6334.885619] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6336.552145] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6337.954135] LustreError: 172445:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 6337.973874] LustreError: 172445:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 6337.991399] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6338.983260] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6340.216471] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6341.743822] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6342.981879] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6344.541245] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6345.682158] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6346.828241] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6347.927080] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6349.359243] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6350.742040] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6352.089832] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6353.580227] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6354.947695] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6356.033125] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6357.244232] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6358.393774] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6359.410467] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6360.582838] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6361.729628] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6363.431893] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6365.205060] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6366.901672] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6368.639338] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6369.711923] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6372.093574] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6373.233545] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6374.672918] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6375.880238] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6377.207254] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6378.421731] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6380.109460] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6381.787996] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6383.298480] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6384.601254] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6385.679522] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6386.928600] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6388.025651] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6389.501374] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6390.628703] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6392.126315] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6393.391683] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6394.809946] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6396.029658] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6397.619215] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6398.983800] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6400.581473] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6402.289557] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6403.611567] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6404.725648] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6406.425085] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6407.653959] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6409.025834] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6410.988897] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6412.487587] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6413.886975] LustreError: 172445:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 6413.894326] LustreError: 172445:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 6413.904903] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6415.306599] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6416.571282] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6417.961455] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6419.663405] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6421.285186] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6422.442304] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6423.736425] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6425.195681] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6426.660860] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6427.759119] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6429.236290] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6430.541487] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6431.412874] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6432.790593] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6434.027532] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6435.003929] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6436.363718] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6437.602013] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6438.690287] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6439.809804] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6440.586833] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6441.917880] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6442.759945] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6443.826970] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6444.755937] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6446.061985] LustreError: 172445:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 6446.077846] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6446.088282] LustreError: 172445:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 6447.130444] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6448.268826] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6449.793409] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6451.119755] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6452.696834] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6453.661083] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6455.461615] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6456.634211] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6458.178169] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6459.888190] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6461.176959] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6462.402600] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6463.774586] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6464.714851] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6465.787900] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6467.008087] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6468.068190] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6469.135263] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6470.172158] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6471.579424] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6472.791112] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6474.160413] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6475.109626] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6476.272267] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6476.906857] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 6476.913228] Lustre: Skipped 189 previous similar messages [ 6476.928955] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6476.938052] Lustre: Skipped 189 previous similar messages [ 6476.942297] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 6476.950253] Lustre: Skipped 189 previous similar messages [ 6476.953407] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6476.962722] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 6476.985237] Lustre: Skipped 189 previous similar messages [ 6478.183478] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6479.267520] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6480.283285] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6481.579523] LustreError: 172445:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 6481.595356] LustreError: 172445:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 6481.603382] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6482.776531] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6484.223328] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6485.715654] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6487.133921] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6488.484538] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6489.455096] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6490.591660] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6491.703896] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6492.886387] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6494.060735] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6495.599386] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6496.382900] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6497.802449] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6498.865566] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6499.941069] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6501.299175] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6502.522391] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6503.720572] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6505.620666] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6507.165390] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6508.325337] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6509.401908] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6510.973708] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6512.385312] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6514.069066] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6515.181687] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6516.136460] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6517.389664] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6519.000190] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6520.057530] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6521.250272] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6522.482575] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6523.822075] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6525.193055] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6526.415727] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6527.779698] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6528.917815] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6529.825483] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6531.034704] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6531.943741] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6533.712095] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6534.741655] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6535.973814] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6537.202188] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6538.433277] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6540.269115] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6541.843312] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6543.057464] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6545.308717] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6546.310329] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6547.388486] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6548.593665] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6549.756546] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6550.852123] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6552.564502] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6553.826885] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6555.511178] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6556.643266] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6557.970659] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6559.278586] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6560.418651] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6562.521600] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6563.869321] LustreError: 172445:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 6563.886870] LustreError: 172445:0:(osp_precreate.c:655:osp_precreate_send()) Skipped 1 previous similar message [ 6563.895065] LustreError: 172445:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 6563.906510] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6563.908885] LustreError: 172445:0:(osp_precreate.c:1359:osp_precreate_thread()) Skipped 1 previous similar message [ 6565.132053] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6566.683814] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6568.207992] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6569.418031] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6570.469836] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6571.535127] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6572.518467] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6574.253976] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6575.799673] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6577.222330] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6578.256668] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6579.762265] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6581.095252] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6582.477954] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6583.948427] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6585.351464] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6586.878306] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6587.854405] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6589.210516] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6590.326788] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6592.024063] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6593.502499] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6595.337731] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6597.080296] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6598.665776] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6599.649512] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6601.374068] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6602.762663] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6603.895362] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6605.091995] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6606.256670] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6607.465212] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6608.809173] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6609.975823] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6610.940622] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6612.054417] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6613.352189] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6614.892315] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6616.172797] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6617.653646] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6618.882874] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6620.551833] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6622.305320] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6623.596077] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6624.928110] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6626.117514] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6627.466765] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6628.471473] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6629.916404] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6630.912795] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6632.394627] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6633.789492] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6634.722706] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6636.071355] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6637.342201] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6638.641142] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6639.704178] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6641.050242] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6642.139391] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6643.682259] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6645.182530] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6647.105244] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6648.558503] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6649.575158] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6651.531734] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6652.773490] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6653.957248] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6655.259945] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6656.344699] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6657.677780] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6659.259203] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6660.644822] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6661.607544] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6662.932682] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6664.039596] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6665.273284] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6666.513637] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6668.128223] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6669.651576] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6670.570701] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6671.554325] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6672.946767] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6674.092846] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6674.917803] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6676.182722] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6677.182806] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6678.575355] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6679.742665] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6681.045454] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6682.071697] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6683.166181] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6684.485131] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6685.763576] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6686.689640] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6688.003455] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6688.993586] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6690.341486] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6691.568526] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6692.547641] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6693.946271] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6694.889108] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6696.400468] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6697.361304] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6699.016357] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6700.123171] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6701.122255] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6702.199985] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6703.090838] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6704.208248] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6705.374458] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6706.552965] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6707.936383] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6709.340962] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6710.764319] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6711.671828] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6713.121254] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6714.304847] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6715.289137] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6716.707628] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6718.215503] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6719.930604] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6721.234732] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6722.699846] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6724.532933] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6725.843805] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6727.147708] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6728.113295] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6729.295996] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6730.331965] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6731.523672] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6732.538258] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6733.820450] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6734.980716] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6736.176203] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6737.715342] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6738.976785] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6740.019636] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6741.292830] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6742.466171] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6743.391469] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6744.831145] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6746.251482] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6747.491085] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6748.757475] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6749.824276] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6751.133898] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6752.786037] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6754.205576] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6755.201521] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6756.447520] LustreError: 172445:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 6756.458042] LustreError: 172445:0:(osp_precreate.c:655:osp_precreate_send()) Skipped 2 previous similar messages [ 6756.465788] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6756.470976] LustreError: 172445:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 6756.470988] LustreError: 172445:0:(osp_precreate.c:1359:osp_precreate_thread()) Skipped 2 previous similar messages [ 6757.949150] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6759.205367] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6760.411293] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6761.542308] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6762.518785] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6763.778184] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6765.044356] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6766.368548] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6767.288628] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6768.527077] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6769.425479] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6770.584299] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6771.364711] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6772.563616] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6773.564668] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6774.811618] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6775.688348] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6776.988713] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6778.034655] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6779.097776] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6779.969860] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6781.136300] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6782.017699] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6783.194823] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6784.064738] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6785.073244] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6785.755439] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6786.504831] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6787.227519] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6788.364892] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6789.501820] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6790.843276] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6792.190990] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6793.518876] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6794.693926] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6795.909510] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6796.929759] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6798.018282] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6798.883349] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6800.242544] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6801.294986] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6802.670163] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6803.599533] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6804.787240] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6805.636829] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6806.921441] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6807.909298] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6808.973786] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6810.334981] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6811.275541] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6812.492427] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6813.471664] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6814.476327] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6815.539191] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6816.577641] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6817.800650] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6819.163353] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6820.325991] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6821.308070] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6822.257219] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6823.141601] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6824.318221] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6825.403818] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6826.289119] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6827.268574] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6828.299735] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6829.259137] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6830.529657] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6831.538976] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6832.650564] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6833.887309] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6834.943155] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6835.824961] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6836.994608] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6837.829660] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6838.864577] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6839.690136] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6840.948795] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6841.959442] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6842.996661] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6843.871365] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6845.046071] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6846.249527] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6847.466276] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6848.657288] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6849.759303] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6851.042710] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6852.132828] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6853.363538] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6854.286721] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6855.783093] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6856.785289] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6858.229889] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6859.672752] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6860.706885] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6861.975104] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6863.046129] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6864.135973] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6865.180653] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6866.300167] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6867.247610] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6868.532345] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6869.507659] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6870.586532] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6871.494543] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6872.449170] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6873.339919] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6874.255841] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6875.045487] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6876.027745] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6876.861564] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6878.275724] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6879.430154] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6880.275578] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6881.199497] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6882.147825] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6883.256279] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6884.200981] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6885.226367] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6886.089909] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6886.993717] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6887.830462] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6889.049905] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6889.846672] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6891.058319] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6891.968777] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6893.293573] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6894.150388] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6895.069925] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6895.855492] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6896.915732] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6898.083512] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6898.865658] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6899.954466] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6901.020466] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6902.048805] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6903.208503] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6904.408525] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6905.155150] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6907.029300] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6908.038433] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6909.209228] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6910.290131] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6911.328467] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6912.634815] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6913.792833] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6914.711358] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6916.032067] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6917.087317] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6918.310172] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6919.300644] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6920.506298] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6921.252352] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6922.477532] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6923.231824] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6924.303896] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6925.272360] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6926.402847] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6927.300175] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6928.356428] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6929.220695] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6930.090537] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6930.811483] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6931.858321] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6932.842953] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6933.954973] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6934.773147] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6935.768959] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6936.572958] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6937.597187] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6938.325539] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6939.231218] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6940.042775] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6940.884201] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6941.585906] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6942.321559] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6943.028599] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6943.761525] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6944.654924] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6945.559619] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6946.367080] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6947.195942] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6948.005217] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6948.744600] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6950.012500] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6950.814391] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6951.906344] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6952.721968] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6953.666494] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6954.561150] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6955.494809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6956.378204] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6957.741547] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6958.602430] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6959.848606] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6960.704699] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6962.044416] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6962.827758] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6963.726164] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6964.406762] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6965.216899] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6966.070950] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6967.343157] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6968.637676] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6969.692641] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6970.536215] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6971.640812] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6973.773982] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6975.836629] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6977.276755] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6978.986923] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6980.934918] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6982.140389] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6983.802715] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6985.489158] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6987.069113] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6988.702387] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6989.981833] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 6989.988840] Lustre: Skipped 434 previous similar messages [ 6990.004925] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6990.012780] Lustre: Skipped 434 previous similar messages [ 6990.020691] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 6990.025798] Lustre: Skipped 434 previous similar messages [ 6990.029754] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6990.038324] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 6990.052207] Lustre: Skipped 434 previous similar messages [ 6991.345294] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6993.038088] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6994.782528] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6996.118680] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6997.618499] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6999.051957] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7000.498965] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7001.391689] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7002.843619] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7005.066112] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7007.348754] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7009.812615] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7012.004171] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7014.316376] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7015.956966] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7017.450497] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7018.797977] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7020.121709] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7021.871952] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7023.440213] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7024.964597] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7026.397187] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7027.738183] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7029.271613] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7030.786832] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7032.161613] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7033.451948] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7034.731209] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7036.042346] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7037.178933] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7039.491299] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7040.950225] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7042.443138] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7043.882599] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7045.052261] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7046.590451] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7048.028538] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7049.137591] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7050.797914] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7052.736293] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7054.385244] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7055.744565] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7057.316948] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7058.744509] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7060.471845] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7061.754353] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7062.648178] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7063.903485] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7064.949180] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7066.318781] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7067.797851] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7069.144147] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7070.453563] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7072.019580] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7073.733924] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7074.859817] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7076.123701] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7077.251290] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7078.314868] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7079.539947] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7080.865785] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7081.902429] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7083.208862] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7084.389475] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7085.486805] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7086.321136] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7087.882194] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7089.714665] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7090.961746] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7092.240533] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7093.498615] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7094.692565] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7096.127984] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7097.560326] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7098.785137] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7100.021280] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7101.396086] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7102.683774] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7104.252928] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7106.088593] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7107.105939] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7108.131137] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7109.448504] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7110.940508] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7111.957330] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7113.296727] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7114.601491] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7116.276597] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7117.885208] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7119.958114] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7121.417421] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7122.852980] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7124.377951] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7125.697778] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7126.744859] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7128.149155] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7129.133350] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7130.338731] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7131.585233] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7132.628630] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7134.445734] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7135.346486] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7136.944271] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7138.555808] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7140.136878] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7141.542295] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7142.967366] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7144.194535] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7145.465964] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7146.995245] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7148.655119] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7149.534275] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7150.876144] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7152.134917] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7153.568567] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7154.940098] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7156.195030] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7157.580471] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7158.641251] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7159.747335] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7161.016218] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7162.323829] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7163.536414] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7165.058586] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7166.352337] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7167.920206] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7169.106288] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7170.217805] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7171.889963] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7173.150892] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7174.507161] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7175.783715] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7177.100631] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7178.083608] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7179.463407] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7180.614807] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7181.792593] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7182.712392] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7183.668879] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7184.591615] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7185.848880] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7186.932131] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7188.136548] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7189.347658] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7190.264067] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7191.567517] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7192.693799] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7193.550308] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7194.655608] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7195.791187] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7197.318842] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7199.268527] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7200.200550] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7201.494091] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7202.705089] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7203.833115] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7205.347237] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7206.694303] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7208.050911] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7209.490657] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7210.628366] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7212.101536] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7213.569979] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7215.097934] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7216.863288] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7218.245166] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7219.628400] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7220.887061] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7222.208425] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7223.248689] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7224.639316] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7226.135850] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7227.537324] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7228.969462] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7230.443385] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7231.619717] LustreError: 172445:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 7231.631774] LustreError: 172445:0:(osp_precreate.c:655:osp_precreate_send()) Skipped 2 previous similar messages [ 7231.634769] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7231.643201] LustreError: 172445:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 7231.643214] LustreError: 172445:0:(osp_precreate.c:1359:osp_precreate_thread()) Skipped 2 previous similar messages [ 7232.784883] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7233.868649] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7234.960702] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7236.106954] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7237.028126] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7238.287347] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7239.485460] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7240.581370] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7241.650777] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7242.534044] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7243.556237] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7244.807786] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7679.881298] LustreError: 174251:0:(ofd_dev.c:1780:ofd_create_hdl()) lustre-OST0000: unable to precreate: rc = -28 [ 8330.726640] LustreError: lustre-OST0000-osc-MDT0000: operation ost_destroy to node 0@lo failed: rc = -107 [ 8330.733670] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8330.738976] LustreError: Skipped 2 previous similar messages [ 8330.758924] Lustre: Skipped 188 previous similar messages [ 8330.760953] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8332.302484] Lustre: server umount lustre-OST0000 complete [ 8339.948762] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8339.951217] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8339.953697] LustreError: Skipped 2 previous similar messages [ 8339.968060] Lustre: Skipped 1 previous similar message [ 8342.016389] Lustre: server umount lustre-MDT0000 complete [ 8345.066541] LustreError: 172425:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8345.103597] LustreError: 172425:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 8346.091535] LustreError: 172405:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786110637 with bad export cookie 10563814675894824750 [ 8346.097733] LustreError: MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8346.118837] LustreError: 172405:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 8355.413626] Lustre: server umount lustre-MDT0001 complete [ 8363.984061] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing unload_modules_local [ 8366.428756] Key type lgssc unregistered [ 8366.665803] LNet: 227750:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8366.674612] LNetError: 227750:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8366.692603] LNet: Removed LNI 192.168.204.106@tcp [ 8367.310650] Key type .llcrypt unregistered [ 8367.312312] Key type ._llcrypt unregistered [ 8388.872787] Key type ._llcrypt registered [ 8388.877663] Key type .llcrypt registered [ 8388.987397] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local [ 8389.926751] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8389.949703] alg: No test for adler32 (adler32-zlib) [ 8390.907545] Lustre: Lustre: Build Version: 2.17.56_50_gf5ff674 [ 8391.091599] LNet: Added LNI 192.168.204.106@tcp [8/256/0/180] [ 8392.720217] Key type lgssc registered [ 8393.627965] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8399.347453] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 8399.368483] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8400.710834] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8404.141350] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 8410.901403] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8411.106908] Lustre: lustre-MDT0001: Not available for connect from 0@lo (not set up) [ 8411.229444] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8415.764290] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 8422.360332] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 8427.056905] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 8432.700274] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8433.023937] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8438.670369] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 8444.650846] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 8445.293688] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49665 to 0x280000401:49696) [ 8449.607329] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 8450.963385] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8450.974026] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 8450.981584] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 8450.988837] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 8450.993965] LustreError: 229188:0:(osp_precreate.c:1268:osp_precreate_thread()) cfs_fail_timeout id 2107 sleeping for 20000ms [ 8452.537112] Lustre: lustre-OST0000: Not available for connect from 192.168.204.6@tcp (stopping) [ 8455.651680] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8455.656959] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8455.661842] Lustre: Skipped 1 previous similar message [ 8458.575317] Lustre: server umount lustre-OST0000 complete [ 8471.032410] LustreError: 229188:0:(osp_precreate.c:1268:osp_precreate_thread()) cfs_fail_timeout id 2107 awake [ 8490.868900] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8491.091748] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8496.231457] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 8496.247565] LustreError: lustre-OST0000-osc-MDT0001: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 8496.252750] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 8496.273787] Lustre: Skipped 1 previous similar message [ 8496.352799] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 8501.756651] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 8509.303491] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 6 sec [ 8513.658958] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff9a529035d800.ost_server_uuid 50 [ 8514.853633] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff9a529035d800.ost_server_uuid in FULL state after 0 sec [ 8520.163191] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 8520.167229] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8520.179264] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8520.184077] Lustre: Skipped 2 previous similar messages [ 8522.214455] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8522.214618] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 8523.709786] Lustre: server umount lustre-OST0000 complete [ 8527.331992] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8527.335512] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8527.342327] Lustre: Skipped 1 previous similar message [ 8527.346426] Lustre: Skipped 2 previous similar messages [ 8532.501814] Lustre: server umount lustre-MDT0000 complete [ 8535.101660] LustreError: 232395:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786110826 with bad export cookie 10495872071001479364 [ 8535.103667] LustreError: MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8535.116602] LustreError: 232395:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 8535.313619] Lustre: server umount lustre-MDT0001 complete [ 8543.254490] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing unload_modules_local [ 8545.278649] Key type lgssc unregistered [ 8545.488819] LNet: 234376:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8545.498660] LNetError: 234376:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8545.512468] LNet: Removed LNI 192.168.204.106@tcp [ 8546.121470] Key type .llcrypt unregistered [ 8546.124140] Key type ._llcrypt unregistered [ 8568.892984] Key type ._llcrypt registered [ 8568.895161] Key type .llcrypt registered [ 8568.981746] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local [ 8569.709696] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8569.725846] alg: No test for adler32 (adler32-zlib) [ 8570.752446] Lustre: Lustre: Build Version: 2.17.56_50_gf5ff674 [ 8570.927352] LNet: Added LNI 192.168.204.106@tcp [8/256/0/180] [ 8572.568875] Key type lgssc registered [ 8573.587572] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8580.674564] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 8580.697229] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8581.985236] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8585.206259] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 8591.337245] LustreError: 236083:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8591.353484] LustreError: 236083:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 8591.700663] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8591.960489] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8595.275243] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 8597.483506] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 8601.660526] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8601.879130] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8605.500132] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 8607.020392] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49728) [ 8610.944866] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8611.122070] Lustre: lustre-OST0001: new disk, initializing [ 8611.125366] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 8611.132102] Lustre: 238396:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8611.216848] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 8615.726436] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 8616.447654] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 8616.459056] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 8616.510322] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 8625.208419] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 8629.450786] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 8640.377797] Lustre: server umount lustre-MDT0000 complete [ 8641.003542] LustreError: lustre-MDT0000-osp-MDT0001: operation out_update to node 0@lo failed: rc = -107 [ 8641.009624] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8641.027886] LustreError: 236082:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8642.027591] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8642.034685] LustreError: 236078:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8642.039922] Lustre: Skipped 1 previous similar message [ 8642.053560] LustreError: 236078:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 8642.983124] LustreError: 236065:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786110934 with bad export cookie 2252794091668125979 [ 8642.986357] LustreError: MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8642.992041] LustreError: 236065:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 8643.005545] LustreError: 236818:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0000-osp-MDT0001: osp_attr_get update error [0x200001b72:0x1:0x0]: rc = -5 [ 8643.223467] Lustre: server umount lustre-MDT0001 complete [ 8655.401930] Lustre: server umount lustre-OST0000 complete [ 8667.586127] Lustre: server umount lustre-OST0001 complete [ 8683.646096] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local [ 8691.566233] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8691.919885] LustreError: 241503:0:(ldlm_lib.c:1192:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8691.939468] LustreError: 241503:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 8692.001415] Lustre: mylustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8695.261585] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 8697.316601] LustreError: 241504:0:(ldlm_lib.c:1192:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8701.329944] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8701.575828] Lustre: mylustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8704.912861] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 8707.334630] Lustre: 242644:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 8712.665652] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8716.974671] LustreError: 242997:0:(ldlm_lib.c:1192:target_handle_connect()) mylustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8716.988505] LustreError: 242997:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 8716.989612] Lustre: mylustre-OST0000: new connection from mylustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49760) [ 8717.494470] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 8723.744340] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8723.913322] Lustre: mylustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 8723.918571] Lustre: Skipped 1 previous similar message [ 8727.051606] Lustre: mylustre-OST0000: new connection from mylustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:100 to 0x280000400:129) [ 8728.896073] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 8735.355873] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 8738.336868] Lustre: 244514:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 8747.493648] LustreError: mylustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8747.495213] Lustre: mylustre-MDT0000-lwp-OST0001: Connection to mylustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8747.499134] Lustre: mylustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8747.513155] Lustre: Skipped 3 previous similar messages [ 8748.011709] Lustre: server umount mylustre-MDT0000 complete [ 8750.663811] LustreError: 241480:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786111042 with bad export cookie 2252794091668128814 [ 8750.669721] LustreError: MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8750.681708] LustreError: 241480:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 8752.610088] LustreError: 241498:0:(ldlm_lib.c:1192:target_handle_connect()) mylustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8752.615102] Lustre: mylustre-MDT0001-lwp-OST0001: Connection to mylustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8752.616852] Lustre: mylustre-MDT0001: Not available for connect from 0@lo (stopping) [ 8752.616859] Lustre: Skipped 3 previous similar messages [ 8752.624154] LustreError: 241498:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 8752.647316] Lustre: Skipped 2 previous similar messages [ 8753.005825] Lustre: server umount mylustre-MDT0001 complete [ 8758.303148] Lustre: server umount mylustre-OST0000 complete [ 8761.253582] Lustre: server umount mylustre-OST0001 complete [ 8776.271298] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local [ 8783.857104] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8784.223870] Lustre: tfs-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8787.502853] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 8789.479464] LustreError: 246818:0:(ldlm_lib.c:1192:target_handle_connect()) tfs-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8789.494467] LustreError: 246818:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 8793.748094] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8797.283343] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 8799.486126] Lustre: 247959:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 8804.216474] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8808.571186] Lustre: tfs-OST0000: new connection from tfs-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49792) [ 8808.652248] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 8814.558755] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8818.980970] Lustre: tfs-OST0000: new connection from tfs-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:131 to 0x280000400:161) [ 8819.408436] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 8825.170329] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 8827.853253] Lustre: 249826:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 8834.534627] Lustre: tfs-MDT0000-lwp-MDT0001: Connection to tfs-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8834.541725] Lustre: tfs-MDT0000: Not available for connect from 0@lo (stopping) [ 8834.558368] Lustre: Skipped 3 previous similar messages [ 8834.562010] Lustre: Skipped 3 previous similar messages [ 8838.619795] Lustre: server umount tfs-MDT0000 complete [ 8841.366968] LustreError: 247562:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786111133 with bad export cookie 2252794091668130767 [ 8841.370022] LustreError: MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8841.376564] LustreError: 247562:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 8841.631038] Lustre: server umount tfs-MDT0001 complete [ 8855.102933] Lustre: server umount tfs-OST0000 complete [ 8867.935721] Lustre: server umount tfs-OST0001 complete [ 8881.809426] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local [ 8888.174894] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8888.443297] LustreError: 252074:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8888.460092] LustreError: 252074:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 7 previous similar messages [ 8888.517748] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8888.524901] Lustre: Skipped 3 previous similar messages [ 8890.944580] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 8896.285044] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8899.219268] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 8901.092375] Lustre: 253213:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 8905.350422] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8906.622642] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:131 to 0x280000400:193) [ 8909.709600] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 8913.909648] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49824) [ 8915.722934] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8920.332608] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 8926.279193] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 8928.917772] Lustre: 255082:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 8933.341899] Lustre: DEBUG MARKER: == conf-sanity test 104a: Make sure user defined options are reflected in mount ========================================================== 10:00:23 (1786111223) [ 8947.682771] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8947.694173] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8947.711397] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8947.716147] Lustre: Skipped 1 previous similar message [ 8951.778562] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8953.376569] Lustre: server umount lustre-MDT0000 complete [ 8955.658786] LustreError: 252048:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786111247 with bad export cookie 2252794091668132461 [ 8955.664102] LustreError: MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8955.667399] LustreError: 252048:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 8960.929874] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 8960.933960] Lustre: Skipped 6 previous similar messages [ 8961.927611] Lustre: server umount lustre-MDT0001 complete [ 8970.462844] Lustre: server umount lustre-OST0000 complete [ 8979.286139] Lustre: server umount lustre-OST0001 complete [ 8983.862319] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_hostid [ 8991.781804] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local [ 9015.057678] LDISKFS-fs (dm-0): Mount option "noacl" will be removed by 3.5 [ 9015.057678] Contact linux-ldiskfs@vger.kernel.org if you think we should keep it. [ 9015.057678] [ 9015.079728] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: acl,user_xattr,errors=remount-ro,noacl,no_mbcache,nodelalloc [ 9015.228150] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 9015.254883] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 9015.319162] Lustre: lustre-MDT0000: new disk, initializing [ 9015.370499] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 9018.471780] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 9025.711673] LDISKFS-fs (dm-1): Mount option "noacl" will be removed by 3.5 [ 9025.711673] Contact linux-ldiskfs@vger.kernel.org if you think we should keep it. [ 9025.711673] [ 9025.739135] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: acl,user_xattr,errors=remount-ro,noacl,no_mbcache,nodelalloc [ 9025.818137] Lustre: 258275:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 9025.866866] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 9025.871059] Lustre: Skipped 1 previous similar message [ 9025.917384] Lustre: lustre-MDT0001: new disk, initializing [ 9025.989580] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9025.993322] Lustre: Skipped 4 previous similar messages [ 9026.017044] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 9026.032190] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 9028.692312] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 9035.317708] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9035.496946] Lustre: lustre-OST0000: new disk, initializing [ 9035.500112] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 9035.504777] Lustre: 259859:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 9036.820090] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 9036.826052] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 9036.900283] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 9039.123379] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 9046.216383] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9046.340678] Lustre: lustre-OST0001: new disk, initializing [ 9046.344469] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 9046.348283] Lustre: 260727:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 9048.441801] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 9048.454699] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 9048.512899] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 9050.099423] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 9057.176639] Lustre: DEBUG MARKER: == conf-sanity test 104b: Mount uses last flock argument ========================================================== 10:02:27 (1786111347) [ 9065.164571] Lustre: DEBUG MARKER: == conf-sanity test 105: check file creation for ro and rw bind mnt pt ========================================================== 10:02:35 (1786111355) [ 9079.271662] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9079.274132] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9079.277800] Lustre: Skipped 6 previous similar messages [ 9079.285203] Lustre: Skipped 1 previous similar message [ 9092.064135] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 9092.144406] Lustre: server umount lustre-OST0000 complete [ 9094.635239] LustreError: 259842:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9094.647931] LustreError: 259842:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 10 previous similar messages [ 9097.699482] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 9101.288368] Lustre: server umount lustre-MDT0000 complete [ 9104.032323] LustreError: 259070:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786111395 with bad export cookie 2252794091668134015 [ 9104.035652] LustreError: MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9104.041450] LustreError: 259070:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 9110.344131] Lustre: server umount lustre-MDT0001 complete [ 9117.999675] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing unload_modules_local [ 9191.597830] Lustre: server umount lustre-OST0001 complete [ 9198.262830] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_hostid [ 9218.619532] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local [ 9280.658050] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9281.313448] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 9281.403896] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 9281.540387] Lustre: lustre-MDT0000: new disk, initializing [ 9281.727258] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 9292.658933] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 9307.113879] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9307.326087] Lustre: 265524:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 9307.402736] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 9307.407588] Lustre: Skipped 1 previous similar message [ 9307.490669] Lustre: lustre-MDT0001: new disk, initializing [ 9307.622814] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9307.637140] Lustre: Skipped 3 previous similar messages [ 9307.721393] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 9307.739715] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 9313.262414] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 9325.512161] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 9333.420923] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 9342.547987] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9342.854751] Lustre: lustre-OST0000: new disk, initializing [ 9342.859151] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 9342.867662] Lustre: 267498:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 9344.256441] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 9344.273988] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 9344.533943] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 9353.090608] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 9364.303200] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 9375.211019] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 9375.217689] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9375.220444] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9375.220453] Lustre: Skipped 10 previous similar messages [ 9375.237128] LustreError: Skipped 1 previous similar message [ 9375.276477] Lustre: Skipped 5 previous similar messages [ 9377.128139] Lustre: server umount lustre-OST0000 complete [ 9384.419938] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 9388.491215] Lustre: server umount lustre-MDT0000 complete [ 9390.572607] LustreError: 265537:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9390.607557] LustreError: 265537:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 4 previous similar messages [ 9393.708526] LustreError: 268307:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786111685 with bad export cookie 2252794091668135485 [ 9393.712269] LustreError: MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9393.718220] LustreError: 268307:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 9394.004277] Lustre: server umount lustre-MDT0001 complete [ 9407.491859] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing unload_modules_local [ 9411.127953] Key type lgssc unregistered [ 9411.433098] LNet: 269265:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 9411.448305] LNetError: 269265:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 9412.521508] LNet: Removed LNI 192.168.204.106@tcp [ 9413.521178] Key type .llcrypt unregistered [ 9413.522983] Key type ._llcrypt unregistered [ 9445.506521] Key type ._llcrypt registered [ 9445.511150] Key type .llcrypt registered [ 9445.682891] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local [ 9447.349051] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 9447.402076] alg: No test for adler32 (adler32-zlib) [ 9448.633403] Lustre: Lustre: Build Version: 2.17.56_50_gf5ff674 [ 9448.853079] LNet: Added LNI 192.168.204.106@tcp [8/256/0/180] [ 9450.568195] Key type lgssc registered [ 9452.225862] Lustre: Echo OBD driver; http://www.lustre.org/ [ 9462.071997] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 9462.111175] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9463.694400] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9468.726292] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 9474.022297] LustreError: 270730:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9474.056104] LustreError: 270730:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 9478.835328] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9479.140911] Lustre: lustre-MDT0001: Not available for connect from 0@lo (not set up) [ 9479.269955] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9484.334287] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 9492.743806] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 9499.582647] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 9506.846830] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9507.160965] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9509.244781] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:33) [ 9513.688905] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 9522.563963] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 9524.259867] Lustre: Setting parameter lustre-OST0000.ost.unknown_param=50 in log lustre-OST0000 [ 9528.806110] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 9528.813159] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9528.821861] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9528.880946] Lustre: Skipped 1 previous similar message [ 9532.836555] Lustre: server umount lustre-OST0000 complete [ 9539.046325] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9539.064220] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9539.074813] Lustre: Skipped 2 previous similar messages [ 9544.164515] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9544.177147] Lustre: Skipped 1 previous similar message [ 9549.283580] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9549.306196] Lustre: Skipped 1 previous similar message [ 9552.352147] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 9552.720532] Lustre: server umount lustre-MDT0000 complete [ 9554.412471] LustreError: 270730:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9554.467652] LustreError: 270730:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 9558.364273] LustreError: 270712:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786111850 with bad export cookie 8314518311012070942 [ 9558.367252] LustreError: MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9558.376750] LustreError: 270712:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 9558.736606] Lustre: server umount lustre-MDT0001 complete [ 9573.767036] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing unload_modules_local [ 9578.022848] Key type lgssc unregistered [ 9578.301366] LNet: 274317:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 9578.312212] LNetError: 274317:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 9578.333454] LNet: Removed LNI 192.168.204.106@tcp [ 9579.803165] Key type .llcrypt unregistered [ 9579.804864] Key type ._llcrypt unregistered [ 9604.591477] Key type ._llcrypt registered [ 9604.596324] Key type .llcrypt registered [ 9604.831746] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local [ 9607.382545] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 9607.532111] alg: No test for adler32 (adler32-zlib) [ 9608.761427] Lustre: Lustre: Build Version: 2.17.56_50_gf5ff674 [ 9609.077367] LNet: Added LNI 192.168.204.106@tcp [8/256/0/180] [ 9610.832911] Key type lgssc registered [ 9612.666751] Lustre: Echo OBD driver; http://www.lustre.org/ [ 9624.677447] Lustre: lustre-OST0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 9624.713912] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9640.480678] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 9645.601319] LustreError: 275514:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.204.106@tcp: failed processing log, type 4: rc = -110 [ 9672.289422] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9679.098889] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 9686.941760] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 9689.415619] Lustre: server umount lustre-OST0000 complete [ 9708.456640] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing unload_modules_local [ 9711.671669] Key type lgssc unregistered [ 9711.973933] LNet: 277149:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 9711.985619] LNetError: 277149:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 9712.001849] LNet: Removed LNI 192.168.204.106@tcp [ 9712.797980] Key type .llcrypt unregistered [ 9712.802933] Key type ._llcrypt unregistered [ 9757.628382] Key type ._llcrypt registered [ 9757.631852] Key type .llcrypt registered [ 9757.761907] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local [ 9758.955743] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 9759.027829] alg: No test for adler32 (adler32-zlib) [ 9760.143099] Lustre: Lustre: Build Version: 2.17.56_50_gf5ff674 [ 9760.342497] LNet: Added LNI 192.168.204.106@tcp [8/256/0/180] [ 9761.968512] Key type lgssc registered [ 9763.232801] Lustre: Echo OBD driver; http://www.lustre.org/ [ 9776.640932] loop0: detected capacity change from 0 to 204800000 [ 9776.858377] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 9776.877301] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 9777.360756] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 9778.427513] loop0: detected capacity change from 0 to 204800000 [ 9778.628811] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 9778.637934] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 9778.909284] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 9779.861226] loop0: detected capacity change from 0 to 204800000 [ 9780.107476] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 9780.121583] blk_update_request: operation not supported error, dev loop0, sector 8224 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 9780.195587] blk_update_request: operation not supported error, dev loop0, sector 58264 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 9781.374793] loop0: detected capacity change from 0 to 204800000 [ 9781.533761] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 9782.605130] loop0: detected capacity change from 0 to 204800000 [ 9782.637952] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 9786.392246] loop0: detected capacity change from 0 to 204800000 [ 9786.422768] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 9790.490254] loop0: detected capacity change from 0 to 204800000 [ 9790.522948] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 9794.732756] loop0: detected capacity change from 0 to 204800000 [ 9794.759583] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 9799.159756] loop0: detected capacity change from 0 to 204800000 [ 9799.322366] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 9799.393697] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9799.475269] Lustre: 280581:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 9799.493633] Lustre: 280581:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000003:0xc:0x0]: rc = 0 [ 9799.503825] Lustre: 280581:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000-MDT0000' with [0x200000005:0x3:0x0]: rc = 0 [ 9799.511213] Lustre: 280581:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000003:0xb:0x0]: rc = 0 [ 9799.518738] Lustre: 280581:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000003:0xa:0x0]: rc = 0 [ 9799.526838] Lustre: 280581:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000-MDT0000' with [0x200000005:0x2:0x0]: rc = 0 [ 9799.536928] Lustre: 280581:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000-MDT0000' with [0x200000005:0x1:0x0]: rc = 0 [ 9799.544536] Lustre: 280581:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index 'nodemap' with [0x200000003:0x3:0x0]: rc = 0 [ 9799.554792] Lustre: 280581:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1020000' with [0x200000006:0x1020000:0x0]: rc = 0 [ 9799.572486] Lustre: 280581:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x20000' with [0x200000006:0x20000:0x0]: rc = 0 [ 9799.598755] Lustre: 280581:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2020000' with [0x200000006:0x2020000:0x0]: rc = 0 [ 9799.612234] Lustre: 280581:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000006:0x2010000:0x0]: rc = 0 [ 9799.621222] Lustre: 280581:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000006:0x1010000:0x0]: rc = 0 [ 9799.631380] Lustre: 280581:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000006:0x10000:0x0]: rc = 0 [ 9805.802613] Lustre: server umount MGS complete [ 9806.768926] loop0: detected capacity change from 0 to 204800000 [ 9806.901812] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9807.539534] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9807.618361] Lustre: lustre-MDT0000: Aborting client recovery [ 9809.047652] loop1: detected capacity change from 0 to 204800000 [ 9809.319668] LDISKFS-fs (loop1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9809.472415] Lustre: 281015:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 9809.487552] Lustre: 281015:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x2010000' with [0x200000003:0x6:0x0]: rc = 0 [ 9809.496888] Lustre: 281015:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x10000' with [0x200000003:0x4:0x0]: rc = 0 [ 9809.505144] Lustre: 281015:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x2010000-MDT0001' with [0x200000005:0x3:0x0]: rc = 0 [ 9809.513794] Lustre: 281015:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x10000-MDT0001' with [0x200000005:0x1:0x0]: rc = 0 [ 9809.522721] Lustre: 281015:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x1010000-MDT0001' with [0x200000005:0x2:0x0]: rc = 0 [ 9809.530667] Lustre: 281015:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x1010000' with [0x200000003:0x5:0x0]: rc = 0 [ 9809.546960] Lustre: Found index 1 for lustre-MDT0001, updating log [ 9809.695483] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9809.757573] Lustre: lustre-MDT0001: Aborting client recovery [ 9810.861184] loop2: detected capacity change from 0 to 204800000 [ 9811.087451] LDISKFS-fs (loop2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9811.281522] Lustre: 281093:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 9811.299203] Lustre: 281093:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x20000-OST0000' with [0x200000005:0x1:0x0]: rc = 0 [ 9811.332757] Lustre: 281093:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x1020000-OST0000' with [0x200000005:0x2:0x0]: rc = 0 [ 9811.346763] Lustre: 281093:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 9811.366532] Lustre: 281093:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x2020000-OST0000' with [0x200000005:0x3:0x0]: rc = 0 [ 9811.380941] Lustre: 281093:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 9811.393765] Lustre: 281093:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 9811.524365] Lustre: Found index 0 for lustre-OST0000, updating log [ 9811.560053] Lustre: 281112:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 9811.610088] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9811.663565] Lustre: lustre-OST0000: Aborting recovery [ 9812.576666] loop3: detected capacity change from 0 to 204800000 [ 9812.763474] LDISKFS-fs (loop3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9812.893583] Lustre: 281178:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 9812.909891] Lustre: 281178:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x2020000-OST0001' with [0x200000005:0x3:0x0]: rc = 0 [ 9812.944049] Lustre: 281178:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 9812.955237] Lustre: 281178:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x20000-OST0001' with [0x200000005:0x1:0x0]: rc = 0 [ 9812.966816] Lustre: 281178:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x1020000-OST0001' with [0x200000005:0x2:0x0]: rc = 0 [ 9812.986658] Lustre: 281178:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 9813.007588] Lustre: 281178:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 9813.040956] Lustre: Found index 1 for lustre-OST0001, updating log [ 9813.070552] Lustre: 281184:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 9813.175501] Lustre: lustre-OST0001: Aborting recovery [ 9818.287711] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 9818.288758] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 9818.342244] LustreError: 280959:0:(lod_dev.c:511:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 11, retries 0, failed: rc = -108 [ 9818.358652] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000bd0 [ 9818.394746] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000bd0 [ 9819.305222] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:5 to 0x280000400:33) [ 9819.311284] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:5 to 0x2c0000400:33) [ 9822.291992] LustreError: 280926:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0000: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0000 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0000/identity_upcall, time 1301us: rc = -2 [ 9822.804164] LustreError: 280927:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0000: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0000 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0000/identity_upcall, time 777us: rc = -2 [ 9822.815766] LustreError: 280927:0:(mdt_identity.c:115:mdt_identity_do_upcall()) Skipped 22 previous similar messages [ 9835.489984] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 9835.498438] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9835.514352] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9840.096871] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9840.101091] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9840.113679] Lustre: Skipped 2 previous similar messages [ 9840.126258] Lustre: Skipped 3 previous similar messages [ 9841.886682] Lustre: server umount lustre-MDT0000 complete [ 9843.069344] LustreError: 280909:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786112134 with bad export cookie 10761333242541117808 [ 9843.095469] LustreError: MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9843.098816] LustreError: 280909:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 9845.216665] LustreError: 280925:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9845.217172] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9845.217994] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 9845.231726] LustreError: 280925:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [ 9845.276405] Lustre: Skipped 1 previous similar message [ 9848.224826] LustreError: 281121:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9848.227035] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 9848.245169] LustreError: 281121:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 9848.267506] Lustre: Skipped 2 previous similar messages [ 9849.629769] Lustre: server umount lustre-MDT0001 complete [ 9865.184179] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 9865.346398] Lustre: server umount lustre-OST0000 complete [ 9873.086274] Lustre: server umount lustre-OST0001 complete [ 9885.223452] Lustre: DEBUG MARKER: == conf-sanity test 109a: test lctl clear_conf fsname ==== 10:16:14 (1786112174) [ 9920.185895] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_hostid [ 9933.828898] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local [ 9978.332158] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9978.678214] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 9978.706589] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 9978.772360] Lustre: lustre-MDT0000: new disk, initializing [ 9978.844660] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9978.855519] Lustre: Skipped 1 previous similar message [ 9978.874717] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 9984.608562] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [ 9997.110131] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9997.441194] Lustre: 285258:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 9997.571384] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 9997.578946] Lustre: Skipped 1 previous similar message [ 9997.670990] Lustre: lustre-MDT0001: new disk, initializing [ 9997.775107] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9997.825766] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 9997.854764] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [10003.122987] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [10013.643855] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [10020.493748] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [10026.903383] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10027.153340] Lustre: lustre-OST0000: new disk, initializing [10027.158229] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [10027.163224] Lustre: 287227:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [10027.241732] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [10032.896449] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [10037.336449] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [10037.353534] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [10037.554345] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [10041.695571] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [10046.188746] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [10054.381700] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [10065.253543] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [10075.183410] Lustre: Modifying parameter lustre-client.llite.max_read_ahead_mb=64 in log lustre-client [10114.531721] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [10114.532185] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10114.539590] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [10114.561477] Lustre: Skipped 1 previous similar message [10118.645980] Lustre: server umount lustre-OST0000 complete [10124.772045] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10124.773520] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10124.780226] Lustre: Skipped 1 previous similar message [10124.792612] Lustre: Skipped 2 previous similar messages [10128.689527] Lustre: server umount lustre-MDT0000 complete [10129.890893] LustreError: 286401:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10129.910671] LustreError: 286401:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [10131.851926] LustreError: 285250:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786112423 with bad export cookie 10761333242541120510 [10131.862451] LustreError: MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [10131.873942] LustreError: 285250:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [10132.196345] Lustre: server umount lustre-MDT0001 complete [10140.143503] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10144.330744] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [10149.244846] Lustre: server umount MGS complete [10160.657415] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10161.055735] LustreError: 291191:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10161.101278] LustreError: 291204:0:(qmt_pool.c:1639:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [10161.224116] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10165.941351] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [10166.241685] LustreError: 291192:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10174.750302] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10180.072780] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [10187.864823] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [10193.685170] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [10200.090152] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10200.407698] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [10200.411027] Lustre: Skipped 1 previous similar message [10207.151673] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [10215.685634] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [10245.603026] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [10245.609129] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10245.619338] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [10245.640615] Lustre: Skipped 1 previous similar message [10250.782548] Lustre: server umount lustre-OST0000 complete [10262.085409] Lustre: server umount lustre-MDT0000 complete [10266.087813] LustreError: 291187:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10266.141253] LustreError: 291187:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [10266.937771] LustreError: 291172:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786112558 with bad export cookie 10761333242541122365 [10266.945208] LustreError: MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [10266.977529] LustreError: 291172:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [10267.428823] Lustre: server umount lustre-MDT0001 complete [10282.665610] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing unload_modules_local [10286.520787] Key type lgssc unregistered [10286.889814] LNet: 295140:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [10286.896585] LNetError: 295140:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [10286.918284] LNet: Removed LNI 192.168.204.106@tcp [10288.178566] Key type .llcrypt unregistered [10288.183409] Key type ._llcrypt unregistered [10332.195774] Key type ._llcrypt registered [10332.198815] Key type .llcrypt registered [10332.296326] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_hostid [10351.098675] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local [10352.669754] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [10352.715244] alg: No test for adler32 (adler32-zlib) [10354.010535] Lustre: Lustre: Build Version: 2.17.56_50_gf5ff674 [10354.243099] LNet: Added LNI 192.168.204.106@tcp [8/256/0/180] [10355.944286] Key type lgssc registered [10356.895796] Lustre: Echo OBD driver; http://www.lustre.org/ [10392.191840] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [10392.217572] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10393.406412] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [10393.432312] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [10393.491953] Lustre: lustre-MDT0000: new disk, initializing [10393.585498] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10393.614076] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [10397.605666] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [10407.217908] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10407.514460] Lustre: 299099:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [10407.647121] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [10407.656942] Lustre: Skipped 1 previous similar message [10407.737951] Lustre: lustre-MDT0001: new disk, initializing [10407.812404] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [10407.850467] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [10407.863696] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [10412.092155] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [10420.161941] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [10425.415532] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [10431.120752] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10431.423198] Lustre: lustre-OST0000: new disk, initializing [10431.426848] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [10431.433155] Lustre: 301071:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [10431.531913] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [10436.703665] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [10439.724350] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [10439.729581] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [10439.844898] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [10444.876954] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [10450.785902] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [10463.406574] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [10471.873965] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [10479.406364] Lustre: Modifying parameter lustre-client.llite.max_read_ahead_mb=64 in log lustre-client [10525.156640] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10525.158968] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [10525.162708] Lustre: Skipped 1 previous similar message [10525.168542] Lustre: Skipped 1 previous similar message [10529.258370] Lustre: server umount lustre-OST0000 complete [10535.394732] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10535.400311] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10535.405069] Lustre: Skipped 1 previous similar message [10535.421865] Lustre: Skipped 1 previous similar message [10538.361295] Lustre: server umount lustre-MDT0000 complete [10541.391589] LustreError: 302415:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786112833 with bad export cookie 2837229781507607967 [10541.392831] LustreError: MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [10541.416558] LustreError: 302415:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [10541.721433] Lustre: server umount lustre-MDT0001 complete [10549.060978] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10552.837379] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [10557.250919] Lustre: server umount MGS complete [10566.483668] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10566.864789] LustreError: 305135:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10566.893791] LustreError: 305135:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [10566.917978] LustreError: 305148:0:(qmt_pool.c:1639:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [10566.977405] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10570.503180] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [10572.265734] LustreError: 305136:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10576.357327] LustreError: 305135:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10578.145316] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10578.465442] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [10582.782778] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [10588.993921] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [10593.912457] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [10599.726463] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10600.034544] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [10605.327809] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [10611.361204] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [10630.114360] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [10630.121052] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10630.131349] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [10632.163485] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [10632.173661] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [10632.187410] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10634.437976] Lustre: server umount lustre-OST0000 complete [10637.286317] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10637.288582] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10637.298516] Lustre: Skipped 1 previous similar message [10637.305786] Lustre: Skipped 1 previous similar message [10643.215628] Lustre: server umount lustre-MDT0000 complete [10646.153100] LustreError: 307860:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786112937 with bad export cookie 2837229781507609913 [10646.158472] LustreError: MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [10646.163346] LustreError: 307860:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [10646.371403] Lustre: server umount lustre-MDT0001 complete [10653.689899] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing unload_modules_local [10655.584812] Key type lgssc unregistered [10655.816986] LNet: 309080:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [10655.822365] LNetError: 309080:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [10655.835224] LNet: Removed LNI 192.168.204.106@tcp [10656.418651] Key type .llcrypt unregistered [10656.421171] Key type ._llcrypt unregistered [10669.906701] Key type ._llcrypt registered [10669.908644] Key type .llcrypt registered [10669.987796] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_hostid [10680.254523] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local [10680.879763] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [10681.007737] alg: No test for adler32 (adler32-zlib) [10681.970540] Lustre: Lustre: Build Version: 2.17.56_50_gf5ff674 [10682.159938] LNet: Added LNI 192.168.204.106@tcp [8/256/0/180] [10683.808391] Key type lgssc registered [10684.714418] Lustre: Echo OBD driver; http://www.lustre.org/ [10701.688405] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local [10711.949559] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [10711.975035] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10713.148667] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [10713.170504] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [10713.222897] Lustre: lustre-MDT0000: new disk, initializing [10713.270960] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10713.287287] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [10716.653605] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [10723.578673] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10723.741464] Lustre: lustre-OST0000: new disk, initializing [10723.745742] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [10723.749379] Lustre: Skipped 1 previous similar message [10723.756145] Lustre: 313109:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [10723.802417] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [10727.452633] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [10729.514118] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [10729.518690] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [10729.535891] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [11243.738754] Lustre: server umount lustre-MDT0000 complete [11245.746580] LustreError: 313108:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786113537 with bad export cookie 3293621345304438950 [11245.752609] LustreError: MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [11256.378528] Lustre: server umount lustre-OST0000 complete [11269.622756] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_hostid [11274.708595] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local [11294.805805] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11294.959667] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [11294.976456] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [11295.022930] Lustre: lustre-MDT0000: new disk, initializing [11295.072578] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [11295.086081] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [11297.674784] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [11304.184660] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11304.245674] Lustre: 317393:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [11304.293312] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [11304.298081] Lustre: Skipped 1 previous similar message [11304.374213] Lustre: lustre-MDT0001: new disk, initializing [11304.466941] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [11304.508652] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [11304.518758] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [11307.042536] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [11312.640088] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [11315.708690] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [11319.623382] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11319.766540] Lustre: lustre-OST0000: new disk, initializing [11319.769765] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [11319.775046] Lustre: 319360:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [11319.846750] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [11320.001703] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [11320.016096] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [11320.084816] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [11323.304951] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [11328.544679] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [11330.749379] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [11330.848486] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [11333.000713] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [11333.131481] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [11335.650439] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [11335.652484] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11335.653579] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [11335.654596] LustreError: Skipped 1 previous similar message [11335.665914] Lustre: Skipped 1 previous similar message [11340.211521] Lustre: server umount lustre-OST0000 complete [11345.377455] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [11345.381472] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11345.388055] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [11345.390920] Lustre: Skipped 1 previous similar message [11350.453310] Lustre: server umount lustre-MDT0000 complete [11352.355245] LustreError: 317383:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786113644 with bad export cookie 3293621345307379741 [11352.357842] LustreError: MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [11352.361261] LustreError: 317383:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [11352.537129] Lustre: server umount lustre-MDT0001 complete [11354.255610] Lustre: DEBUG MARKER: SKIP: conf-sanity test_111 skipping SLOW test 111 [11355.135392] Lustre: DEBUG MARKER: == conf-sanity test 112a: mount OST with no_create option ========================================================== 10:40:45 (1786113645) [11358.451442] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11358.678811] LustreError: 321667:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11358.689713] LustreError: 321667:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [11358.723317] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [11360.862538] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [11363.810943] LustreError: 321668:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11365.283853] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11367.684901] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [11371.437607] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [11374.365016] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [11377.779548] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11377.940772] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [11377.945694] Lustre: Skipped 1 previous similar message [11380.967461] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [11384.523978] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [11388.046658] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11388.153552] Lustre: lustre-OST0001: new disk, initializing [11388.156537] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [11388.161613] Lustre: 324503:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [11388.168422] Lustre: lustre-OST0001: Not available for connect from 0@lo (not set up) [11388.171840] Lustre: Skipped 1 previous similar message [11390.323525] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [11390.328748] LustreError: 324518:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [11390.335285] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [11391.192823] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [11391.396195] LustreError: 324507:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [11391.402589] LustreError: 324507:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 2 previous similar messages [11392.421025] LustreError: 324518:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [11392.428551] LustreError: 324518:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 1 previous similar message [11394.470358] LustreError: 324507:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [11394.476366] LustreError: 324507:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 3 previous similar messages [11396.565795] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [11396.693383] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [11398.563546] LustreError: 324507:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [11398.570962] LustreError: 324507:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 7 previous similar messages [11399.403658] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff9a52890e5000.ost_server_uuid 50 [11400.163050] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff9a52890e5000.ost_server_uuid in FULL state after 0 sec [11403.111200] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff9a52890e5000.ost_server_uuid 50 [11404.037319] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-ffff9a52890e5000.ost_server_uuid in FULL state after 0 sec [11405.746588] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [11420.083066] Lustre: lustre-OST0001: Not available for connect from 192.168.204.6@tcp (stopping) [11421.154757] LustreError: lustre-OST0001-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [11421.157209] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11421.161036] Lustre: Skipped 1 previous similar message [11425.193551] Lustre: lustre-OST0001: Not available for connect from 192.168.204.6@tcp (stopping) [11425.196351] Lustre: Skipped 2 previous similar messages [11430.883594] Lustre: lustre-OST0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [11430.928964] Lustre: server umount lustre-OST0001 complete [11431.394426] LustreError: 323487:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11431.403403] LustreError: 323487:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [11435.489660] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [11435.493376] LustreError: Skipped 1 previous similar message [11435.496078] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11435.502075] Lustre: Skipped 1 previous similar message [11435.505208] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [11435.507679] Lustre: Skipped 3 previous similar messages [11436.517834] LustreError: 323488:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11436.527660] LustreError: 323488:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [11439.291978] Lustre: server umount lustre-OST0000 complete [11441.636457] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11441.642926] Lustre: Skipped 2 previous similar messages [11447.400628] Lustre: server umount lustre-MDT0000 complete [11449.143168] LustreError: 326154:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786113740 with bad export cookie 3293621345307380616 [11449.146287] LustreError: MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [11449.151470] LustreError: 326154:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [11449.300574] Lustre: server umount lustre-MDT0001 complete [11453.982530] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing unload_modules_local [11455.342181] Key type lgssc unregistered [11455.504038] LNet: 327195:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [11455.509307] LNetError: 327195:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [11455.518108] LNet: Removed LNI 192.168.204.106@tcp [11455.932148] Key type .llcrypt unregistered [11455.933778] Key type ._llcrypt unregistered [11468.425582] Key type ._llcrypt registered [11468.428169] Key type .llcrypt registered [11468.480526] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local [11468.906741] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [11468.969279] alg: No test for adler32 (adler32-zlib) [11469.900701] Lustre: Lustre: Build Version: 2.17.56_50_gf5ff674 [11470.019056] LNet: Added LNI 192.168.204.106@tcp [8/256/0/180] [11471.624718] Key type lgssc registered [11472.172393] Lustre: Echo OBD driver; http://www.lustre.org/ [11476.074569] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [11476.086285] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11477.374984] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [11479.367397] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [11484.575929] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [11487.734660] LustreError: 328592:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11487.757754] LustreError: 328592:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [11491.851475] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11492.469252] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [11499.443254] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [11509.265131] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11509.803290] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [11518.070603] LustreError: 330270:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11518.452605] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [11523.254714] LustreError: 330614:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11523.279785] LustreError: 330614:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [11523.306223] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:65) [11527.554793] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [11528.680782] LustreError: 330614:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11528.698925] LustreError: 330614:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [11533.819577] LustreError: 330614:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11533.843289] LustreError: 330614:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [11535.452917] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11535.834854] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [11541.013140] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:33) [11543.722846] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [11551.599867] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [11558.152069] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing wait_import_state (FULL|IDLE) os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [11558.342282] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [11657.705886] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11657.721070] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [11657.726832] Lustre: Skipped 1 previous similar message [11660.238341] Lustre: server umount lustre-OST0001 complete [11662.817376] LustreError: 331200:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11666.914870] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [11666.914944] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11666.920370] LustreError: Skipped 1 previous similar message [11666.928821] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [11666.936426] Lustre: Skipped 2 previous similar messages [11666.958122] Lustre: Skipped 1 previous similar message [11667.941433] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [11673.059185] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [11673.063965] Lustre: Skipped 2 previous similar messages [11678.178194] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [11678.186440] Lustre: Skipped 1 previous similar message [11679.200514] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [11679.342772] Lustre: server umount lustre-OST0000 complete [11683.301176] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11683.312168] Lustre: Skipped 1 previous similar message [11688.279382] Lustre: server umount lustre-MDT0000 complete [11688.417351] LustreError: 328591:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11688.426260] LustreError: 328591:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 8 previous similar messages [11690.830212] LustreError: 328573:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786113982 with bad export cookie 9791855072282643136 [11690.836634] LustreError: MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [11690.844691] LustreError: 328573:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [11691.045734] Lustre: server umount lustre-MDT0001 complete [11698.805905] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing unload_modules_local [11700.694607] Key type lgssc unregistered [11700.910839] LNet: 333540:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [11700.916306] LNetError: 333540:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [11700.926838] LNet: Removed LNI 192.168.204.106@tcp [11701.604470] Key type .llcrypt unregistered [11701.606298] Key type ._llcrypt unregistered [11735.922383] Key type ._llcrypt registered [11735.924658] Key type .llcrypt registered [11735.999708] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local [11736.714869] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [11736.736386] alg: No test for adler32 (adler32-zlib) [11737.694221] Lustre: Lustre: Build Version: 2.17.56_50_gf5ff674 [11737.882494] LNet: Added LNI 192.168.204.106@tcp [8/256/0/180] [11739.560182] Key type lgssc registered [11740.582214] Lustre: Echo OBD driver; http://www.lustre.org/ [11747.712363] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [11747.723445] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11749.061987] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [11752.202500] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [11758.563360] LustreError: 335807:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11758.573863] LustreError: 335807:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [11758.735680] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11759.021652] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [11762.412834] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [11764.554709] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [11769.933492] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11770.209648] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [11773.292742] LustreError: 337297:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11773.307884] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:97) [11774.318630] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [11778.537812] LustreError: 337296:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11779.851657] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11780.033252] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [11783.553808] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [11784.120780] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:65) [11789.909714] Lustre: DEBUG MARKER: Using TIMEOUT=20 [11794.778343] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [11804.645254] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11804.647545] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [11804.657187] Lustre: Skipped 2 previous similar messages [11804.659471] Lustre: Skipped 1 previous similar message [11808.083488] Lustre: server umount lustre-MDT0000 complete [11809.767614] LustreError: 335807:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11809.781530] LustreError: 335807:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [11810.306093] LustreError: 335787:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786114102 with bad export cookie 5594028220727003543 [11810.313716] LustreError: MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [11810.317549] LustreError: 335787:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [11810.532650] Lustre: server umount lustre-MDT0001 complete [11823.137963] Lustre: server umount lustre-OST0000 complete [11836.087171] Lustre: server umount lustre-OST0001 complete [11846.681466] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local [11852.979689] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11853.260932] LustreError: 341067:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11853.316692] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [11856.248682] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [11861.969385] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11862.273352] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [11865.689266] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [11867.624060] Lustre: 342207:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [11872.173780] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11876.450575] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [11879.591819] LustreError: 342561:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11879.627836] LustreError: 342561:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [11879.646100] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:129) [11882.743163] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11882.974453] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [11882.982519] Lustre: Skipped 1 previous similar message [11887.110691] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:97) [11887.808450] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [11894.045731] Lustre: DEBUG MARKER: Using TIMEOUT=20 [11896.767749] Lustre: 344078:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [11902.437785] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11902.440073] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [11902.452722] Lustre: Skipped 4 previous similar messages [11902.457908] Lustre: Skipped 4 previous similar messages [11905.840637] Lustre: server umount lustre-MDT0000 complete [11907.555163] LustreError: 341067:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11907.575263] LustreError: 341067:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [11908.723345] LustreError: 341050:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786114200 with bad export cookie 5594028220727005244 [11908.735325] LustreError: MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [11908.738957] LustreError: 341050:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [11909.017314] Lustre: server umount lustre-MDT0001 complete [11921.969984] Lustre: server umount lustre-OST0000 complete [11934.811454] Lustre: server umount lustre-OST0001 complete [11937.021789] Lustre: DEBUG MARKER: SKIP: conf-sanity test_114 skipping SLOW test 114 [11938.083851] Lustre: DEBUG MARKER: SKIP: conf-sanity test_115 skipping excluded test 115 [11939.456933] Lustre: DEBUG MARKER: == conf-sanity test 116: big size MDT support ============ 10:50:29 (1786114229) [11955.735867] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local [11961.743806] loop0: detected capacity change from 0 to 1099511627776 [11962.213721] SGI XFS with ACLs, security attributes, quota, no debug enabled [11962.219886] *** VALIDATE xfs *** [11962.236912] XFS (loop0): Mounting V5 Filesystem [11962.259247] XFS (loop0): Ending clean mount [11963.118862] loop1: detected capacity change from 0 to 18691697672192 [12012.352235] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_hostid [12018.652896] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local [12041.529498] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12041.691381] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [12041.714561] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [12041.775823] Lustre: lustre-MDT0000: new disk, initializing [12041.855549] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [12041.876697] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [12044.425316] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [12051.665891] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12051.765576] Lustre: 349199:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [12051.816243] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [12051.822022] Lustre: Skipped 1 previous similar message [12051.881428] Lustre: lustre-MDT0001: new disk, initializing [12052.009284] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [12052.019829] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [12054.715771] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [12060.771870] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [12064.126753] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [12068.459089] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [12068.630845] Lustre: lustre-OST0000: new disk, initializing [12068.634209] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [12068.638788] Lustre: 351168:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [12069.731616] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [12069.742261] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [12069.836556] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [12072.620451] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [12078.935384] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [12081.869844] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [12082.054810] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [12085.005066] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [12085.171206] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [12090.340114] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [12090.340658] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [12090.343821] LustreError: Skipped 1 previous similar message [12090.349862] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [12090.359364] Lustre: Skipped 1 previous similar message [12092.540593] Lustre: server umount lustre-OST0000 complete [12095.459191] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [12095.462056] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [12095.465107] Lustre: Skipped 2 previous similar messages [12100.578283] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [12100.584802] Lustre: Skipped 2 previous similar messages [12109.280146] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [12109.390683] Lustre: server umount lustre-MDT0000 complete [12110.818178] LustreError: 349212:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [12110.836577] LustreError: 349212:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [12111.561779] LustreError: 350005:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786114403 with bad export cookie 5594028220727006791 [12111.566861] LustreError: MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [12111.576345] LustreError: 350005:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [12111.784421] Lustre: server umount lustre-MDT0001 complete [12116.770092] XFS (loop0): Unmounting Filesystem [12119.849187] Lustre: DEBUG MARKER: == conf-sanity test 117: lctl get_param return errors properly ========================================================== 10:53:30 (1786114410) [12124.132664] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12124.474833] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [12124.483106] Lustre: Skipped 2 previous similar messages [12127.103528] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [12132.474594] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12135.133501] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [12139.259247] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [12142.548570] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [12146.647834] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [12150.436951] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [12154.797284] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [12165.602856] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [12165.607935] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [12165.617151] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [12165.621929] Lustre: Skipped 2 previous similar messages [12165.958479] Lustre: server umount lustre-OST0000 complete [12168.673679] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [12174.387639] Lustre: server umount lustre-MDT0000 complete [12176.605494] LustreError: 353706:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786114468 with bad export cookie 5594028220727007666 [12176.612373] LustreError: MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [12176.613381] LustreError: 353706:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [12187.212267] Lustre: server umount lustre-MDT0001 complete [12193.736428] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing unload_modules_local [12195.602513] Key type lgssc unregistered [12195.818759] LNet: 357355:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [12195.824447] LNetError: 357355:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [12195.835154] LNet: Removed LNI 192.168.204.106@tcp [12196.534295] Key type .llcrypt unregistered [12196.537763] Key type ._llcrypt unregistered [12213.451539] Key type ._llcrypt registered [12213.452707] Key type .llcrypt registered [12213.512728] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local [12214.078296] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [12214.123769] alg: No test for adler32 (adler32-zlib) [12215.040783] Lustre: Lustre: Build Version: 2.17.56_50_gf5ff674 [12215.174655] LNet: Added LNI 192.168.204.106@tcp [8/256/0/180] [12216.784139] Key type lgssc registered [12217.522704] Lustre: Echo OBD driver; http://www.lustre.org/ [12222.328926] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [12222.344798] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12223.596189] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [12226.470287] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [12232.339917] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12232.560859] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [12235.119047] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [12239.452081] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [12242.656991] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [12246.696515] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [12246.933336] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [12250.685235] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [12255.138407] Lustre: DEBUG MARKER: oleg406-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [12267.974388] Lustre: lustre-MDT0001: Not available for connect from 192.168.204.6@tcp (stopping) [12268.518781] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [12268.538695] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [12268.548343] Lustre: Skipped 1 previous similar message [12271.037284] Lustre: server umount lustre-MDT0001 complete [12273.066978] LustreError: 358897:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.204.6@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [12273.095653] LustreError: 358897:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [12273.645165] LustreError: 358900:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [12273.668032] LustreError: 358900:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [12278.169122] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12278.192464] LustreError: 358895:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.204.6@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [12278.265744] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [12278.268926] Lustre: Found index 1 for lustre-MDT0001, updating log [12278.291234] Lustre: 358890:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [12278.527771] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [12281.731372] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [12283.891947] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [12284.400616] LustreError: 362494:0:(obd_mount.c:234:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [12284.412526] LustreError: 362494:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [12284.420776] LustreError: 358893:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [12284.471307] LustreError: 362497:0:(obd_config.c:2103:class_config_llog_handler()) MGC192.168.204.106@tcp: cfg command failed: rc = -17 [12284.478816] Lustre: cmd=cf001 0:lustre-MDT0001-osp-MDT0000 1:osp 2:lustre-MDT0000-mdtlov_UUID [12284.478816] [12585.953810] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [12585.961689] Lustre: Skipped 1 previous similar message [12585.965392] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [12585.968094] Lustre: Skipped 1 previous similar message [12590.519905] Lustre: lustre-MDT0001: Not available for connect from 192.168.204.6@tcp (stopping) [12595.626528] Lustre: lustre-MDT0001: Not available for connect from 192.168.204.6@tcp (stopping) [12595.630464] Lustre: Skipped 2 previous similar messages [12600.288172] Lustre: lustre-MDT0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [12600.357866] Lustre: server umount lustre-MDT0001 complete [12600.745948] LustreError: 358895:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.204.6@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [12605.657621] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12605.715731] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [12605.719458] Lustre: Found index 1 for lustre-MDT0001, updating log [12605.737514] Lustre: 358890:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [12605.897608] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [12608.020520] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [12611.048783] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [12613.100811] LustreError: 373691:0:(obd_mount.c:234:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [12613.104926] LustreError: 373691:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [12613.109116] LustreError: 358893:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [12613.111889] LustreError: 358893:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [12613.148526] LustreError: 373694:0:(obd_config.c:761:class_setup()) osp: device 8 already setup: rc = -17 [12613.152165] LustreError: 373694:0:(obd_config.c:866:class_detach()) OBD device 8 still set up [12613.154949] LustreError: 373694:0:(obd_config.c:2103:class_config_llog_handler()) MGC192.168.204.106@tcp: cfg command failed: rc = -17 [12613.159676] Lustre: cmd=cf003 0:lustre-MDT0001-osp-MDT0000 1:lustre-MDT0001_UUID 2:192.168.204.106@tcp [12613.159676] [12911.076222] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [12911.080458] Lustre: Skipped 1 previous similar message [12911.083560] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [12911.086299] Lustre: Skipped 3 previous similar messages [12917.032380] Lustre: server umount lustre-MDT0001 complete [12918.186213] LustreError: 358897:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.204.6@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [12918.192980] LustreError: 358897:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [12921.457668] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12921.511665] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [12921.514702] Lustre: Found index 1 for lustre-MDT0001, updating log [12921.535256] Lustre: 358890:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [12921.663838] Lustre: lustre-MDT0001: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [12923.293279] Lustre: DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug -1 all [12926.951082] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [12927.462920] LustreError: 385182:0:(obd_mount.c:234:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [12927.465651] LustreError: 385182:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [12927.469950] LustreError: 358893:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [12927.472820] LustreError: 358893:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [12927.499308] LustreError: 385191:0:(lod_lov.c:210:lod_add_device()) lustre-MDT0001-osp-MDT0000: cannot connect to next dev lustre-MDT0001_UUID (-114) [12927.509055] LustreError: 385191:0:(obd_config.c:2103:class_config_llog_handler()) MGC192.168.204.106@tcp: cfg command failed: rc = -114 [12927.512521] Lustre: cmd=cf014 0:lustre-MDT0000-mdtlov 1:lustre-MDT0001_UUID 2:1 3:1 [12927.512521]