[ 0.000000] Linux version 4.18.0rh8.10-debug (green@maintenance) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-26) (GCC)) #2 SMP Mon Jul 14 01:24:22 EDT 2025 [ 0.000000] Command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffcdfff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffce000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x0000000146dfffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.8 present. [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-8.fc42 06/10/2025 [ 0.000000] Hypervisor detected: KVM [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 615968861 cycles [ 0.000000] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns [ 0.000000] tsc: Detected 2399.998 MHz processor [ 0.000000] last_pfn = 0x146e00 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0xbffce max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000f54b0-0x000f54bf] [ 0.000000] RAMDISK: [mem 0xbcc54000-0xbffbffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F52D0 000014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 0x00000000BFFE2439 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 0x00000000BFFE22D5 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 0x00000000BFFE0040 002295 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 0x00000000BFFE0000 000040 [ 0.000000] ACPI: APIC 0x00000000BFFE2349 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: HPET 0x00000000BFFE23D9 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: WAET 0x00000000BFFE2411 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0xbffe22d5-0xbffe2348] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe22d4] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0xbffe2349-0xbffe23d8] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0xbffe23d9-0xbffe2410] [ 0.000000] ACPI: Reserving WAET table memory at [mem 0xbffe2411-0xbffe2438] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x0000000146dfffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x1465a3000-0x1465cdfff] [ 0.000000] Reserving 256MB of memory at 2752MB for crashkernel (System RAM: 4205MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009efff] [ 0.000000] node 0: [mem 0x0000000000100000-0x00000000bffcdfff] [ 0.000000] node 0: [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Zeroed struct page in unavailable ranges: 4756 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x0000000146dfffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] TSC deadline timer available [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] kvm-guest: KVM setup pv remote TLB flush [ 0.000000] kvm-guest: setup PV sched yield [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbffce000-0xbfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.000000] [mem 0xc0000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u524288 [ 0.000000] kvm-guest: PV spinlocks enabled [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1059606 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] audit: disabled (until reboot) [ 0.000000] software IO TLB: area num 4. [ 0.000000] Memory: 2829652K/4306352K available (18435K kernel code, 11221K rwdata, 7248K rodata, 2908K init, 18040K bss, 524584K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] ftrace: allocating 41240 entries in 162 pages [ 0.000000] ftrace: allocated 162 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU event tracing is enabled. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=4. [ 0.000000] rcu: RCU callback double-/use-after-free debug enabled. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 [ 0.000000] NR_IRQS: 524544, nr_irqs: 456, preallocated irqs: 16 [ 0.000000] random: get_random_bytes called from start_kernel+0x622/0x9a8 with crng_init=0 [ 0.001000] Console: colour *CGA 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns [ 0.001010] APIC: Switch to symmetric I/O mode setup [ 0.002000] x2apic enabled [ 0.002000] Switched APIC routing to physical x2apic. [ 0.002000] kvm-guest: setup PV IPIs [ 0.002000] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.002000] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 0.002000] Calibrating delay loop (skipped) preset value.. 4799.99 BogoMIPS (lpj=2399998) [ 0.002000] pid_max: default: 32768 minimum: 301 [ 0.002000] LSM: Security Framework initializing [ 0.002000] Yama: becoming mindful. [ 0.002000] SELinux: Initializing. [ 0.002000] *** VALIDATE selinux *** [ 0.002000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, vmalloc) [ 0.002000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc) [ 0.002000] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.002000] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.002000] *** VALIDATE tmpfs *** [ 0.002000] *** VALIDATE proc *** [ 0.002000] *** VALIDATE cgroup *** [ 0.002000] *** VALIDATE cgroup2 *** [ 0.002000] x86/cpu: User Mode Instruction Prevention (UMIP) activated [ 0.002000] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.002000] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 [ 0.002000] Spectre V2 : User space: Vulnerable [ 0.002000] Speculative Store Bypass: Vulnerable [ 0.002000] debug: unmapping init [mem 0xffffffff8d459000-0xffffffff8d460fff] [ 0.002000] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (family: 0x6, model: 0x3e, stepping: 0x4) [ 0.002758] Performance Events: IvyBridge events, full-width counters, Intel PMU driver. [ 0.003025] ... version: 2 [ 0.004015] ... bit width: 48 [ 0.005020] ... generic registers: 4 [ 0.006022] ... value mask: 0000ffffffffffff [ 0.007022] ... max period: 00007fffffffffff [ 0.008021] ... fixed-purpose events: 3 [ 0.009016] ... event mask: 000000070000000f [ 0.010304] rcu: Hierarchical SRCU implementation. [ 0.013719] smp: Bringing up secondary CPUs ... [ 0.015735] x86: Booting SMP configuration: [ 0.016128] .... node #0, CPUs: #1 #2 #3 [ 0.035483] smp: Brought up 1 node, 4 CPUs [ 0.038016] smpboot: Max logical packages: 1 [ 0.039014] smpboot: Total of 4 processors activated (19199.98 BogoMIPS) [ 0.128057] node 0 deferred pages initialised in 86ms [ 0.156371] devtmpfs: initialized [ 0.161548] x86/mm: Memory block size: 128MB [ 0.172134] gcov: version magic: 0x41383552 [ 0.180000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.189735] futex hash table entries: 1024 (order: 4, 65536 bytes, vmalloc) [ 0.194442] pinctrl core: initialized pinctrl subsystem [ 0.215259] [ 0.217013] ************************************************************* [ 0.225015] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.232000] ** ** [ 0.239013] ** IOMMU DebugFS SUPPORT HAS BEEN ENABLED IN THIS KERNEL ** [ 0.246015] ** ** [ 0.251018] ** This means that this kernel is built to expose internal ** [ 0.263020] ** IOMMU data structures, which may compromise security on ** [ 0.279020] ** your system. ** [ 0.292013] ** ** [ 0.303021] ** If you see this message and you are not debugging the ** [ 0.308016] ** kernel, report this immediately to your vendor! ** [ 0.312015] ** ** [ 0.317015] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.323013] ************************************************************* [ 0.327367] NET: Registered protocol family 16 [ 0.331127] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations [ 0.338069] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.352070] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.369195] cpuidle: using governor menu [ 0.374310] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.379047] PCI: Using configuration type 1 for base access [ 0.382179] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.397779] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.398000] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.405398] cryptd: max_cpu_qlen set to 1000 [ 0.407458] ACPI: Added _OSI(Module Device) [ 0.411025] ACPI: Added _OSI(Processor Device) [ 0.414018] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.416018] ACPI: Added _OSI(Processor Aggregator Device) [ 0.426209] ACPI: 1 ACPI AML tables successfully acquired and loaded [ 0.437485] ACPI: Interpreter enabled [ 0.440220] ACPI: PM: (supports S0 S3 S4 S5) [ 0.445049] ACPI: Using IOAPIC for interrupt routing [ 0.450083] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.455819] ACPI: Enabled 2 GPEs in block 00 to 0F [ 0.477104] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.481039] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3] [ 0.486018] acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI] [ 0.492094] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.502729] acpiphp: Slot [2] registered [ 0.505148] acpiphp: Slot [5] registered [ 0.509008] acpiphp: Slot [6] registered [ 0.512186] acpiphp: Slot [7] registered [ 0.514823] acpiphp: Slot [8] registered [ 0.517128] acpiphp: Slot [9] registered [ 0.520000] acpiphp: Slot [10] registered [ 0.522197] acpiphp: Slot [3] registered [ 0.524141] acpiphp: Slot [4] registered [ 0.527014] acpiphp: Slot [11] registered [ 0.528119] acpiphp: Slot [12] registered [ 0.530122] acpiphp: Slot [13] registered [ 0.532125] acpiphp: Slot [14] registered [ 0.535158] acpiphp: Slot [15] registered [ 0.538160] acpiphp: Slot [16] registered [ 0.540169] acpiphp: Slot [17] registered [ 0.543020] acpiphp: Slot [18] registered [ 0.545140] acpiphp: Slot [19] registered [ 0.546124] acpiphp: Slot [20] registered [ 0.549144] acpiphp: Slot [21] registered [ 0.552069] acpiphp: Slot [22] registered [ 0.554889] acpiphp: Slot [23] registered [ 0.558098] acpiphp: Slot [24] registered [ 0.561087] acpiphp: Slot [25] registered [ 0.564155] acpiphp: Slot [26] registered [ 0.566161] acpiphp: Slot [27] registered [ 0.568825] acpiphp: Slot [28] registered [ 0.571129] acpiphp: Slot [29] registered [ 0.575137] acpiphp: Slot [30] registered [ 0.578148] acpiphp: Slot [31] registered [ 0.581071] PCI host bridge to bus 0000:00 [ 0.584021] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.592025] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.595023] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.603041] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 0.609027] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] [ 0.616026] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.620355] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.625000] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.630392] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 0.653000] pci 0000:00:01.1: reg 0x20: [io 0xc320-0xc32f] [ 0.662058] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.667028] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.670016] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.675086] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.683000] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 0.701000] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 0.701000] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 0.704043] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 [ 0.707000] pci 0000:00:02.0: reg 0x10: [io 0xc300-0xc31f] [ 0.720014] pci 0000:00:02.0: reg 0x20: [mem 0xe0000000000-0xe0000003fff 64bit pref] [ 0.729019] pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 0.767554] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 [ 0.787021] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] [ 0.800032] pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] [ 0.835000] pci 0000:00:05.0: reg 0x20: [mem 0xe0000004000-0xe0000007fff 64bit pref] [ 0.846000] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 [ 0.858017] pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] [ 0.862013] pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 0.872015] pci 0000:00:06.0: reg 0x20: [mem 0xe0000008000-0xe000000bfff 64bit pref] [ 0.879000] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 [ 0.883014] pci 0000:00:07.0: reg 0x10: [io 0xc100-0xc17f] [ 0.886014] pci 0000:00:07.0: reg 0x14: [mem 0xfebc2000-0xfebc2fff] [ 0.900018] pci 0000:00:07.0: reg 0x20: [mem 0xe000000c000-0xe000000ffff 64bit pref] [ 0.910000] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 [ 0.910000] pci 0000:00:08.0: reg 0x10: [io 0xc180-0xc1ff] [ 0.910000] pci 0000:00:08.0: reg 0x14: [mem 0xfebc3000-0xfebc3fff] [ 0.910000] pci 0000:00:08.0: reg 0x20: [mem 0xe0000010000-0xe0000013fff 64bit pref] [ 0.910000] pci 0000:00:09.0: [1af4:1001] type 00 class 0x010000 [ 0.910000] pci 0000:00:09.0: reg 0x10: [io 0xc200-0xc27f] [ 0.910000] pci 0000:00:09.0: reg 0x14: [mem 0xfebc4000-0xfebc4fff] [ 0.910000] pci 0000:00:09.0: reg 0x20: [mem 0xe0000014000-0xe0000017fff 64bit pref] [ 0.910000] pci 0000:00:0a.0: [1af4:1001] type 00 class 0x010000 [ 0.910000] pci 0000:00:0a.0: reg 0x10: [io 0xc280-0xc2ff] [ 0.910000] pci 0000:00:0a.0: reg 0x14: [mem 0xfebc5000-0xfebc5fff] [ 0.910000] pci 0000:00:0a.0: reg 0x20: [mem 0xe0000018000-0xe000001bfff 64bit pref] [ 0.910000] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 [ 0.910000] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 0.910000] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 [ 0.910000] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 0.910000] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 [ 0.910159] iommu: Default domain type: Passthrough [ 0.913429] SCSI subsystem initialized [ 0.916180] ACPI: bus type USB registered [ 0.920153] usbcore: registered new interface driver usbfs [ 0.974068] usbcore: registered new interface driver hub [ 0.980054] usbcore: registered new device driver usb [ 0.988130] pps_core: LinuxPPS API ver. 1 registered [ 0.991011] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 0.996183] PTP clock support registered [ 1.035122] EDAC MC: Ver: 3.0.0 [ 1.036453] PCI: Using ACPI for IRQ routing [ 1.039278] NetLabel: Initializing [ 1.042353] NetLabel: domain hash size = 128 [ 1.044010] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 1.046094] NetLabel: unlabeled traffic allowed by default [ 1.049425] vgaarb: loaded [ 1.050700] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 1.052010] hpet0: 3 comparators, 64-bit 100.000000 MHz counter [ 1.059738] clocksource: Switched to clocksource kvm-clock [ 1.266309] VFS: Disk quotas dquot_6.6.0 [ 1.269605] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 1.275529] *** VALIDATE ramfs *** [ 1.278588] *** VALIDATE hugetlbfs *** [ 1.282400] pnp: PnP ACPI init [ 1.289218] pnp: PnP ACPI: found 6 devices [ 1.310443] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 1.313659] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 1.315449] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 1.317489] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 1.319691] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 1.321963] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] [ 1.324551] NET: Registered protocol family 2 [ 1.326755] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, vmalloc) [ 1.331428] tcp_listen_portaddr_hash hash table entries: 4096 (order: 5, 163840 bytes, vmalloc) [ 1.335045] TCP established hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 1.339996] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc) [ 1.343047] TCP: Hash tables configured (established 65536 bind 65536) [ 1.345572] MPTCP token hash table entries: 8192 (order: 6, 393216 bytes, vmalloc) [ 1.348446] UDP hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 1.351166] UDP-Lite hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 1.353819] NET: Registered protocol family 1 [ 1.356241] RPC: Registered named UNIX socket transport module. [ 1.358020] RPC: Registered udp transport module. [ 1.361621] RPC: Registered tcp transport module. [ 1.363339] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 1.365523] NET: Registered protocol family 44 [ 1.367193] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 1.369221] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 1.371455] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 1.373553] PCI: CLS 0 bytes, default 64 [ 1.376160] Unpacking initramfs... [ 5.093286] debug: unmapping init [mem 0xffff9b6fbcc54000-0xffff9b6fbffbffff] [ 5.098514] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 5.101338] software IO TLB: mapped [mem 0x00000000a8000000-0x00000000ac000000] (64MB) [ 5.105227] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 7.251182] Initialise system trusted keyrings [ 7.253902] Key type blacklist registered [ 7.257888] workingset: timestamp_bits=36 max_order=20 bucket_order=0 [ 7.455201] zbud: loaded [ 7.458024] *** VALIDATE nfs *** [ 7.459101] *** VALIDATE nfs4 *** [ 7.460533] pstore: using deflate compression [ 7.464369] Platform Keyring initialized [ 7.993390] NET: Registered protocol family 38 [ 7.995374] Key type asymmetric registered [ 7.996798] Asymmetric key parser 'x509' registered [ 7.998262] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 8.001348] io scheduler mq-deadline registered [ 8.010259] io scheduler kyber registered [ 8.025725] io scheduler bfq registered [ 8.027666] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 8.031838] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 8.035089] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 8.048742] ACPI: Power Button [PWRF] [ 8.165976] ACPI: \_SB_.LNKB: Enabled at IRQ 10 [ 8.202357] ACPI: \_SB_.LNKA: Enabled at IRQ 11 [ 8.259400] ACPI: \_SB_.LNKC: Enabled at IRQ 11 [ 8.287887] ACPI: \_SB_.LNKD: Enabled at IRQ 10 [ 8.337328] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 8.383254] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 8.419275] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 8.423328] Non-volatile memory driver v1.3 [ 8.424466] Linux agpgart interface v0.103 [ 8.452730] virtio_blk virtio1: [vda] 134096 512-byte logical blocks (68.7 MB/65.5 MiB) [ 8.454827] vda: detected capacity change from 0 to 68657152 [ 8.477894] virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) [ 8.480202] vdb: detected capacity change from 0 to 1073741824 [ 8.499237] virtio_blk virtio3: [vdc] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 8.503123] vdc: detected capacity change from 0 to 2621440000 [ 8.523344] virtio_blk virtio4: [vdd] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 8.526913] vdd: detected capacity change from 0 to 2621440000 [ 8.542161] virtio_blk virtio5: [vde] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 8.544503] vde: detected capacity change from 0 to 4294967296 [ 8.562832] virtio_blk virtio6: [vdf] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 8.565722] vdf: detected capacity change from 0 to 4294967296 [ 8.659707] libphy: Fixed MDIO Bus: probed [ 8.666905] usbcore: registered new interface driver usbserial_generic [ 8.669268] usbserial: USB Serial support registered for generic [ 8.672320] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 8.693466] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 8.695123] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 8.698048] mousedev: PS/2 mouse device common for all mice [ 8.700990] rtc_cmos 00:05: RTC can wake from S4 [ 8.704628] rtc_cmos 00:05: registered as rtc0 [ 8.706506] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 8.711312] intel_pstate: CPU model not supported [ 8.714974] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 8.720057] hid: raw HID events driver (C) Jiri Kosina [ 8.723178] usbcore: registered new interface driver usbhid [ 8.725287] usbhid: USB HID core driver [ 8.726854] drop_monitor: Initializing network drop monitor service [ 8.729214] Initializing XFRM netlink socket [ 8.731671] NET: Registered protocol family 10 [ 8.735435] Segment Routing with IPv6 [ 8.737183] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 [ 8.740627] NET: Registered protocol family 17 [ 8.744244] mpls_gso: MPLS GSO support [ 8.745672] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 [ 8.756503] RAS: Correctable Errors collector initialized. [ 8.762838] AVX version of gcm_enc/dec engaged. [ 8.768524] AES CTR mode by8 optimization enabled [ 9.006895] sched_clock: Marking stable (9006803711, 0)->(11151970279, -2145166568) [ 9.022281] registered taskstats version 1 [ 9.030425] Loading compiled-in X.509 certificates [ 9.037302] zswap: loaded using pool lzo/zbud [ 9.134842] Key type big_key registered [ 9.176820] Key type encrypted registered [ 9.178339] ima: No TPM chip found, activating TPM-bypass! [ 9.183276] ima: Allocated hash algorithm: sha1 [ 9.187571] ima: No architecture policies found [ 9.196353] evm: Initialising EVM extended attributes: [ 9.199743] evm: security.selinux [ 9.204173] evm: security.ima [ 9.205430] evm: security.capability [ 9.213724] evm: HMAC attrs: 0x1 [ 9.221484] rtc_cmos 00:05: setting system clock to 2026-01-16 06:55:41 UTC (1768546541) [ 9.237368] debug: unmapping init [mem 0xffffffff8e403000-0xffffffff8e5fffff] [ 9.242367] debug: unmapping init [mem 0xffffffff8d182000-0xffffffff8d458fff] [ 9.251568] Write protecting the kernel read-only data: 28672k [ 9.259541] debug: unmapping init [mem 0xffffffff8b803000-0xffffffff8b9fffff] [ 9.266761] debug: unmapping init [mem 0xffffffff8c114000-0xffffffff8c1fffff] [ 9.508513] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 9.550633] systemd[1]: Detected virtualization kvm. [ 9.552353] systemd[1]: Detected architecture x86-64. [ 9.562426] systemd[1]: Running in initial RAM disk. Welcome to Rocky Linux 8.10 (Green Obsidian) dracut-049-233.git20240115.el8 (Initramfs)! [ 9.615536] systemd[1]: No hostname configured. [ 9.622119] systemd[1]: Set hostname to . [ 9.628618] random: systemd: uninitialized urandom read (16 bytes read) [ 9.638897] systemd[1]: Initializing machine ID from random generator. [ 10.383187] random: systemd: uninitialized urandom read (16 bytes read) [ 10.388120] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 10.405590] random: systemd: uninitialized urandom read (16 bytes read) [ 10.409686] systemd[1]: Reached target Initrd Root Device. [ OK ] Reached target Initrd Root Device. [ 10.417470] systemd[1]: Reached target Timers. [ OK ] Reached target Timers. [ OK ] Listening on udev Control Socket. [ OK ] Reached target Swap. [ OK ] Listening on Journal Socket. [ OK ] Started Memstrack Anylazing Service. [ 10.693332] urandom_read: 5 callbacks suppressed [ 10.693340] random: systemd: uninitialized urandom read (16 bytes read) Starting Create list of required st…ce nodes for the current kernel... [ 10.769297] random: systemd: uninitialized urandom read (16 bytes read) [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Paths. Starting Apply Kernel Variables... Starting Setup Virtual Console... [ OK ] Reached target Slices. [ OK ] Listening on Journal Socket (/dev/log). Starting Journal Service... [ OK ] Reached target Sockets. [ OK ] Reached target Local File Systems. Starting Create Volatile Files and Directories... [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Apply Kernel Variables. [ OK ] Started Setup Virtual Console. [ OK ] Started Create Volatile Files and Directories. Starting dracut cmdline hook... Starting Create Static Device Nodes in /dev... [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started Journal Service. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ 13.938983] device-mapper: uevent: version 1.0.3 [ 13.948891] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting dracut pre-trigger hook... [ OK ] Started dracut pre-trigger hook. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. [ OK ] Reached target System Initialization. [ OK ] Reached target Basic System. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. Starting dracut initqueue hook... [ 17.602580] random: fast init done [ 17.631623] virtio_net virtio0 ens2: renamed from eth0 [ 18.243557] scsi host0: ata_piix [ 18.400648] scsi host1: ata_piix [ 18.405797] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc320 irq 14 [ 18.426613] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc328 irq 15 [ 23.763903] random: crng init done [ 27.000894] dracut-initqueue[583]: RTNETLINK answers: File exists Starting nbd nbd0... [ OK ] Started nbd nbd0. [ OK ] Started dracut initqueue hook. Mounting /sysroot... [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. [ 29.257814] EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Timers. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Initrd Root Device. Stopping Hardware RNG Entropy Gatherer Daemon... [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped Hardware RNG Entropy Gatherer Daemon. [ OK ] Stopped target Basic System. [ OK ] Stopped target Sockets. [ OK ] Stopped target Slices. [ OK ] Stopped target Paths. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Swap. [ OK ] Stopped target Local Encrypted Volumes. [ OK ] Stopped Dispatch Password Requests to Console Directory Watch. [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped target Local File Systems. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped dracut pre-trigger hook. Stopping udev Kernel Device Manager... [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Closed udev Kernel Socket. [ OK ] Closed udev Control Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Reached target Switch Root. Starting Switch Root... [ 33.529861] printk: systemd: 26 output lines suppressed due to ratelimiting [ 34.594510] SELinux: Disabled at runtime. [ 34.762676] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 34.882427] systemd[1]: Detected virtualization kvm. [ 34.884262] systemd[1]: Detected architecture x86-64. Welcome to Rocky Linux 8.10 (Green Obsidian)! [ 36.715595] systemd[1]: initrd-switch-root.service: Succeeded. [ 36.718953] systemd[1]: Stopped Switch Root. [ OK ] Stopped Switch Root. [ 36.731898] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. [ 36.736303] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 36.739590] systemd[1]: Stopped Journal Service. [ OK ] Stopped Journal Service. [ 36.748529] systemd[1]: Starting Journal Service... Starting Journal Service... [ 36.984400] systemd[1]: Listening on Process Core Dump Socket. [ OK ] Listening on Process Core Dump Socket. Activating swap /dev/disk/by-label/SWAP... [ OK ] Created slice system-getty.slice. [ OK ] Listening on udev Kernel Socket. [ OK ] Listening on udev Control Socket. [ OK ] Created slice User and Session Slice. [ 37.076092] Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS Mounting Kernel Debug File System... [ OK ] Started Forward Password Requests to Wall Directory Watch. Starting Remount Root and Kernel File Systems... [ OK ] Reached target rpc_pipefs.target. [ OK ] Reached target Slices. [ OK ] Created slice system-serial\x2dgetty.slice. [ OK ] Listening on RPCbind Server Activation Socket. Starting udev Coldplug all Devices... [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd Root File System. Mounting POSIX Message Queue File System... Starting Create list of required st…ce nodes for the current kernel... [ OK ] Created slice system-sshd\x2dkeygen.slice. [ OK ] Reached target RPC Port Mapper. [FAILED] Failed to set up automount Arbitrar…rmats File System Automount Point. See 'systemctl status proc-sys-fs-binfmt_misc.automount' for details. Starting Apply Kernel Variables... [ OK ] Reached target Paths. Mounting Huge Pages File System... [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Stopped target Initrd File Systems. [ OK ] Started Journal Service. [ OK ] Activated swap /dev/disk/by-label/SWAP. [ OK ] Mounted Kernel Debug File System. [FAILED] Failed to start Remount Root and Kernel File Systems. See 'systemctl status systemd-remount-fs.service' for details. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Apply Kernel Variables. [ OK ] Mounted Huge Pages File System. Starting Configure read-only root support... Starting Create Static Device Nodes in /dev... [ OK ] Reached target Swap. Starting Flush Journal to Persistent Storage... [ OK ] Started udev Coldplug all Devices. [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started Create Static Device Nodes in /dev. Starting udev Kernel Device Manager... [ OK ] Reached target Local File Systems (Pre). Mounting /mnt... Mounting /home/green/git/lustre-release... [ OK ] Mounted /mnt. [ 39.407604] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ OK ] Mounted /home/green/git/lustre-release. [ OK ] Started udev Kernel Device Manager. [ 40.898764] input: PC Speaker as /devices/platform/pcspkr/input/input5 [ 41.063460] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 42.091200] RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer [ 42.198400] EDAC sbridge: Ver: 1.1.2 [* ] A start job is running for Configur…-only root support (9s / no limit) [** ] A start job is running for Configur…only root support (10s / no limit) [*** ] A start job is running for Configur…only root support (10s / no limit) [ *** ] A start job is running for Configur…only root support (11s / no limit) [ *** ] A start job is running for Configur…only root support (11s / no limit) [ ***] A start job is running for Configur…only root support (12s / no limit) [ **] A start job is running for Configur…only root support (12s / no limit)[ 49.666871] Key type dns_resolver registered [ *] A start job is running for Configur…only root support (13s / no limit) [ **] A start job is running for Configur…only root support (14s / no limit)[ 50.494841] hrtimer: interrupt took 2930881 ns [ ***] A start job is running for Configur…only root support (14s / no limit)[ 51.122674] NFS: Registering the id_resolver key type [ 51.127983] Key type id_resolver registered [ 51.130920] Key type id_legacy registered [ *** ] A start job is running for Configur…only root support (15s / no limit) [ OK ] Started Configure read-only root support. Starting Load/Save Random Seed... [ OK ] Reached target Local File Systems. Starting Mark the need to relabel after reboot... Starting Rebuild Dynamic Linker Cache... Starting Create Volatile Files and Directories... [ OK ] Started Load/Save Random Seed. [ OK ] Started Mark the need to relabel after reboot. [ OK ] Started Create Volatile Files and Directories. Starting RPC Bind... Starting Update UTMP about System Boot/Shutdown... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Started RPC Bind. [ OK ] Started Rebuild Dynamic Linker Cache. Starting Update is Completed... [ OK ] Started Update is Completed. [ OK ] Reached target System Initialization. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. Starting Restore /run/initramfs on shutdown... [ OK ] Started irqbalance daemon. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. [ OK ] Started D-Bus System Message Bus. Starting Network Manager... [ OK ] Reached target sshd-keygen.target. Starting Login Service... [ OK ] Started dnf makecache --timer. [ OK ] Reached target Timers. [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Login Service. [ OK ] Started Network Manager. Starting Network Manager Wait Online... [ OK ] Reached target Network. Starting GSSAPI Proxy Daemon... Starting OpenSSH server daemon... Starting Dynamic System Tuning Daemon... Starting Hostname Service... [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Started OpenSSH server daemon. [ OK ] Started Permit User Sessions. [ OK ] Started Getty on tty1. [ OK ] Started Serial Getty on ttyS0. [ OK ] Started Serial Getty on ttyS1. [ OK ] Reached target Login Prompts. [ OK ] Started Command Scheduler. [ OK ] Started Hostname Service. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... Starting System Logging Service... Starting Notify NFS peers of a restart... [ OK ] Started Notify NFS peers of a restart. [ OK ] Started System Logging Service. Rocky Linux 8.10 (Green Obsidian) Kernel 4.18.0rh8.10-debug on an x86_64 oleg259-server login: [ 94.879818] libcfs: loading out-of-tree module taints kernel. [ 94.903229] Key type ._llcrypt registered [ 94.904758] Key type .llcrypt registered [ 94.976706] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_hostid [ 106.333702] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [ 107.252455] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 107.268718] alg: No test for adler32 (adler32-zlib) [ 108.367395] Lustre: Lustre: Build Version: 2.17.50_30_gbb2e37c [ 109.036617] LNet: Added LNI 192.168.202.159@tcp [8/256/0/180] [ 110.711179] Key type lgssc registered [ 111.526260] Lustre: Echo OBD driver; http://www.lustre.org/ [ 123.253981] ZFS: Loaded module v2.3.2-1, ZFS pool version 5000, ZFS filesystem version 5 [ 147.972812] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [ 155.564739] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 155.581580] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 156.771784] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 156.794133] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 156.840401] Lustre: lustre-MDT0000: new disk, initializing [ 156.911789] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 156.932162] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 158.951156] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 166.890107] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 166.965437] Lustre: 6470:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 166.981411] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 166.983690] Lustre: Skipped 1 previous similar message [ 167.036672] Lustre: lustre-MDT0001: new disk, initializing [ 167.087265] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 167.109372] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 167.114267] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 169.366422] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 172.318797] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 177.503494] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 177.597920] Lustre: lustre-OST0000: new disk, initializing [ 177.600115] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 177.629543] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 180.417323] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 180.420341] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 180.464896] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 181.069697] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 190.329151] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 190.408593] Lustre: lustre-OST0001: new disk, initializing [ 190.411238] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 190.444219] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 194.739646] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 197.122076] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 197.136124] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 197.175346] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 203.681217] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 207.448582] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 215.318423] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing check_logdir /tmp/testlogs/ [ 218.112229] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing yml_node [ 220.832558] Lustre: DEBUG MARKER: Client: 2.17.50.30 [ 222.429123] Lustre: DEBUG MARKER: MDS: 2.17.50.30 [ 224.034929] Lustre: DEBUG MARKER: OSS: 2.17.50.30 [ 225.048651] Lustre: DEBUG MARKER: -----============= acceptance-small: conf-sanity ============----- Fri Jan 16 01:59:16 EST 2026 [ 236.190525] Lustre: DEBUG MARKER: excepting tests: 102 106 115 32newtarball [ 237.190236] Lustre: DEBUG MARKER: skipping tests SLOW=no: 45 69 106 111 114 [ 253.407847] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 253.410129] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 253.414855] Lustre: Skipped 2 previous similar messages [ 253.417993] Lustre: Skipped 1 previous similar message [ 256.339403] LustreError: 12162:0:(obd_class.h:479:obd_check_dev()) Device 28 not setup [ 256.434546] Lustre: server umount lustre-MDT0000 complete [ 258.551036] LustreError: 6459:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768546790 with bad export cookie 5653383725561204665 [ 258.553236] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 258.557383] LustreError: 6459:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 263.647858] LustreError: 9835:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 263.648181] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 263.650983] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 263.660872] LustreError: 9835:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 6 previous similar messages [ 263.683428] Lustre: Skipped 2 previous similar messages [ 264.747524] LustreError: 12364:0:(obd_class.h:479:obd_check_dev()) Device 27 not setup [ 264.751360] LustreError: 12364:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 264.841027] Lustre: server umount lustre-MDT0001 complete [ 267.098201] LustreError: 12565:0:(obd_class.h:479:obd_check_dev()) Device 19 not setup [ 267.106189] LustreError: 12565:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 267.144916] Lustre: server umount lustre-OST0000 complete [ 269.264970] LustreError: 12765:0:(obd_class.h:479:obd_check_dev()) Device 2 not setup [ 269.267711] LustreError: 12765:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 269.334353] Lustre: server umount lustre-OST0001 complete [ 272.635081] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_hostid [ 277.707871] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [ 299.616481] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 299.867292] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 299.895684] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 299.966483] Lustre: lustre-MDT0000: new disk, initializing [ 300.062406] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 300.096783] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 304.219102] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 313.742617] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 313.854279] Lustre: 14933:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 313.899115] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 313.902627] Lustre: Skipped 1 previous similar message [ 313.964749] Lustre: lustre-MDT0001: new disk, initializing [ 314.051406] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 314.087653] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 314.102433] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 316.700634] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 322.099488] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 324.757463] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 329.019460] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 330.731424] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 330.740778] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 330.858495] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 333.095312] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 338.099817] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 340.375804] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 340.471067] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 342.961280] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 343.137961] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 346.087399] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 346.088581] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 346.088630] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 346.088636] Lustre: Skipped 1 previous similar message [ 346.095214] Lustre: Skipped 1 previous similar message [ 350.579207] LustreError: 17878:0:(obd_class.h:479:obd_check_dev()) Device 19 not setup [ 350.582450] LustreError: 17878:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 350.635687] Lustre: server umount lustre-OST0000 complete [ 355.296592] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 355.302714] LustreError: Skipped 1 previous similar message [ 355.308489] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 355.325768] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 355.331667] Lustre: Skipped 1 previous similar message [ 358.664110] LustreError: 18082:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup [ 358.666117] LustreError: 18082:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 358.698390] Lustre: server umount lustre-MDT0000 complete [ 360.848355] LustreError: 14924:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768546893 with bad export cookie 5653383725561206191 [ 360.850124] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 360.867158] LustreError: 14924:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 361.048578] Lustre: server umount lustre-MDT0001 complete [ 363.858485] Lustre: DEBUG MARKER: == conf-sanity test 76a: set permanent params with lctl across mounts ========================================================== 02:01:35 (1768546895) [ 368.170522] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 368.477768] LustreError: 18808:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 368.539870] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 368.543482] Lustre: Skipped 1 previous similar message [ 371.379364] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 373.731258] LustreError: 18808:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 377.506563] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 380.892781] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 385.391293] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 388.121277] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 393.803410] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 398.374282] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 401.756357] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 407.604304] Lustre: Modifying parameter general.osc.*.max_dirty_mb=452 in log params [ 413.667185] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 413.668360] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 413.672665] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 413.676982] Lustre: Skipped 2 previous similar messages [ 413.681900] Lustre: Skipped 4 previous similar messages [ 413.723466] LustreError: 21103:0:(obd_class.h:479:obd_check_dev()) Device 9 not setup [ 413.728106] LustreError: 21103:0:(obd_class.h:479:obd_check_dev()) Skipped 13 previous similar messages [ 413.806891] Lustre: server umount lustre-MDT0000 complete [ 416.119088] LustreError: 20999:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768546948 with bad export cookie 5653383725561207080 [ 416.120464] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 416.127720] LustreError: 20999:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 416.274355] Lustre: server umount lustre-MDT0001 complete [ 429.054645] Lustre: server umount lustre-OST0000 complete [ 442.090850] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [ 447.372880] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 447.700063] LustreError: 22829:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 447.757737] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 447.761332] Lustre: Skipped 2 previous similar messages [ 450.623405] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 453.089240] LustreError: 22829:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 455.969355] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 458.763834] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 460.681357] Lustre: Setting parameter general.debug_raw_pointers=Y in log params [ 465.482765] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 470.616617] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 476.913897] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 477.033424] Lustre: lustre-OST0001: new disk, initializing [ 477.035551] Lustre: Skipped 1 previous similar message [ 477.039372] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 477.046579] Lustre: Skipped 1 previous similar message [ 478.849967] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 478.859361] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 478.919444] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 481.363775] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 488.111496] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 490.544163] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 503.348178] LustreError: 26300:0:(obd_class.h:479:obd_check_dev()) Device 28 not setup [ 503.352271] LustreError: 26300:0:(obd_class.h:479:obd_check_dev()) Skipped 17 previous similar messages [ 503.411850] Lustre: server umount lustre-MDT0000 complete [ 504.805789] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 504.813415] Lustre: Skipped 2 previous similar messages [ 504.815858] LustreError: 22823:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 504.828199] LustreError: 22823:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 505.436083] LustreError: 23933:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768547037 with bad export cookie 5653383725561207927 [ 505.440869] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 505.442841] LustreError: 23933:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 509.923112] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 509.926385] Lustre: Skipped 1 previous similar message [ 511.637166] Lustre: server umount lustre-MDT0001 complete [ 514.103474] Lustre: server umount lustre-OST0000 complete [ 516.561626] Lustre: server umount lustre-OST0001 complete [ 527.366764] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [ 533.858366] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 534.099606] LustreError: 28074:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 534.112386] LustreError: 28074:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 4 previous similar messages [ 534.175734] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 534.179641] Lustre: Skipped 3 previous similar messages [ 536.851380] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 541.749134] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 544.341683] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 546.052724] Lustre: 29187:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 550.269304] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 554.037588] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 559.232913] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 562.670362] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 567.530394] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 569.559587] Lustre: 31039:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 578.017399] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 578.020933] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 578.025943] Lustre: Skipped 3 previous similar messages [ 578.028629] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 578.035110] Lustre: Skipped 2 previous similar messages [ 583.653120] LustreError: 31242:0:(obd_class.h:479:obd_check_dev()) Device 10 not setup [ 583.657296] LustreError: 31242:0:(obd_class.h:479:obd_check_dev()) Skipped 25 previous similar messages [ 583.704920] Lustre: server umount lustre-MDT0000 complete [ 585.188165] LustreError: 28994:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 585.203273] LustreError: 28994:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 8 previous similar messages [ 586.085322] LustreError: 31041:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768547118 with bad export cookie 5653383725561209222 [ 586.088729] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 586.090391] LustreError: 31041:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 586.253146] Lustre: server umount lustre-MDT0001 complete [ 598.561977] Lustre: server umount lustre-OST0000 complete [ 611.446708] Lustre: server umount lustre-OST0001 complete [ 617.219916] Lustre: DEBUG MARKER: == conf-sanity test 76b: verify params log setup correctly ========================================================== 02:05:48 (1768547148) [ 634.723985] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [ 640.492412] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 643.454784] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 648.943290] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 652.132639] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 653.901852] Lustre: 34935:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 657.980816] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 659.304118] LustreError: 35291:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 659.312914] LustreError: 35291:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 661.522349] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 666.377479] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 666.569708] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 666.575104] Lustre: Skipped 6 previous similar messages [ 669.486429] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 673.602138] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 675.725370] Lustre: 36786:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 685.027895] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 685.038055] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 685.046824] Lustre: Skipped 3 previous similar messages [ 685.051321] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 685.053860] Lustre: Skipped 4 previous similar messages [ 689.278137] Lustre: server umount lustre-MDT0000 complete [ 691.120702] LustreError: 33801:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768547223 with bad export cookie 5653383725561210328 [ 691.125930] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 691.255442] Lustre: server umount lustre-MDT0001 complete [ 703.622931] Lustre: server umount lustre-OST0000 complete [ 714.843453] LustreError: 37542:0:(obd_class.h:479:obd_check_dev()) Device 2 not setup [ 714.852115] LustreError: 37542:0:(obd_class.h:479:obd_check_dev()) Skipped 45 previous similar messages [ 714.956463] Lustre: server umount lustre-OST0001 complete [ 720.414921] Lustre: DEBUG MARKER: == conf-sanity test 76c: verify changelog_mask is applied with lctl set_param -P ========================================================== 02:07:31 (1768547251) [ 729.407256] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [ 734.953510] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 737.564714] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 741.972252] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 744.689631] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 746.546184] Lustre: 40020:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 750.752362] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 755.130382] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 760.561132] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 764.318657] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 769.133145] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 776.918136] Lustre: Setting parameter general.mdd.*.changelog_mask=-CLOSE in log params [ 776.921535] Lustre: Skipped 1 previous similar message [ 781.284837] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 781.289879] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 781.292468] Lustre: Skipped 5 previous similar messages [ 781.295189] Lustre: Skipped 6 previous similar messages [ 784.821922] Lustre: server umount lustre-MDT0000 complete [ 787.363589] LustreError: 41872:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768547319 with bad export cookie 5653383725561211434 [ 787.364831] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 787.371552] LustreError: 41872:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 7 previous similar messages [ 791.527186] LustreError: 40346:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.59@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 791.538975] LustreError: 40346:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 14 previous similar messages [ 793.608789] Lustre: server umount lustre-MDT0001 complete [ 797.642102] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 811.999778] LustreError: 3624:0:(client.c:1390:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff9b703260c700 x1854455562977024/t0(0) o250->MGC192.168.202.159@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 814.233766] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 818.774767] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 821.331145] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 822.121360] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 825.036488] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 827.910160] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 2 sec [ 829.730512] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 832.779571] Lustre: DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 2 sec [ 842.690736] Lustre: server umount lustre-MDT0000 complete [ 850.738660] LustreError: 41872:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768547383 with bad export cookie 5653383725561212624 [ 850.746579] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 850.754115] LustreError: 41872:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 851.123298] Lustre: server umount lustre-MDT0001 complete [ 864.858366] Lustre: server umount lustre-OST0000 complete [ 868.831304] Lustre: 3628:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1768547385/real 1768547385] req@ffff9b6f02f19180 x1854455563009024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1768547401 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 871.274479] Lustre: server umount lustre-OST0001 complete [ 881.428361] Lustre: DEBUG MARKER: == conf-sanity test 76d: verify llite.*.xattr_cache can be set by 'lctl set_param -P' correctly ========================================================== 02:10:12 (1768547412) [ 913.337479] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [ 925.686785] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 926.166384] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 926.169745] Lustre: Skipped 6 previous similar messages [ 930.191902] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 938.586265] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 943.717499] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 947.397936] Lustre: 47381:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 947.405189] Lustre: 47381:0:(mgs_llog.c:1348:mgs_modify_param()) Skipped 1 previous similar message [ 954.431896] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 960.809561] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 970.695895] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 977.808269] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 985.304457] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 994.789511] Lustre: Setting parameter general.llite.*.xattr_cache=0 in log params [ 1010.656661] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1010.661056] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1010.698272] Lustre: Skipped 8 previous similar messages [ 1010.728217] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1010.741964] Lustre: Skipped 11 previous similar messages [ 1010.838641] LustreError: 49454:0:(obd_class.h:479:obd_check_dev()) Device 10 not setup [ 1010.850180] LustreError: 49454:0:(obd_class.h:479:obd_check_dev()) Skipped 47 previous similar messages [ 1010.951881] Lustre: server umount lustre-MDT0000 complete [ 1015.186374] LustreError: 46241:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768547547 with bad export cookie 5653383725561213408 [ 1015.192077] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1015.199649] LustreError: 46241:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 1015.939518] Lustre: server umount lustre-MDT0001 complete [ 1031.265954] Lustre: server umount lustre-OST0000 complete [ 1034.208107] Lustre: 3627:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1768547550/real 1768547550] req@ffff9b6f01b37100 x1854455563070592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1768547566 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 1035.690325] Lustre: server umount lustre-OST0001 complete [ 1045.690414] Lustre: DEBUG MARKER: == conf-sanity test 77: comma-separated MGS NIDs and failover node NIDs ========================================================== 02:12:56 (1768547576) [ 1048.727304] Lustre: DEBUG MARKER: SKIP: conf-sanity test_77 mixed loopback and real device not working [ 1050.893627] Lustre: DEBUG MARKER: == conf-sanity test 78: run resize2fs on MDT and OST filesystems ========================================================== 02:13:01 (1768547581) [ 1062.715552] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_hostid [ 1073.927932] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [ 1098.515314] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1098.908310] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1099.000228] Lustre: lustre-MDT0000: new disk, initializing [ 1099.177550] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1103.564812] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 1111.513352] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1118.607256] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1120.511081] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 1120.558165] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 1126.134080] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 1135.065488] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1138.065860] Lustre: DEBUG MARKER: create test files [ 1177.015700] Lustre: server umount lustre-OST0000 complete [ 1191.622670] Lustre: server umount lustre-MDT0000 complete [ 1203.808504] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing unload_modules_local [ 1207.263822] Key type lgssc unregistered [ 1207.550925] LNet: 54783:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1207.557541] LNetError: 54783:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1207.579808] LNet: Removed LNI 192.168.202.159@tcp [ 1208.750359] Key type .llcrypt unregistered [ 1208.759512] Key type ._llcrypt unregistered [ 1238.668276] Key type ._llcrypt registered [ 1238.669933] Key type .llcrypt registered [ 1238.779669] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [ 1239.937867] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1239.984928] alg: No test for adler32 (adler32-zlib) [ 1241.101308] Lustre: Lustre: Build Version: 2.17.50_30_gbb2e37c [ 1241.276860] LNet: Added LNI 192.168.202.159@tcp [8/256/0/180] [ 1242.887206] Key type lgssc registered [ 1244.104940] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1252.475669] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1252.514924] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1254.272749] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1259.050143] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 1266.461383] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1274.556173] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1275.048974] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1279.149849] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:102 to 0x240000400:129) [ 1279.215746] Lustre: 57385:0:(osd_internal.h:1459:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 515 < left 544, rollback = 9 [ 1279.223776] Lustre: 57385:0:(osd_handler.c:2096:osd_trans_dump_creds()) create: 32/128/0, destroy: 0/0/0 [ 1279.227587] Lustre: 57385:0:(osd_handler.c:2103:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 1279.240110] Lustre: 57385:0:(osd_handler.c:2113:osd_trans_dump_creds()) write: 2/13/1, punch: 0/0/0, quota 1/3/0 [ 1279.249236] Lustre: 57385:0:(osd_handler.c:2120:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 1279.256681] Lustre: 57385:0:(osd_handler.c:2127:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 1281.512579] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 1287.714655] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1292.747258] Lustre: DEBUG MARKER: check files after expanding the MDT and OST filesystems [ 1299.137469] Lustre: DEBUG MARKER: create more files after expanding the MDT and OST filesystems [ 1310.178418] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1310.211644] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1313.353111] LustreError: 58128:0:(obd_class.h:479:obd_check_dev()) Device 13 not setup [ 1313.465958] Lustre: server umount lustre-OST0000 complete [ 1318.100610] LustreError: 58329:0:(obd_class.h:479:obd_check_dev()) Device 8 not setup [ 1318.108699] LustreError: 58329:0:(obd_class.h:479:obd_check_dev()) Skipped 1 previous similar message [ 1318.412656] Lustre: server umount lustre-MDT0000 complete [ 1329.892336] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing unload_modules_local [ 1333.324471] Key type lgssc unregistered [ 1333.735307] LNet: 58862:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1333.751449] LNetError: 58862:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1333.788766] LNet: Removed LNI 192.168.202.159@tcp [ 1334.669443] Key type .llcrypt unregistered [ 1334.671815] Key type ._llcrypt unregistered [ 1371.003942] Key type ._llcrypt registered [ 1371.012310] Key type .llcrypt registered [ 1371.131770] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [ 1372.505775] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1372.549205] alg: No test for adler32 (adler32-zlib) [ 1373.762642] Lustre: Lustre: Build Version: 2.17.50_30_gbb2e37c [ 1374.076629] LNet: Added LNI 192.168.202.159@tcp [8/256/0/180] [ 1375.799223] Key type lgssc registered [ 1377.439218] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1386.725986] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1386.777651] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1388.284435] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1392.880159] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 1399.744817] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1407.278595] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1407.696446] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1412.800626] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:140 to 0x240000400:161) [ 1412.895878] Lustre: 61567:0:(osd_internal.h:1459:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 515 < left 544, rollback = 9 [ 1412.912336] Lustre: 61567:0:(osd_handler.c:2096:osd_trans_dump_creds()) create: 32/128/0, destroy: 0/0/0 [ 1412.921317] Lustre: 61567:0:(osd_handler.c:2103:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 1412.929313] Lustre: 61567:0:(osd_handler.c:2113:osd_trans_dump_creds()) write: 2/13/1, punch: 0/0/0, quota 1/3/0 [ 1412.934450] Lustre: 61567:0:(osd_handler.c:2120:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 1412.947242] Lustre: 61567:0:(osd_handler.c:2127:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 1415.011561] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 1422.384139] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1427.745123] Lustre: DEBUG MARKER: check files after shrinking the MDT and OST filesystems [ 1469.409656] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1469.428438] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1469.445270] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1474.221237] LustreError: 62283:0:(obd_class.h:479:obd_check_dev()) Device 13 not setup [ 1474.403481] Lustre: server umount lustre-OST0000 complete [ 1479.410956] LustreError: 62485:0:(obd_class.h:479:obd_check_dev()) Device 8 not setup [ 1479.421906] LustreError: 62485:0:(obd_class.h:479:obd_check_dev()) Skipped 1 previous similar message [ 1479.782939] Lustre: server umount lustre-MDT0000 complete [ 1494.023215] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing unload_modules_local [ 1497.321426] Key type lgssc unregistered [ 1497.779079] LNet: 63019:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1497.785539] LNetError: 63019:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1497.813828] LNet: Removed LNI 192.168.202.159@tcp [ 1498.643244] Key type .llcrypt unregistered [ 1498.646048] Key type ._llcrypt unregistered [ 1520.378261] Key type ._llcrypt registered [ 1520.380823] Key type .llcrypt registered [ 1520.511809] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_hostid [ 1536.738827] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [ 1537.871405] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1538.029432] alg: No test for adler32 (adler32-zlib) [ 1539.238559] Lustre: Lustre: Build Version: 2.17.50_30_gbb2e37c [ 1539.456843] LNet: Added LNI 192.168.202.159@tcp [8/256/0/180] [ 1541.151234] Key type lgssc registered [ 1542.775117] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1588.852394] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1588.909135] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1590.342691] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1590.437720] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1590.690029] Lustre: lustre-MDT0000: new disk, initializing [ 1590.882964] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1590.933784] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1597.745236] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 1612.310903] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1612.570535] Lustre: 66134:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1612.675217] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 1612.682938] Lustre: Skipped 1 previous similar message [ 1612.837890] Lustre: lustre-MDT0001: new disk, initializing [ 1613.077251] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1613.168810] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 1613.201414] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1619.485885] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 1628.675260] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1632.664751] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1640.654561] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1641.078721] Lustre: lustre-OST0000: new disk, initializing [ 1641.090948] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1641.219088] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1647.375768] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 1647.755233] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 1647.772525] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1647.890911] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1657.027581] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1663.299966] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1663.696586] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1670.004232] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1670.465369] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1673.706785] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1673.721809] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1673.723718] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1673.771943] Lustre: Skipped 1 previous similar message [ 1678.817065] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1678.829223] Lustre: Skipped 2 previous similar messages [ 1679.175180] LustreError: 69070:0:(obd_class.h:479:obd_check_dev()) Device 19 not setup [ 1679.395458] Lustre: server umount lustre-OST0000 complete [ 1684.966655] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1684.971520] LustreError: Skipped 1 previous similar message [ 1684.974927] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1684.985165] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1689.057134] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1689.058615] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1691.050513] LustreError: 69273:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup [ 1691.070052] LustreError: 69273:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 1691.589393] Lustre: server umount lustre-MDT0000 complete [ 1697.403671] LustreError: 66129:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768548229 with bad export cookie 14923387243452748996 [ 1697.418056] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1697.427439] LustreError: 66129:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 1697.646442] LustreError: 69475:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 1697.660185] LustreError: 69475:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 1698.081874] Lustre: server umount lustre-MDT0001 complete [ 1709.253681] Lustre: DEBUG MARKER: == conf-sanity test 79: format MDT/OST without mgs option (should return errors) ========================================================== 02:24:00 (1768548240) [ 1721.204595] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [ 1772.122533] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_hostid [ 1784.010549] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [ 1821.579184] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1821.881762] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1821.904718] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1821.998312] Lustre: lustre-MDT0000: new disk, initializing [ 1822.111697] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1822.137243] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1826.887369] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 1839.657668] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1839.842790] Lustre: 73702:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1839.899482] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 1839.903322] Lustre: Skipped 1 previous similar message [ 1839.971778] Lustre: lustre-MDT0001: new disk, initializing [ 1840.078677] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1840.122052] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 1840.132485] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1845.048317] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 1854.741721] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1859.836465] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1870.275274] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1870.952942] Lustre: lustre-OST0000: new disk, initializing [ 1870.998391] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1871.245533] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1878.171679] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 1878.218472] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1878.448567] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1880.893948] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 1889.934774] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1893.961597] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1894.046321] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1899.843750] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1900.188272] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1904.096804] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1904.110889] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1904.123326] LustreError: Skipped 1 previous similar message [ 1904.128929] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1904.151678] Lustre: Skipped 1 previous similar message [ 1904.170214] Lustre: Skipped 2 previous similar messages [ 1908.622497] LustreError: 76646:0:(obd_class.h:479:obd_check_dev()) Device 19 not setup [ 1908.628129] LustreError: 76646:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 1908.880519] Lustre: server umount lustre-OST0000 complete [ 1914.338996] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1914.343295] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1914.354761] Lustre: Skipped 1 previous similar message [ 1914.376135] Lustre: Skipped 1 previous similar message [ 1920.198217] LustreError: 76848:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup [ 1920.208331] LustreError: 76848:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 1920.407187] Lustre: server umount lustre-MDT0000 complete [ 1924.582573] LustreError: 73709:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1924.619951] LustreError: 73709:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 4 previous similar messages [ 1925.057367] LustreError: 73696:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768548457 with bad export cookie 14923387243452749878 [ 1925.069443] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1925.411732] Lustre: server umount lustre-MDT0001 complete [ 1935.095427] Lustre: DEBUG MARKER: == conf-sanity test 80: mgc import reconnect race ======== 02:27:45 (1768548465) [ 1942.568740] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1943.115052] LustreError: 77720:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1943.210425] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1947.532987] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 1948.644379] LustreError: 77720:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1952.749383] LustreError: 77720:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1957.118291] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1961.441100] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 1966.907853] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1970.826199] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1978.052531] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 1978.437255] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1978.445570] Lustre: Skipped 1 previous similar message [ 1985.106685] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 1990.911190] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1994.585552] Lustre: 80054:0:(genops.c:1791:obd_export_evict_by_uuid()) MGS: evicting d6f1235c-dae0-470f-a543-869f384790eb at adminstrative request [ 1999.333847] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1999.355051] Lustre: *** cfs_fail_loc=906, val=2147483648*** [ 2009.572797] Lustre: MGS: Client d6f1235c-dae0-470f-a543-869f384790eb (at 0@lo) reconnecting [ 2009.592615] Lustre: Evicted from MGS (at 0@lo) after server handle changed from 0xcf1a85a16398dba8 to 0xcf1a85a16398de48 [ 2009.631050] Lustre: MGC192.168.202.159@tcp: Connection restored to 0@lo (at 0@lo) [ 2034.959362] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 2035.281672] Lustre: lustre-OST0001: new disk, initializing [ 2035.300481] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 2042.306807] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 2044.039993] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 2044.047281] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 2044.203938] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 2051.356178] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 2059.750378] LustreError: lustre-OST0001-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2059.757286] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2059.766708] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 2059.766718] Lustre: Skipped 2 previous similar messages [ 2059.768200] LustreError: Skipped 1 previous similar message [ 2059.814220] Lustre: Skipped 1 previous similar message [ 2060.802548] LustreError: 81188:0:(obd_class.h:479:obd_check_dev()) Device 25 not setup [ 2060.807729] LustreError: 81188:0:(obd_class.h:479:obd_check_dev()) Skipped 13 previous similar messages [ 2060.893914] Lustre: server umount lustre-OST0001 complete [ 2064.870905] LustreError: 79315:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2064.909288] LustreError: 79315:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 2065.890083] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2071.769961] Lustre: server umount lustre-OST0000 complete [ 2080.228036] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2080.249888] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2080.250244] Lustre: Skipped 3 previous similar messages [ 2080.276913] LustreError: Skipped 1 previous similar message [ 2081.906356] LustreError: 81593:0:(obd_class.h:479:obd_check_dev()) Device 28 not setup [ 2081.915973] LustreError: 81593:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 2082.119950] Lustre: server umount lustre-MDT0000 complete [ 2085.344450] LustreError: 78430:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2085.359916] LustreError: 78430:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 2086.491980] LustreError: 77702:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768548618 with bad export cookie 14923387243452751432 [ 2086.498606] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2086.508794] LustreError: 77702:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 6 previous similar messages [ 2086.867823] Lustre: server umount lustre-MDT0001 complete [ 2095.444444] Lustre: DEBUG MARKER: == conf-sanity test 81: sparse OST indexing ============== 02:30:26 (1768548626) [ 2097.290578] Lustre: DEBUG MARKER: SKIP: conf-sanity test_81 needs >= 3 OSTs [ 2099.521794] Lustre: DEBUG MARKER: == conf-sanity test 82a: specify OSTs for file (succeed) or directory (succeed) ========================================================== 02:30:30 (1768548630) [ 2101.717925] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82a needs >= 3 OSTs [ 2103.471596] Lustre: DEBUG MARKER: == conf-sanity test 82b: specify OSTs for file with --pool and --ost-list options ========================================================== 02:30:34 (1768548634) [ 2105.222372] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82b needs >= 4 OSTs [ 2107.382118] Lustre: DEBUG MARKER: == conf-sanity test 82c: specify sparse OSTs for setstripe (should not crash) ========================================================== 02:30:37 (1768548637) [ 2109.108834] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82c needs >= 4 OSTs [ 2111.149955] Lustre: DEBUG MARKER: == conf-sanity test 83: ENOSPACE on OST doesn't cause message VFS: Busy inodes after unmount ... ========================================================== 02:30:41 (1768548641) [ 2113.101533] Lustre: DEBUG MARKER: mount the OST /dev/mapper/ost1_flakey as a ldiskfs filesystem [ 2121.026179] loop: module loaded [ 2121.046816] loop0: detected capacity change from 0 to 4294967296 [ 2121.116533] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 2122.791200] Lustre: DEBUG MARKER: run llverfs in partial mode on the OST ldiskfs /mnt/lustre-ost1 [ 2126.539457] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing run_llverfs /mnt/lustre-ost1 -vpl no [ 2131.232653] Lustre: DEBUG MARKER: unmount the OST /dev/mapper/ost1_flakey [ 2163.614722] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 2163.673080] LustreError: 84444:0:(obd_config.c:783:class_setup()) setup lustre-OST0000-osd failed (-28) [ 2163.685629] LustreError: 84444:0:(obd_mount.c:193:lustre_start_simple()) lustre-OST0000-osd setup error -28 [ 2163.701521] LustreError: 84444:0:(tgt_mount.c:2451:server_fill_super()) Unable to start osd on /dev/mapper/ost1_flakey: -28 [ 2163.714713] LustreError: 84444:0:(super25.c:199:lustre_fill_super()) llite: Unable to mount : rc = -28 [ 2185.053649] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_hostid [ 2196.694415] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [ 2235.139776] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2235.420197] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2235.489150] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2235.631155] Lustre: lustre-MDT0000: new disk, initializing [ 2235.737783] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2235.740992] Lustre: Skipped 1 previous similar message [ 2235.756687] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2241.164714] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 2251.728186] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 2251.902871] Lustre: 87276:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2252.211984] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2256.726574] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 2267.382147] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2272.192863] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2280.268802] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 2287.440668] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 2289.740773] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2289.887188] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2295.629500] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2300.271324] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2300.446286] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2305.110428] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2305.369794] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2310.626249] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2310.629619] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2310.632037] LustreError: Skipped 1 previous similar message [ 2310.633287] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2310.633292] Lustre: Skipped 6 previous similar messages [ 2310.668985] Lustre: Skipped 1 previous similar message [ 2313.492721] LustreError: 90207:0:(obd_class.h:479:obd_check_dev()) Device 19 not setup [ 2313.498537] LustreError: 90207:0:(obd_class.h:479:obd_check_dev()) Skipped 17 previous similar messages [ 2313.901728] Lustre: server umount lustre-OST0000 complete [ 2324.240459] Lustre: server umount lustre-MDT0000 complete [ 2325.988047] LustreError: 87286:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2326.016216] LustreError: 87286:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 2327.847955] LustreError: 87267:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768548860 with bad export cookie 14923387243452752027 [ 2327.850387] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2327.858023] LustreError: 87267:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2328.193943] Lustre: server umount lustre-MDT0001 complete [ 2336.450274] Lustre: DEBUG MARKER: == conf-sanity test 84: check recovery_hard_time ========= 02:34:27 (1768548867) [ 2342.800389] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2348.200505] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 2356.008896] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 2360.599700] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 2366.011921] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2370.121713] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2377.383810] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 2377.749086] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2377.756762] Lustre: Skipped 4 previous similar messages [ 2385.479319] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 2392.723621] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2399.417478] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2399.827806] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2405.313746] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2405.546298] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2413.695276] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 2413.942937] Lustre: lustre-OST0001: new disk, initializing [ 2413.948834] Lustre: Skipped 2 previous similar messages [ 2413.962169] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 2413.968322] Lustre: Skipped 3 previous similar messages [ 2420.471880] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 2422.906136] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 2422.918951] Lustre: Skipped 2 previous similar messages [ 2422.929014] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 2423.016455] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 2428.867717] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 2434.421818] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid 50 [ 2434.653627] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2439.698209] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [ 2439.963728] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2460.370317] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 2481.896996] Lustre: Failing over lustre-MDT0000 [ 2482.278704] LustreError: 96185:0:(obd_class.h:479:obd_check_dev()) Device 28 not setup [ 2482.282599] LustreError: 96185:0:(obd_class.h:479:obd_check_dev()) Skipped 17 previous similar messages [ 2482.393949] Lustre: server umount lustre-MDT0000 complete [ 2484.237201] LustreError: 91277:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.59@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2484.263506] LustreError: 91277:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 4 previous similar messages [ 2484.719158] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2484.721881] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2484.741884] Lustre: Skipped 4 previous similar messages [ 2484.760971] LustreError: Skipped 1 previous similar message [ 2500.067192] Lustre: 64357:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1768549016/real 1768549017] req@0000000007a292c6 x1854457062370304/t0(0) o400->MGC192.168.202.159@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1768549032 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 2500.123322] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2507.850260] LDISKFS-fs (dm-0): 4 truncates cleaned up [ 2507.853305] LDISKFS-fs (dm-0): recovery complete [ 2507.882833] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2510.047149] LustreError: 96905:0:(import.c:337:ptlrpc_invalidate_import()) MGS: timeout waiting for callback (1 != 0) [ 2510.054814] LustreError: 96905:0:(import.c:361:ptlrpc_invalidate_import()) @@@ still on sending list req@0000000031c847eb x1854457062375936/t0(0) o250->MGC192.168.202.159@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1768549042 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 2510.094844] LustreError: 96905:0:(import.c:371:ptlrpc_invalidate_import()) MGS: Unregistering RPCs found (0). Network is sluggish? Waiting for them to error out. [ 2510.307179] LustreError: 64356:0:(client.c:1390:ptlrpc_import_delay_req()) @@@ invalidate in flight req@0000000012228ce0 x1854457062378368/t0(0) o250->MGC192.168.202.159@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 2510.653727] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 2514.913647] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 2514.919537] Lustre: 91278:0:(ldlm_lib.c:2068:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 2515.373863] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 2515.957957] Lustre: 92645:0:(ldlm_lib.c:2068:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 2515.963644] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 2515.966516] Lustre: 92645:0:(ldlm_lib.c:2068:extend_recovery_timer()) Skipped 1 previous similar message [ 2516.056646] LustreError: 96935:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2516.381872] LustreError: 96935:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2516.711025] LustreError: 96935:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2516.718154] LustreError: 96935:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 1 previous similar message [ 2517.039928] LustreError: 96935:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2517.050971] LustreError: 96935:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 1 previous similar message [ 2517.066280] Lustre: 96935:0:(ldlm_lib.c:2068:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2517.084070] Lustre: 96935:0:(ldlm_lib.c:2068:extend_recovery_timer()) Skipped 7 previous similar messages [ 2517.736165] LustreError: 96935:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2517.743104] LustreError: 96935:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 2 previous similar messages [ 2518.063122] LustreError: 96935:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2518.078529] LustreError: 96935:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 2 previous similar messages [ 2519.371276] Lustre: 96935:0:(ldlm_lib.c:2068:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2519.382646] Lustre: 96935:0:(ldlm_lib.c:2068:extend_recovery_timer()) Skipped 6 previous similar messages [ 2520.041026] LustreError: 96935:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2520.051829] LustreError: 96935:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 6 previous similar messages [ 2520.377943] LustreError: 96935:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2520.386549] LustreError: 96935:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 6 previous similar messages [ 2523.544168] Lustre: 96935:0:(ldlm_lib.c:2068:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2523.560702] Lustre: 96935:0:(ldlm_lib.c:2068:extend_recovery_timer()) Skipped 12 previous similar messages [ 2524.208147] LustreError: 96935:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2524.226190] LustreError: 96935:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 12 previous similar messages [ 2524.551939] LustreError: 96935:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2524.568433] LustreError: 96935:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 12 previous similar messages [ 2531.573718] Lustre: 96935:0:(ldlm_lib.c:2068:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2531.593855] Lustre: 96935:0:(ldlm_lib.c:2068:extend_recovery_timer()) Skipped 24 previous similar messages [ 2532.249758] LustreError: 96935:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2532.257990] LustreError: 96935:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 24 previous similar messages [ 2532.583518] LustreError: 96935:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2532.603639] LustreError: 96935:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 24 previous similar messages [ 2547.620213] Lustre: 96935:0:(ldlm_lib.c:2068:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2547.637036] Lustre: 96935:0:(ldlm_lib.c:2068:extend_recovery_timer()) Skipped 49 previous similar messages [ 2548.283701] LustreError: 96935:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2548.297692] LustreError: 96935:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 49 previous similar messages [ 2548.625599] LustreError: 96935:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2548.649469] LustreError: 96935:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 49 previous similar messages [ 2574.207143] Lustre: 96935:0:(ldlm_lib.c:2377:target_recovery_overseer()) lustre-MDT0000 recovery is aborted by hard timeout [ 2574.223575] Lustre: 96935:0:(ldlm_lib.c:2387:target_recovery_overseer()) recovery is aborted, evict exports in recovery [ 2574.233227] Lustre: 96935:0:(genops.c:1618:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client 41384c53-b3a1-4ba6-b71e-61e38f5b8626@192.168.202.59@tcp [ 2574.244287] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 2574.249641] Lustre: 96935:0:(ldlm_lib.c:1897:abort_req_replay_queue()) @@@ aborted: req@000000007f6b453c x1854457046440064/t0(8589934779) o101->41384c53-b3a1-4ba6-b71e-61e38f5b8626@192.168.202.59@tcp:122/0 lens 592/0 e 0 to 0 dl 1768549117 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:0 [ 2574.270187] Lustre: lustre-MDT0000-osd: cancel update llog [0x200000400:0x1:0x0] [ 2574.293288] Lustre: lustre-MDT0000: Denying connection for new client 41384c53-b3a1-4ba6-b71e-61e38f5b8626 (at 192.168.202.59@tcp), waiting for 3 known clients (2 recovered, 0 in progress, and 1 evicted) to recover in 0:00 [ 2574.301113] Lustre: lustre-MDT0001-osp-MDT0000: cancel update llog [0x240000401:0x1:0x0] [ 2574.385058] Lustre: lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 2574.396819] Lustre: lustre-MDT0000: Recovery over after 1:00, of 3 clients 2 recovered and 1 was evicted. [ 2574.398082] Lustre: Skipped 2 previous similar messages [ 2574.437231] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:79 to 0x280000401:577) [ 2574.439065] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:48 to 0x2c0000401:545) [ 2590.690714] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2590.713723] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2590.716571] Lustre: Skipped 4 previous similar messages [ 2596.691963] Lustre: server umount lustre-OST0000 complete [ 2597.875100] LustreError: 92876:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2597.901212] LustreError: 92876:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 37 previous similar messages [ 2607.860864] Lustre: server umount lustre-OST0001 complete [ 2613.227907] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2613.239147] Lustre: Skipped 6 previous similar messages [ 2617.987488] LustreError: 97998:0:(obd_class.h:479:obd_check_dev()) Device 10 not setup [ 2618.002146] LustreError: 97998:0:(obd_class.h:479:obd_check_dev()) Skipped 15 previous similar messages [ 2618.378401] Lustre: server umount lustre-MDT0000 complete [ 2622.211597] LustreError: 91261:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768549154 with bad export cookie 14923387243452803246 [ 2622.214347] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2622.226067] LustreError: 91261:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2622.846820] Lustre: server umount lustre-MDT0001 complete [ 2633.799942] Lustre: DEBUG MARKER: == conf-sanity test 85: osd_ost init: fail ea_fid_set ==== 02:39:24 (1768549164) [ 2641.790229] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 2641.797728] Lustre: *** cfs_fail_loc=197, val=0*** [ 2657.503902] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 2662.623482] LustreError: 98891:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.202.159@tcp: failed processing log, type 4: rc = -110 [ 2667.790803] Lustre: *** cfs_fail_loc=197, val=0*** [ 2667.793162] Lustre: Skipped 65 previous similar messages [ 2688.354303] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2688.366470] Lustre: Skipped 2 previous similar messages [ 2696.561501] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 2703.893554] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2706.700583] Lustre: server umount lustre-OST0000 complete [ 2716.627647] Lustre: DEBUG MARKER: == conf-sanity test 86: Replacing mkfs.lustre -G option == 02:40:47 (1768549247) [ 2739.362698] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2740.066311] LustreError: 100401:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2740.093514] LustreError: 100401:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 4 previous similar messages [ 2744.470536] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 2752.372263] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2756.792253] LustreError: 100431:0:(osp_object.c:617:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x200000009:0x1:0x0]: rc = -5 [ 2756.805569] LustreError: 100431:0:(lod_sub_object.c:917:lod_sub_prep_llog()) lustre-MDT0000-mdtlov: can't get id from catalogs: rc = -5 [ 2756.818602] LustreError: 100431:0:(lod_dev.c:510:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 17, retries 0, failed: rc = -5 [ 2757.165390] Lustre: server umount lustre-MDT0000 complete [ 2790.050785] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_hostid [ 2799.598739] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [ 2838.850376] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2839.159965] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2839.212917] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2839.346778] Lustre: lustre-MDT0000: new disk, initializing [ 2839.546106] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2844.416808] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 2857.007444] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 2857.208815] Lustre: 104469:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2857.685756] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2862.488587] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 2870.367400] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2874.368753] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2882.258565] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 2890.221526] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 2891.578229] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2898.071438] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2902.892335] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2903.099594] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2908.028227] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2908.245286] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2912.234065] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2912.239871] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2912.286455] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2912.293987] LustreError: Skipped 2 previous similar messages [ 2912.309371] Lustre: Skipped 8 previous similar messages [ 2916.671938] LustreError: 107403:0:(obd_class.h:479:obd_check_dev()) Device 19 not setup [ 2916.681900] LustreError: 107403:0:(obd_class.h:479:obd_check_dev()) Skipped 33 previous similar messages [ 2916.795922] Lustre: server umount lustre-OST0000 complete [ 2927.423499] Lustre: server umount lustre-MDT0000 complete [ 2930.940725] LustreError: 105249:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768549463 with bad export cookie 14923387243452813900 [ 2930.945815] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2930.952268] LustreError: 105249:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 1 previous similar message [ 2931.394919] Lustre: server umount lustre-MDT0001 complete [ 2939.847345] Lustre: DEBUG MARKER: == conf-sanity test 87: check if MDT inode can hold EAs with N stripes properly ========================================================== 02:44:30 (1768549470) [ 2950.215786] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing unload_modules_local [ 2952.804690] Key type lgssc unregistered [ 2953.141772] LNet: 108533:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2953.159373] LNetError: 108533:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2953.202764] LNet: Removed LNI 192.168.202.159@tcp [ 2954.100573] Key type .llcrypt unregistered [ 2954.107158] Key type ._llcrypt unregistered [ 2977.748726] Key type ._llcrypt registered [ 2977.757823] Key type .llcrypt registered [ 2977.922890] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_hostid [ 2997.255710] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [ 2999.355424] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2999.484442] alg: No test for adler32 (adler32-zlib) [ 3000.649508] Lustre: Lustre: Build Version: 2.17.50_30_gbb2e37c [ 3001.005886] LNet: Added LNI 192.168.202.159@tcp [8/256/0/180] [ 3002.783542] Key type lgssc registered [ 3004.251589] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3055.636696] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3055.678580] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3057.267847] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3057.337891] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3057.409256] Lustre: lustre-MDT0000: new disk, initializing [ 3057.495964] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3057.519688] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3062.430712] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 3074.935383] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 3075.392364] Lustre: lustre-OST0000: new disk, initializing [ 3075.399597] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3075.416671] Lustre: Skipped 1 previous similar message [ 3075.528549] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3084.630991] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 3085.059954] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 3085.077287] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 3085.178949] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 3098.560843] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 3098.840550] Lustre: lustre-OST0001: new disk, initializing [ 3098.846857] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 3098.950718] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 3108.006771] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost [ 3108.013267] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] [ 3108.044190] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 [ 3108.546778] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 3123.683443] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3123.702807] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3123.712984] Lustre: Skipped 1 previous similar message [ 3125.225855] LustreError: 114097:0:(obd_class.h:479:obd_check_dev()) Device 17 not setup [ 3125.881623] Lustre: server umount lustre-MDT0000 complete [ 3134.308816] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null) [ 3139.394836] LustreError: 113503:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768549671 with bad export cookie 6541704513910422984 [ 3139.399445] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3139.413784] LustreError: 113503:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 3139.473393] LustreError: 114692:0:(obd_class.h:479:obd_check_dev()) Device 12 not setup [ 3139.480102] LustreError: 114692:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 3139.717254] Lustre: server umount lustre-OST0000 complete [ 3143.931405] LustreError: 114893:0:(obd_class.h:479:obd_check_dev()) Device 2 not setup [ 3143.936371] LustreError: 114893:0:(obd_class.h:479:obd_check_dev()) Skipped 1 previous similar message [ 3144.078684] Lustre: server umount lustre-OST0001 complete [ 3154.303757] Lustre: DEBUG MARKER: == conf-sanity test 88: check the default mount options can be overridden ========================================================== 02:48:05 (1768549685) [ 3164.157866] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [ 3190.328527] Lustre: DEBUG MARKER: == conf-sanity test 89: check tunefs --param and --erase-param{s} options ========================================================== 02:48:41 (1768549721) [ 3235.289516] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_hostid [ 3247.148332] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [ 3287.849681] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3288.194820] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3288.224216] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3288.336827] Lustre: lustre-MDT0000: new disk, initializing [ 3288.488168] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3288.531965] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3293.030662] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 3303.974442] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 3304.161637] Lustre: 120189:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 3304.209379] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 3304.221308] Lustre: Skipped 1 previous similar message [ 3304.305152] Lustre: lustre-MDT0001: new disk, initializing [ 3304.408968] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3304.487317] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 3304.509281] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 3310.080978] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 3318.021809] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3322.180514] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3330.274785] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 3330.620241] Lustre: lustre-OST0000: new disk, initializing [ 3330.628328] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3330.747968] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3336.279504] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 3336.297333] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 3336.485750] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 3337.814773] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 3345.792279] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount (FULL|IDLE) failover.node=192.0.2.254@tcp0,osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3350.988068] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 3351.280917] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 3357.056527] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 3357.485629] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 3362.275536] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3362.278537] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3362.287490] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3362.301566] LustreError: Skipped 1 previous similar message [ 3362.339580] Lustre: Skipped 2 previous similar messages [ 3365.593847] LustreError: 123123:0:(obd_class.h:479:obd_check_dev()) Device 19 not setup [ 3365.599963] LustreError: 123123:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 3365.881276] Lustre: server umount lustre-OST0000 complete [ 3370.977169] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3370.984813] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3371.013976] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3371.016336] Lustre: Skipped 1 previous similar message [ 3377.633652] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3377.641142] Lustre: Skipped 3 previous similar messages [ 3381.729117] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3381.745643] Lustre: Skipped 1 previous similar message [ 3384.287148] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 3384.423524] LustreError: 123325:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup [ 3384.439752] LustreError: 123325:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 3384.681339] Lustre: server umount lustre-MDT0000 complete [ 3388.653418] LustreError: 120182:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768549920 with bad export cookie 6541704513910424209 [ 3388.655658] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3388.660938] LustreError: 120182:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 3389.033574] Lustre: server umount lustre-MDT0001 complete [ 3401.342849] Lustre: DEBUG MARKER: == conf-sanity test 90a: check max_mod_rpcs_in_flight is enforced ========================================================== 02:52:11 (1768549931) [ 3410.030386] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3410.773558] LustreError: 124201:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3410.797710] LustreError: 124201:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 3410.903072] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3416.035275] LustreError: 124201:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3418.315933] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 3421.153533] LustreError: 124201:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3426.284539] LustreError: 124201:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3429.621493] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 3436.286267] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 3442.076030] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3446.797882] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3455.142317] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 3455.430976] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3455.435156] Lustre: Skipped 1 previous similar message [ 3462.142770] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 3469.590882] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3478.118664] Lustre: *** cfs_fail_loc=159, val=0*** [ 3494.491524] Lustre: lustre-MDT0000: Client c42dcbb9-02ec-4fd9-88b9-a01f9086033e (at 192.168.202.59@tcp) reconnecting [ 3496.471372] Lustre: *** cfs_fail_loc=159, val=0*** [ 3496.480028] Lustre: Skipped 5 previous similar messages [ 3511.833510] Lustre: lustre-MDT0000: Client c42dcbb9-02ec-4fd9-88b9-a01f9086033e (at 192.168.202.59@tcp) reconnecting [ 3517.931680] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3517.938684] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3517.954878] Lustre: Skipped 1 previous similar message [ 3517.970045] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3519.948622] LustreError: 126685:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 3519.951582] LustreError: 126685:0:(obd_class.h:479:obd_check_dev()) Skipped 13 previous similar messages [ 3520.406685] Lustre: server umount lustre-OST0000 complete [ 3526.113398] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3526.128081] Lustre: Skipped 1 previous similar message [ 3531.817774] Lustre: server umount lustre-MDT0000 complete [ 3536.360393] LustreError: 124195:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3536.387639] LustreError: 124195:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 3536.411072] LustreError: 124181:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768550068 with bad export cookie 6541704513910425091 [ 3536.413746] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3536.418594] LustreError: 124181:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 3546.622473] LustreError: 127090:0:(obd_class.h:479:obd_check_dev()) Device 16 not setup [ 3546.633572] LustreError: 127090:0:(obd_class.h:479:obd_check_dev()) Skipped 9 previous similar messages [ 3547.029396] Lustre: server umount lustre-MDT0001 complete [ 3559.172726] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing unload_modules_local [ 3561.997831] Key type lgssc unregistered [ 3562.334255] LNet: 127625:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3562.341114] LNetError: 127625:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3563.366531] LNet: Removed LNI 192.168.202.159@tcp [ 3564.651593] Key type .llcrypt unregistered [ 3564.657856] Key type ._llcrypt unregistered [ 3594.579703] Key type ._llcrypt registered [ 3594.584361] Key type .llcrypt registered [ 3594.707101] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [ 3597.012223] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3597.074663] alg: No test for adler32 (adler32-zlib) [ 3598.462862] Lustre: Lustre: Build Version: 2.17.50_30_gbb2e37c [ 3598.732715] LNet: Added LNI 192.168.202.159@tcp [8/256/0/180] [ 3600.535534] Key type lgssc registered [ 3602.555442] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3611.579126] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3611.600187] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3613.110419] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3617.988868] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 3623.398530] LustreError: 129024:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3623.429858] LustreError: 129024:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 3627.335578] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 3627.656426] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3631.883037] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 3640.248930] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3644.312209] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3652.630913] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 3652.938210] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3658.118744] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:42 to 0x280000401:65) [ 3661.518251] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 3669.694186] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3683.246532] Lustre: *** cfs_fail_loc=159, val=0*** [ 3699.728616] Lustre: lustre-MDT0000: Client 9d705992-05b4-4a85-8786-eb46fa39ff56 (at 192.168.202.59@tcp) reconnecting [ 3702.816022] Lustre: *** cfs_fail_loc=159, val=0*** [ 3702.830182] Lustre: Skipped 2 previous similar messages [ 3719.220820] Lustre: lustre-MDT0001: Client 9d705992-05b4-4a85-8786-eb46fa39ff56 (at 192.168.202.59@tcp) reconnecting [ 3721.306922] Lustre: *** cfs_fail_loc=159, val=0*** [ 3721.311259] Lustre: Skipped 3 previous similar messages [ 3737.642587] Lustre: lustre-MDT0001: Client 9d705992-05b4-4a85-8786-eb46fa39ff56 (at 192.168.202.59@tcp) reconnecting [ 3743.234481] Lustre: 131727:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3746.107972] Lustre: *** cfs_fail_loc=159, val=0*** [ 3746.112195] Lustre: Skipped 2 previous similar messages [ 3762.762279] Lustre: lustre-MDT0000: Client 1e7d90c2-07a3-4649-8ad5-e6e6a20df5a4 (at 192.168.202.59@tcp) reconnecting [ 3765.231479] Lustre: *** cfs_fail_loc=159, val=0*** [ 3765.233313] Lustre: Skipped 14 previous similar messages [ 3781.714272] Lustre: lustre-MDT0000: Client 1e7d90c2-07a3-4649-8ad5-e6e6a20df5a4 (at 192.168.202.59@tcp) reconnecting [ 3783.475742] Lustre: 132020:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3791.330720] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3791.341916] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3791.361783] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3795.427687] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3795.428244] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3795.434973] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3795.441055] Lustre: Skipped 1 previous similar message [ 3796.763117] LustreError: 132121:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 3796.919184] Lustre: server umount lustre-OST0000 complete [ 3801.508502] LustreError: 132323:0:(obd_class.h:479:obd_check_dev()) Device 9 not setup [ 3801.522875] LustreError: 132323:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 3801.578944] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3801.590244] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3801.614737] LustreError: 129735:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3801.860546] Lustre: server umount lustre-MDT0000 complete [ 3805.668183] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3805.676478] LustreError: 129735:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3805.697857] LustreError: 129735:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 3805.934928] LustreError: 129006:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768550338 with bad export cookie 799424486026450167 [ 3805.937743] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3805.955203] LustreError: 129006:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3806.083571] LustreError: 132524:0:(obd_class.h:479:obd_check_dev()) Device 16 not setup [ 3806.090194] LustreError: 132524:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 3806.237434] Lustre: server umount lustre-MDT0001 complete [ 3818.510953] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing unload_modules_local [ 3821.498062] Key type lgssc unregistered [ 3821.876730] LNet: 133055:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3821.889586] LNetError: 133055:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3822.954827] LNet: Removed LNI 192.168.202.159@tcp [ 3824.077690] Key type .llcrypt unregistered [ 3824.079509] Key type ._llcrypt unregistered [ 3850.760334] Key type ._llcrypt registered [ 3850.766317] Key type .llcrypt registered [ 3850.963495] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [ 3852.082401] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3852.177586] alg: No test for adler32 (adler32-zlib) [ 3853.336822] Lustre: Lustre: Build Version: 2.17.50_30_gbb2e37c [ 3853.554375] LNet: Added LNI 192.168.202.159@tcp [8/256/0/180] [ 3855.240204] Key type lgssc registered [ 3856.505755] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3863.799363] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3863.822845] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3865.290605] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3870.292258] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 3874.798159] LustreError: 134451:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3874.835725] LustreError: 134451:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 3879.561878] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 3880.020216] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3884.284097] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 3892.330592] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3897.086792] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3904.995678] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 3905.518848] LustreError: 136048:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3905.714786] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3909.854765] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:129) [ 3909.913543] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:97) [ 3914.304976] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 3920.991766] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3926.807704] Lustre: 136701:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3931.234868] Lustre: 136762:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3933.218886] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 in log params [ 3934.271965] Lustre: Setting parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=8 in log params [ 3938.414125] Lustre: 136908:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre/mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 (mode = 0) failed: rc = -17 [ 3939.494868] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=7 in log params [ 3940.788685] Lustre: 137017:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3945.960957] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3945.967446] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3945.981029] LustreError: Skipped 1 previous similar message [ 3945.985752] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3946.006677] Lustre: Skipped 1 previous similar message [ 3946.030917] Lustre: Skipped 1 previous similar message [ 3951.085355] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3951.109445] Lustre: Skipped 1 previous similar message [ 3951.170063] LustreError: 137115:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 3951.436210] Lustre: server umount lustre-OST0000 complete [ 3956.193733] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3956.199824] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3956.222444] Lustre: Skipped 1 previous similar message [ 3961.314845] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3961.322997] Lustre: Skipped 2 previous similar messages [ 3961.398366] LustreError: 137316:0:(obd_class.h:479:obd_check_dev()) Device 9 not setup [ 3961.405527] LustreError: 137316:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 3961.529961] Lustre: server umount lustre-MDT0000 complete [ 3965.318152] LustreError: 135167:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768550497 with bad export cookie 4887094277430427345 [ 3965.331068] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3965.345916] LustreError: 135167:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 3965.568755] LustreError: 137519:0:(obd_class.h:479:obd_check_dev()) Device 16 not setup [ 3965.576568] LustreError: 137519:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 3965.751882] Lustre: server umount lustre-MDT0001 complete [ 3974.559230] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing unload_modules_local [ 3977.027170] Key type lgssc unregistered [ 3977.315763] LNet: 138050:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3977.323463] LNetError: 138050:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3978.342341] LNet: Removed LNI 192.168.202.159@tcp [ 3979.051685] Key type .llcrypt unregistered [ 3979.054227] Key type ._llcrypt unregistered [ 3999.997702] Key type ._llcrypt registered [ 3999.999911] Key type .llcrypt registered [ 4000.084527] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [ 4001.167057] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4001.189032] alg: No test for adler32 (adler32-zlib) [ 4002.230050] Lustre: Lustre: Build Version: 2.17.50_30_gbb2e37c [ 4002.491408] LNet: Added LNI 192.168.202.159@tcp [8/256/0/180] [ 4004.199192] Key type lgssc registered [ 4005.311859] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4012.556708] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4012.604220] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4014.061869] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4017.498354] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 4024.290284] LustreError: 139424:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4024.306865] LustreError: 139424:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 4025.829569] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 4026.192107] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4029.393712] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 4034.172111] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4037.877043] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4043.924853] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 4044.256989] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4049.930484] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 4051.463955] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:129) [ 4055.423885] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4059.649713] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:161) [ 4067.102055] Lustre: *** cfs_fail_loc=159, val=0*** [ 4083.715620] Lustre: lustre-MDT0000: Client e9c45bba-afbb-44c3-88a7-e0bb840e118b (at 192.168.202.59@tcp) reconnecting [ 4089.838749] LustreError: lustre-OST0000-osc-MDT0000: operation ost_destroy to node 0@lo failed: rc = -107 [ 4089.842368] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4089.845770] LustreError: Skipped 3 previous similar messages [ 4089.890631] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4090.107175] LustreError: 141812:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 4090.306695] Lustre: server umount lustre-OST0000 complete [ 4095.464503] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4095.478231] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4095.482323] Lustre: Skipped 1 previous similar message [ 4095.497539] Lustre: Skipped 1 previous similar message [ 4100.578882] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4100.590759] Lustre: Skipped 1 previous similar message [ 4105.696031] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4105.706020] Lustre: Skipped 1 previous similar message [ 4106.720453] Lustre: 138734:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1768550622/real 1768550622] req@00000000d0775773 x1854459644773504/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 1 dl 1768550638 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 4106.743319] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4108.255152] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 4108.354797] LustreError: 142013:0:(obd_class.h:479:obd_check_dev()) Device 9 not setup [ 4108.361651] LustreError: 142013:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 4108.581847] Lustre: server umount lustre-MDT0000 complete [ 4108.642311] Lustre: 138737:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1768550624/real 1768550624] req@00000000d85611f7 x1854459644773760/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 1 dl 1768550640 ref 1 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 4110.884318] Lustre: 138734:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1768550627/real 1768550627] req@00000000abe7ac21 x1854459644775296/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 1 dl 1768550643 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 4111.843699] LustreError: 139424:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4112.187357] LustreError: 139405:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768550644 with bad export cookie 16120248551838734983 [ 4112.199248] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4112.315903] LustreError: 142215:0:(obd_class.h:479:obd_check_dev()) Device 16 not setup [ 4112.324408] LustreError: 142215:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 4112.626638] Lustre: server umount lustre-MDT0001 complete [ 4123.147735] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing unload_modules_local [ 4125.549426] Key type lgssc unregistered [ 4125.892824] LNet: 142746:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4125.899850] LNetError: 142746:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4126.953347] LNet: Removed LNI 192.168.202.159@tcp [ 4127.682695] Key type .llcrypt unregistered [ 4127.684844] Key type ._llcrypt unregistered [ 4150.061662] Key type ._llcrypt registered [ 4150.063187] Key type .llcrypt registered [ 4150.145408] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [ 4151.257118] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4151.343358] alg: No test for adler32 (adler32-zlib) [ 4152.397604] Lustre: Lustre: Build Version: 2.17.50_30_gbb2e37c [ 4152.611977] LNet: Added LNI 192.168.202.159@tcp [8/256/0/180] [ 4154.271248] Key type lgssc registered [ 4155.367924] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4163.399876] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4163.416289] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4164.969285] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4169.487908] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 4175.339973] LustreError: 144143:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4175.370815] LustreError: 144143:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 4177.445177] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 4177.831293] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4182.815304] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 4187.978680] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4192.679553] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4199.956241] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 4200.246700] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4202.290493] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:161) [ 4206.033183] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 4210.534627] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:170 to 0x280000401:193) [ 4211.245165] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4231.352303] Lustre: lustre-MDT0001: evicting 8678a5fa-5293-40aa-9ade-6de82e5da40e (at 192.168.202.59@tcp) by administrative request [ 4231.360989] Lustre: Skipped 1 previous similar message [ 4261.858898] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4261.860341] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4261.891172] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4266.627318] LustreError: 146925:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 4266.798184] Lustre: server umount lustre-OST0000 complete [ 4272.099180] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4272.106071] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4272.108364] Lustre: Skipped 2 previous similar messages [ 4272.114024] Lustre: Skipped 1 previous similar message [ 4276.318686] LustreError: 147126:0:(obd_class.h:479:obd_check_dev()) Device 9 not setup [ 4276.327308] LustreError: 147126:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 4276.557329] Lustre: server umount lustre-MDT0000 complete [ 4277.218221] LustreError: 144143:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4277.242165] LustreError: 144143:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 4280.809658] LustreError: 144124:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768550813 with bad export cookie 4955224947292829307 [ 4280.829873] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4280.834903] LustreError: 144124:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 4280.969471] LustreError: 147328:0:(obd_class.h:479:obd_check_dev()) Device 16 not setup [ 4280.979754] LustreError: 147328:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 4281.262887] Lustre: server umount lustre-MDT0001 complete [ 4291.587571] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing unload_modules_local [ 4294.407083] Key type lgssc unregistered [ 4294.785568] LNet: 147862:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4294.795760] LNetError: 147862:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4294.831302] LNet: Removed LNI 192.168.202.159@tcp [ 4295.520312] Key type .llcrypt unregistered [ 4295.522445] Key type ._llcrypt unregistered [ 4364.649769] Key type ._llcrypt registered [ 4364.665553] Key type .llcrypt registered [ 4364.822734] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [ 4365.915447] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4366.001786] alg: No test for adler32 (adler32-zlib) [ 4367.134256] Lustre: Lustre: Build Version: 2.17.50_30_gbb2e37c [ 4367.455196] LNet: Added LNI 192.168.202.159@tcp [8/256/0/180] [ 4369.135369] Key type lgssc registered [ 4370.207698] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4378.454412] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4378.476365] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4380.199363] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4383.923921] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 4390.372420] LustreError: 150330:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4390.386744] LustreError: 150330:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 4391.903236] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 4392.330549] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4396.517493] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 4403.027950] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4407.011743] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4413.843959] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 4414.286317] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4417.426837] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:193) [ 4421.073687] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 4426.611113] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:195 to 0x280000401:225) [ 4427.719825] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4436.978435] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4436.979020] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4437.014186] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4442.083059] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4442.102730] Lustre: Skipped 2 previous similar messages [ 4442.573116] LustreError: 152580:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 4442.862854] Lustre: server umount lustre-OST0000 complete [ 4448.737561] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4448.761501] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4448.801833] Lustre: Skipped 1 previous similar message [ 4448.834358] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4452.335783] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4452.336829] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4453.907582] LustreError: 152781:0:(obd_class.h:479:obd_check_dev()) Device 9 not setup [ 4453.914944] LustreError: 152781:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 4454.141129] Lustre: server umount lustre-MDT0000 complete [ 4457.441925] LustreError: 150330:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4457.452663] LustreError: 150330:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 4457.737892] LustreError: 150311:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768550990 with bad export cookie 1241003424343765125 [ 4457.757995] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4457.759264] LustreError: 150311:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4457.924856] LustreError: 152984:0:(obd_class.h:479:obd_check_dev()) Device 16 not setup [ 4457.928470] LustreError: 152984:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 4458.096040] Lustre: server umount lustre-MDT0001 complete [ 4469.267824] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing unload_modules_local [ 4472.358023] Key type lgssc unregistered [ 4472.792700] LNet: 153517:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4472.802766] LNetError: 153517:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4472.836490] LNet: Removed LNI 192.168.202.159@tcp [ 4473.764318] Key type .llcrypt unregistered [ 4473.766567] Key type ._llcrypt unregistered [ 4499.381831] Key type ._llcrypt registered [ 4499.383331] Key type .llcrypt registered [ 4499.493101] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [ 4500.755122] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4501.019502] alg: No test for adler32 (adler32-zlib) [ 4502.076656] Lustre: Lustre: Build Version: 2.17.50_30_gbb2e37c [ 4502.339328] LNet: Added LNI 192.168.202.159@tcp [8/256/0/180] [ 4504.055322] Key type lgssc registered [ 4505.312809] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4524.883854] Lustre: DEBUG MARKER: == conf-sanity test 100: check lshowmount lists MGS, MDT, OST and 0@lo ========================================================== 03:10:55 (1768551055) [ 4540.518643] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_hostid [ 4550.295561] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [ 4589.824409] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4589.869595] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4591.261455] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 4591.328950] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 4591.472299] Lustre: lustre-MDT0000: new disk, initializing [ 4591.617857] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4591.635492] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 4596.517294] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 4607.322854] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 4607.451863] Lustre: 157727:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 4607.509393] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 4607.516411] Lustre: Skipped 1 previous similar message [ 4607.611528] Lustre: lustre-MDT0001: new disk, initializing [ 4607.789885] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4607.839955] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 4607.853519] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 4612.056543] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 4623.276249] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4629.649361] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4640.188091] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 4640.456952] Lustre: lustre-OST0000: new disk, initializing [ 4640.464790] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 4640.571631] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4645.994510] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 4646.008779] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 4646.151165] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 4646.894354] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 4655.046912] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4666.849143] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4666.854829] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4666.856076] LustreError: Skipped 1 previous similar message [ 4666.860784] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4666.869342] Lustre: Skipped 1 previous similar message [ 4666.881778] Lustre: Skipped 1 previous similar message [ 4671.553910] LustreError: 160311:0:(obd_class.h:479:obd_check_dev()) Device 19 not setup [ 4671.667970] Lustre: server umount lustre-OST0000 complete [ 4677.095266] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4677.135612] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4677.140862] Lustre: Skipped 1 previous similar message [ 4681.813872] LustreError: 160512:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup [ 4681.820525] LustreError: 160512:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 4681.969394] Lustre: server umount lustre-MDT0000 complete [ 4686.036967] LustreError: 159481:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768551218 with bad export cookie 17803342133530129955 [ 4686.040671] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4686.054194] LustreError: 159481:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 4686.276945] LustreError: 160713:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 4686.286408] LustreError: 160713:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 4686.521550] Lustre: server umount lustre-MDT0001 complete [ 4697.930554] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing unload_modules_local [ 4700.957339] Key type lgssc unregistered [ 4701.391909] LNet: 161247:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4701.399396] LNetError: 161247:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4701.418337] LNet: Removed LNI 192.168.202.159@tcp [ 4702.619740] Key type .llcrypt unregistered [ 4702.622178] Key type ._llcrypt unregistered [ 4728.304452] Key type ._llcrypt registered [ 4728.306124] Key type .llcrypt registered [ 4728.535285] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [ 4729.903749] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4729.941802] alg: No test for adler32 (adler32-zlib) [ 4731.005651] Lustre: Lustre: Build Version: 2.17.50_30_gbb2e37c [ 4731.200372] LNet: Added LNI 192.168.202.159@tcp [8/256/0/180] [ 4732.807218] Key type lgssc registered [ 4734.674944] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4743.889396] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4743.925418] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4745.689528] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4750.511162] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 4754.913916] LustreError: 162640:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4754.937567] LustreError: 162640:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 4760.041047] LustreError: 162640:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4760.504258] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 4760.910713] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4766.035736] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 4773.652217] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4777.502975] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4784.806826] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 4785.142650] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4790.340053] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:33) [ 4791.246824] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 4797.588881] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4805.131789] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4805.149830] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4805.175904] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4805.188183] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4805.201306] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4806.182257] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4806.193570] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4806.200240] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4806.204392] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4806.211526] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4807.126280] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4807.732352] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4807.736471] Lustre: Skipped 1 previous similar message [ 4807.749357] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4807.756797] Lustre: Skipped 1 previous similar message [ 4807.759902] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4807.763083] Lustre: Skipped 1 previous similar message [ 4807.771164] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4807.782136] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4807.789040] Lustre: Skipped 1 previous similar message [ 4808.560351] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4809.519970] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4810.468941] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4810.473200] Lustre: Skipped 2 previous similar messages [ 4810.487494] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4810.498266] Lustre: Skipped 2 previous similar messages [ 4810.502076] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4810.506743] Lustre: Skipped 2 previous similar messages [ 4810.509274] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4810.517561] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4810.528448] Lustre: Skipped 2 previous similar messages [ 4811.346133] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4812.401652] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4813.319449] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4814.381497] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4815.256502] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4815.262358] Lustre: Skipped 4 previous similar messages [ 4815.278707] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4815.290148] Lustre: Skipped 4 previous similar messages [ 4815.292755] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4815.297250] Lustre: Skipped 4 previous similar messages [ 4815.300933] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4815.311517] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4815.321994] Lustre: Skipped 4 previous similar messages [ 4816.294576] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4817.056381] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4817.924661] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4818.772441] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4819.609360] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4820.430594] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4821.319952] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4822.070502] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4822.950396] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4823.656473] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4823.660250] Lustre: Skipped 9 previous similar messages [ 4823.670692] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4823.678179] Lustre: Skipped 9 previous similar messages [ 4823.680960] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4823.685487] Lustre: Skipped 9 previous similar messages [ 4823.688578] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4823.696441] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4823.700640] Lustre: Skipped 9 previous similar messages [ 4824.484127] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4825.213785] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4826.033434] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4826.820236] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4827.738333] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4828.569907] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4829.440980] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4830.213796] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4831.142281] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4831.907484] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4832.781846] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4833.731112] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4834.681574] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4835.430523] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4836.274061] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4837.128919] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4838.201428] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4839.210386] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4840.050714] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4840.063484] Lustre: Skipped 18 previous similar messages [ 4840.075890] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4840.086518] Lustre: Skipped 18 previous similar messages [ 4840.091868] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4840.095386] Lustre: Skipped 18 previous similar messages [ 4840.099462] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4840.107427] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4840.109354] Lustre: Skipped 18 previous similar messages [ 4841.028927] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4841.930535] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4842.808355] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4843.918075] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4845.032740] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4846.077683] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4847.208733] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4848.126699] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4849.259757] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4850.440920] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4851.520618] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4852.667110] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4853.778510] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4854.920876] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4856.184791] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4857.326547] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4858.459436] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4859.626995] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4861.586718] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4862.924621] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4864.054996] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4865.243732] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4866.640227] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4867.690806] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4868.796819] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4869.681345] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4870.701728] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4871.710174] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4872.827966] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4872.835785] Lustre: Skipped 28 previous similar messages [ 4872.849408] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4872.860566] Lustre: Skipped 28 previous similar messages [ 4872.864070] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4872.867118] Lustre: Skipped 28 previous similar messages [ 4872.871509] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4872.880960] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4872.886782] Lustre: Skipped 28 previous similar messages [ 4873.974812] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4874.978101] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4876.485227] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4877.581849] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4878.719274] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4879.756933] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4880.884805] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4882.130618] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4883.265535] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4884.331832] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4885.346458] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4886.343352] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4887.361668] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4888.231508] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4889.177275] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4890.030111] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4891.248513] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4892.217137] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4893.207660] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4894.024856] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4894.974643] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4895.747830] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4897.009609] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4897.967987] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4899.048943] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4900.041420] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4900.987186] LustreError: 162660:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 4900.995661] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4900.999642] LustreError: 162660:0:(osp_precreate.c:1355:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 4901.892491] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4902.925100] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4903.768644] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4904.687419] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4905.411969] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4906.162817] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4906.951459] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4908.078544] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4909.054379] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4910.042249] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4910.781477] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4911.589432] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4912.459788] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4913.367676] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4914.350331] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4915.306358] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4916.442106] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4917.350216] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4918.266450] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4918.946303] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4919.728079] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4920.555440] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4921.485527] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4922.450434] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4923.287484] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4924.210266] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4925.030589] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4925.927233] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4926.703743] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4927.499212] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4928.299449] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4929.000937] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4929.700506] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4930.478166] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4931.197595] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4932.070942] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4932.819937] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4933.668588] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4934.533551] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4935.461967] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4936.127426] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4936.836433] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4936.842464] Lustre: Skipped 68 previous similar messages [ 4936.850419] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4936.856303] Lustre: Skipped 68 previous similar messages [ 4936.860473] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4937.556778] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4937.559634] Lustre: Skipped 69 previous similar messages [ 4937.568758] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4937.581410] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4937.588615] Lustre: Skipped 69 previous similar messages [ 4938.584406] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4939.545763] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4940.495905] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4941.398867] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4942.355345] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4943.344197] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4944.115856] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4945.138926] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4946.018399] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4946.927175] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4947.825767] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4948.568862] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4949.404642] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4950.113937] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4950.847772] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4951.673790] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4952.747704] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4953.694118] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4954.663070] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4955.646110] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4956.627238] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4957.670358] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4958.760091] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4959.653545] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4960.554075] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4961.395196] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4962.088451] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4962.729770] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4963.512597] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4964.546636] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4965.701835] LustreError: 162660:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 4965.720155] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4965.726441] LustreError: 162660:0:(osp_precreate.c:1355:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 4967.102634] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4968.368323] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4969.245403] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4970.548020] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4971.660398] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4972.991941] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4974.104093] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4975.159656] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4976.402686] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4977.920858] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4979.301148] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4981.017863] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4982.050141] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4983.358565] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4984.483931] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4985.697676] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4987.080901] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4988.403186] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4990.043663] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4991.354079] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4992.632774] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4993.821047] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4994.763890] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4996.165982] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4997.553705] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4998.959034] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5000.175614] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5001.442851] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5002.886332] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5004.035043] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5004.983080] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5006.043871] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5007.084453] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5008.018347] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5009.019883] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5010.008668] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5011.083156] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5012.109346] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5013.141709] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5014.205871] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5015.284426] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5016.442630] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5017.817456] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5018.990459] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5020.364331] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5021.532562] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5022.513867] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5023.473271] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5024.295818] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5025.382485] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5026.509164] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5027.832624] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5029.208458] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5030.489041] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5031.674893] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5032.737968] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5034.219554] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5035.431685] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5036.727266] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5038.136571] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5039.453733] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5040.731228] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5041.591067] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5042.637329] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5043.470772] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5044.725282] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5045.663537] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5046.815891] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5047.727959] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5049.012057] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5049.824652] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5050.945904] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5051.798699] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5052.687228] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5053.472884] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5054.393894] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5055.246353] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5056.016663] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5056.798336] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5057.824873] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5058.701699] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5059.766117] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5060.713785] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5061.625907] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5062.572695] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5063.540517] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5064.282386] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5065.145544] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5065.149471] Lustre: Skipped 119 previous similar messages [ 5065.163577] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5065.176143] Lustre: Skipped 119 previous similar messages [ 5065.181132] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5065.996786] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5066.000362] Lustre: Skipped 119 previous similar messages [ 5066.004949] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5066.018584] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5066.021391] Lustre: Skipped 119 previous similar messages [ 5067.049220] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5067.807934] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5068.562981] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5069.591566] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5070.589981] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5071.410768] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5072.247288] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5073.081451] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5074.165788] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5075.095581] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5076.173543] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5076.996094] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5077.887984] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5078.618916] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5079.620898] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5080.366888] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5081.234427] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5082.312478] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5083.511256] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5084.358530] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5085.306096] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5086.064931] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5087.013462] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5087.820273] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5088.800386] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5089.662882] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5090.616566] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5091.507516] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5092.487089] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5093.312869] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5094.188945] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5095.175427] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5095.959268] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5096.947179] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5097.872414] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5098.795971] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5099.823921] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5100.728253] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5101.952520] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5103.106932] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5104.160867] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5105.258933] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5106.365731] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5107.237380] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5108.172650] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5109.102458] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5110.110598] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5110.946290] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5112.010037] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5112.904572] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5113.927524] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5114.904689] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5115.899304] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5116.598437] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5117.402831] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5118.305575] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5119.243618] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5120.268086] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5121.096566] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5122.002256] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5122.953743] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5123.816078] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5124.989202] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5125.948641] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5126.941350] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5127.780089] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5128.558933] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5129.533723] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5130.512441] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5131.357592] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5132.078032] LustreError: 162660:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 5132.084730] LustreError: 162660:0:(osp_precreate.c:1355:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 5132.090320] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5132.900824] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5133.901819] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5134.830971] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5135.557238] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5136.413598] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5137.716091] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5138.913247] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5139.923778] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5140.884286] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5141.697672] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5142.637531] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5143.540295] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5144.434455] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5145.277512] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5146.260138] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5147.092722] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5147.867687] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5148.741853] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5149.723719] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5150.654262] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5151.592589] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5152.508311] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5153.434830] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5154.321787] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5155.170477] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5156.108168] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5156.964873] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5157.874729] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5158.662614] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5159.761979] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5160.601987] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5161.627555] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5162.485584] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5163.392069] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5164.144036] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5165.091195] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5165.809508] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5166.600787] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5167.389669] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5168.435718] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5169.255619] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5170.214729] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5171.038786] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5172.199995] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5173.581076] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5174.482293] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5175.415813] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5176.286215] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5177.355439] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5178.624834] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5179.854747] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5180.901441] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5181.915679] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5182.981095] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5184.002178] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5184.947079] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5185.986719] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5187.053640] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5187.960435] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5188.797648] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5189.869871] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5190.890294] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5191.839764] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5192.976658] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5193.959245] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5194.907061] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5195.924617] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5196.818372] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5197.740400] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5198.636816] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5199.568858] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5200.407208] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5201.328808] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5202.198114] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5203.060396] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5204.174330] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5205.542714] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5206.849517] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5207.992802] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5208.930994] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5210.180702] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5211.449916] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5212.485277] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5213.829640] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5214.930405] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5215.897576] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5216.909337] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5217.832453] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5218.815074] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5219.632072] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5220.572951] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5221.476279] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5222.439425] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5223.293661] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5224.281274] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5225.224029] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5226.228874] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5227.073261] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5227.972322] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5228.926548] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5229.857373] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5230.723234] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5231.682742] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5232.622157] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5233.476952] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5234.619203] LustreError: 162660:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 5234.638615] LustreError: 162660:0:(osp_precreate.c:1355:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 5234.644598] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5235.631513] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5236.489613] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5237.410433] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5238.638984] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5239.543551] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5240.585318] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5241.629041] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5242.618464] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5243.586814] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5244.513966] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5245.389704] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5246.378762] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5247.287500] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5248.375525] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5249.320710] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5250.149794] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5250.990688] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5251.968244] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5252.963096] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5254.061480] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5254.920612] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5255.826078] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5257.110650] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5258.112239] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5259.052811] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5260.037874] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5260.904227] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5261.808035] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5262.701503] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5263.604661] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5264.582927] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5265.444277] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5266.563192] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5267.410883] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5268.410530] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5269.100147] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5269.922795] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5270.796823] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5271.629981] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5272.440424] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5273.422794] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5274.376521] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5275.135944] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5275.869404] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5276.939809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5277.884251] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5278.840823] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5280.133161] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5281.082078] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5282.065886] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5283.097390] LustreError: 162660:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 5283.109193] LustreError: 162660:0:(osp_precreate.c:1355:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 5283.117836] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5284.051804] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5285.238246] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5286.716855] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5287.996302] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5288.948687] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5289.839451] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5290.845759] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5292.054503] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5292.725063] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5293.705788] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5294.792801] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5295.664949] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5296.816593] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5297.692371] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5298.943518] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5299.981071] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5300.925535] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5301.893158] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5303.081137] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5303.991599] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5304.977454] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5305.884488] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5306.843090] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5307.701941] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5308.475839] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5309.317832] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5310.177075] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5311.233905] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5311.953354] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5312.788845] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5313.851795] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5314.604902] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5315.550321] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5316.590204] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5317.506841] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5318.480890] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5319.453064] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5320.384927] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5321.320957] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5321.325284] Lustre: Skipped 267 previous similar messages [ 5321.344257] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5321.351320] Lustre: Skipped 267 previous similar messages [ 5321.356335] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5322.141751] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5322.146973] Lustre: Skipped 267 previous similar messages [ 5322.150931] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5322.174498] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5322.189730] Lustre: Skipped 267 previous similar messages [ 5323.054902] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5323.860574] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5324.821044] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5325.677524] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5326.678615] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5327.597949] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5328.576562] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5329.522550] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5330.608316] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5331.589556] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5332.752459] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5333.659391] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5334.479729] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5335.374790] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5336.549925] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5337.339699] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5338.260547] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5339.178384] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5340.005362] LustreError: 162660:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 5340.017627] LustreError: 162660:0:(osp_precreate.c:1355:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 5340.020113] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5340.875732] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5341.703532] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5342.351961] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5343.021399] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5343.824207] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5344.792674] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5345.790499] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5347.014897] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5347.976135] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5349.096673] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5350.217076] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5351.355193] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5352.203074] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5353.234806] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5354.116411] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5355.007580] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5355.850080] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5356.619440] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5357.704522] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5358.757202] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5359.787742] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5360.786504] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5361.654485] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5362.506503] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5363.614748] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5364.935617] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5365.761511] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5366.585844] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5367.319730] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5368.143944] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5368.965923] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5369.735812] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5370.600763] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5371.633949] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5372.548922] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5373.545545] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5374.480230] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5375.351112] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5376.194323] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5377.014228] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5377.799804] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5378.574594] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5379.404289] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5380.285640] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5381.192890] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5382.011940] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5382.687514] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5383.438202] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5384.234553] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5385.007868] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5385.900819] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5386.815064] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5387.639609] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5388.451885] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5389.158341] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5390.166457] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5390.963470] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5391.889378] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5392.726176] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5393.854584] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5394.723693] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5395.641344] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5396.753617] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5397.775820] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5398.722396] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5399.761598] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5400.715365] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5401.719050] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5402.765421] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5403.532600] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5404.417224] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5405.321372] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5406.362143] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5407.288448] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5408.381375] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5409.243507] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5410.171387] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5411.013621] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5411.940885] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5412.688347] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5413.565092] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5414.446315] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5415.538724] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5416.497150] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5417.553885] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5418.408780] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5419.309235] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5420.005490] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5420.884363] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5421.667789] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5422.715143] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5423.644570] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5424.688141] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5425.596898] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5426.619016] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5427.496129] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5428.812856] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5429.538515] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5430.319223] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5431.150564] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5432.153652] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5433.076994] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5434.060968] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5434.872417] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5435.734231] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5436.560153] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5437.423500] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5438.329771] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5439.172645] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5440.025756] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5441.015390] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5441.983656] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5442.653032] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5443.560418] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5444.562481] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5445.542087] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5446.524041] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5447.355623] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5448.219885] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5449.285242] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5450.175076] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5451.121751] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5451.911763] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5452.723642] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5453.478644] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5454.172482] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5455.108624] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5455.904930] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5457.016736] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5458.293986] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5459.083633] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5460.044090] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5460.725813] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5461.650699] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5462.551272] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5463.519914] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5464.548720] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5465.309345] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5466.040190] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5466.909418] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5467.741356] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5468.434541] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5469.220731] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5470.114727] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5470.973744] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5472.063792] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5472.716709] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5473.569466] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5474.246631] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5475.066471] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5475.895883] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5477.022454] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5478.208316] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5479.485881] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5480.325297] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5481.093928] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5481.816632] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5482.580729] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5483.395038] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5484.261079] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5485.138163] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5485.968193] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5486.666867] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5487.578875] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5488.410181] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5489.273809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5490.015565] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5490.881788] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5491.773992] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5492.565508] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5493.257843] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5494.128351] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5494.852984] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5495.670915] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5496.381470] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5497.221455] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5497.919629] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5498.880336] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5499.814783] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5500.996862] LustreError: 162660:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 5501.009357] LustreError: 162660:0:(osp_precreate.c:1355:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 5501.031763] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5501.998055] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5503.142762] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5504.385310] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5505.675608] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5506.750303] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5507.932736] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5509.218055] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5510.689613] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5511.886747] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5512.682447] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5513.592410] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5514.353043] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5515.442865] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5516.406780] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5517.432685] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5518.232160] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5519.135538] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5519.996715] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5520.895689] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5521.782870] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5522.621636] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5523.327991] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5524.201597] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5524.924734] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5525.719925] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5526.496565] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5527.438527] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5528.190488] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5529.024991] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5529.770261] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5530.485403] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5531.289306] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5532.200957] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5533.113076] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5533.981115] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5534.796969] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5535.670987] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5536.442779] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5537.447669] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5538.346576] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5539.224433] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5540.115582] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5540.957698] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5541.748666] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5542.705611] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5543.390861] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5544.229437] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5545.052623] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5545.840348] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5546.589397] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5547.585466] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5548.442391] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5549.367251] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5550.312103] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5551.234721] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5552.122894] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5552.971258] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5553.733742] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5554.593353] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5555.571186] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5556.597716] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5557.378100] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5558.262736] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5559.245830] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5560.099667] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5561.091291] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5561.783618] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5562.550227] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5563.359769] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5564.202731] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5564.959151] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5565.678806] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5566.419701] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5567.285574] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5568.107900] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5568.762082] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5569.520765] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5570.300395] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5571.090675] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5571.834406] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5572.479282] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5573.227076] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5574.001859] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5574.728740] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5575.580820] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5576.434082] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5577.211354] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5578.115401] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5578.974376] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5579.662529] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5580.488354] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5581.331729] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5582.190235] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5582.988761] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5583.877971] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5584.636673] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5585.506736] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5586.388612] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5587.276934] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5588.272567] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5589.013403] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5589.931251] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5590.732536] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5591.648597] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5592.605560] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5593.601795] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5594.633383] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5595.522658] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5596.406959] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5597.272419] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5598.146869] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5598.940425] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5599.667734] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5600.676437] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5601.492481] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5602.486255] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5603.376120] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5604.320753] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5605.060829] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5605.900866] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5606.699075] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5607.591372] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5608.518902] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5609.407509] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5610.177892] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5611.045319] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5611.843934] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5612.950434] LustreError: 162660:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 5612.961618] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5612.964741] LustreError: 162660:0:(osp_precreate.c:651:osp_precreate_send()) Skipped 2 previous similar messages [ 5612.991142] LustreError: 162660:0:(osp_precreate.c:1355:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 5613.009824] LustreError: 162660:0:(osp_precreate.c:1355:osp_precreate_thread()) Skipped 2 previous similar messages [ 5613.708071] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5614.428321] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5615.175803] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5616.381928] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5617.345686] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5618.520937] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5619.497289] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5620.434620] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5621.297916] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5622.361827] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5623.461463] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5624.587632] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5625.642077] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5626.607795] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5627.510547] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5628.581444] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5629.443335] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5630.472213] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5631.779820] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5632.943313] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5634.106362] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5635.510494] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5636.954414] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5638.479500] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5639.389364] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5640.315572] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5640.967913] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5642.094968] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5643.061643] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5644.197983] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5645.114836] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5645.958537] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5646.845906] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5647.694430] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5648.285846] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5648.981734] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5649.895056] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5650.888602] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5651.661781] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5652.650615] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5653.482816] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5654.400715] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5655.340505] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5656.067902] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5656.989765] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5658.263690] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5659.296866] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5660.298904] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5661.188719] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5662.185920] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5663.232468] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5664.369876] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5665.502958] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5666.974385] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5668.042825] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5669.142295] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5670.090520] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5671.139992] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5672.098976] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5673.043717] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5673.936024] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5674.622596] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5675.473780] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5676.139112] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5677.051138] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5678.025715] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5678.932175] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5679.846198] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5680.742554] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5681.846607] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5682.874081] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5683.742419] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5684.699759] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5685.581199] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5686.446736] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5687.282835] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5688.113687] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5688.922412] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5689.632919] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5690.549712] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5691.446464] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5692.497471] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5693.420525] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5694.447679] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5695.435504] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5696.329028] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5697.218706] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5698.047920] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5699.043829] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5700.093298] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5701.241911] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5702.366041] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5703.836907] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5704.684374] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5705.646867] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5706.666674] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5707.780867] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5708.913248] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5709.917279] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5710.946264] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5712.015957] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5713.269049] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5714.478413] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5715.573330] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5716.742734] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5718.177237] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5719.415068] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5720.840370] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5722.279290] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5723.744178] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5724.892774] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5725.895845] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5727.087037] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5728.340112] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5729.361047] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5730.312307] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5731.094541] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5732.061365] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5732.731497] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5733.585879] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5734.320912] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5735.311175] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5736.156630] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5737.000802] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5737.891637] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5738.993223] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5739.851691] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5741.037200] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5742.152556] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5743.300749] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5744.261792] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5745.116512] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5745.907710] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5746.986771] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5747.951703] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5748.884144] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5749.613950] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5750.417441] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5751.250511] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5752.282967] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5753.271261] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5754.310860] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5755.316330] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5756.401294] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5757.233853] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6100.552780] LustreError: 164238:0:(ofd_dev.c:1780:ofd_create_hdl()) lustre-OST0000: unable to precreate: rc = -28 [ 6100.579447] LustreError: 162660:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -28 [ 6100.600527] LustreError: 162660:0:(osp_precreate.c:651:osp_precreate_send()) Skipped 1 previous similar message [ 6567.904138] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 6567.917968] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6567.925567] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6567.966561] Lustre: Skipped 474 previous similar messages [ 6573.029254] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6573.031816] Lustre: Skipped 1 previous similar message [ 6573.605265] LustreError: 216563:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 6574.069467] Lustre: server umount lustre-OST0000 complete [ 6583.265497] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6583.275145] Lustre: Skipped 1 previous similar message [ 6585.183071] LustreError: 216766:0:(obd_class.h:479:obd_check_dev()) Device 9 not setup [ 6585.192980] LustreError: 216766:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 6585.621316] Lustre: server umount lustre-MDT0000 complete [ 6588.384342] LustreError: 162640:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6588.402723] LustreError: 162640:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 6589.916384] LustreError: 162620:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768553122 with bad export cookie 5323914425023353390 [ 6589.920584] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6589.934899] LustreError: 162620:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 6590.103019] LustreError: 216969:0:(obd_class.h:479:obd_check_dev()) Device 16 not setup [ 6590.111591] LustreError: 216969:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 6590.380323] Lustre: server umount lustre-MDT0001 complete [ 6601.004509] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing unload_modules_local [ 6604.395678] Key type lgssc unregistered [ 6604.734218] LNet: 217502:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6604.742738] LNetError: 217502:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6604.761871] LNet: Removed LNI 192.168.202.159@tcp [ 6605.717632] Key type .llcrypt unregistered [ 6605.720977] Key type ._llcrypt unregistered [ 6631.316444] Key type ._llcrypt registered [ 6631.318313] Key type .llcrypt registered [ 6631.472780] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [ 6632.617400] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6632.713114] alg: No test for adler32 (adler32-zlib) [ 6633.880575] Lustre: Lustre: Build Version: 2.17.50_30_gbb2e37c [ 6634.155480] LNet: Added LNI 192.168.202.159@tcp [8/256/0/180] [ 6635.842373] Key type lgssc registered [ 6636.755179] Lustre: Echo OBD driver; http://www.lustre.org/ [ 6643.671238] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 6643.689658] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6645.282435] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6650.088499] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 6655.487468] LustreError: 218899:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6655.498142] LustreError: 218899:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 6660.585314] LustreError: 218899:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6661.294304] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 6661.776883] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6666.217818] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 6672.105850] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 6676.187329] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 6683.441228] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 6683.721428] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6689.912745] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49666 to 0x280000401:49697) [ 6690.579791] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 6696.804669] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 6702.259412] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 6703.966728] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6703.981965] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 6703.996647] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6704.011587] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 6704.013770] LustreError: 218918:0:(osp_precreate.c:1263:osp_precreate_thread()) cfs_fail_timeout id 2107 sleeping for 20000ms [ 6706.657392] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 6706.663435] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6706.682260] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6709.797824] Lustre: lustre-OST0000: Not available for connect from 192.168.202.59@tcp (stopping) [ 6710.755776] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6712.137306] LustreError: 221290:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 6712.392432] Lustre: server umount lustre-OST0000 complete [ 6724.113052] LustreError: 218918:0:(osp_precreate.c:1263:osp_precreate_thread()) cfs_fail_timeout id 2107 awake [ 6747.456617] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 6747.849265] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6750.901494] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6750.920183] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 6754.462883] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 6760.066133] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 6761.211964] LustreError: lustre-OST0000-osc-MDT0001: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6761.228835] Lustre: lustre-OST0000-osc-MDT0001: Connection restored to 0@lo (at 0@lo) [ 6761.637347] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec [ 6765.453408] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8c7f524d9000.ost_server_uuid 50 [ 6767.262594] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff8c7f524d9000.ost_server_uuid in FULL state after 0 sec [ 6772.717042] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 6772.733463] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6772.770304] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6772.790641] Lustre: Skipped 2 previous similar messages [ 6774.009072] LustreError: 222621:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 6774.024752] LustreError: 222621:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 6774.228765] Lustre: server umount lustre-OST0000 complete [ 6779.364881] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 6779.375513] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6779.397881] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6785.557640] LustreError: 222822:0:(obd_class.h:479:obd_check_dev()) Device 9 not setup [ 6785.570250] LustreError: 222822:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 6786.112618] Lustre: server umount lustre-MDT0000 complete [ 6787.042293] LustreError: 218898:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6787.082504] LustreError: 218898:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 6790.604106] LustreError: 218878:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768553322 with bad export cookie 187991668084281228 [ 6790.608165] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6790.611451] LustreError: 218878:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 1 previous similar message [ 6799.863991] LustreError: 223024:0:(obd_class.h:479:obd_check_dev()) Device 16 not setup [ 6799.877170] LustreError: 223024:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 6800.094865] Lustre: server umount lustre-MDT0001 complete [ 6812.299730] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing unload_modules_local [ 6815.578258] Key type lgssc unregistered [ 6815.946131] LNet: 223558:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6815.975485] LNetError: 223558:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6816.006373] LNet: Removed LNI 192.168.202.159@tcp [ 6817.156284] Key type .llcrypt unregistered [ 6817.157649] Key type ._llcrypt unregistered [ 6851.154891] Key type ._llcrypt registered [ 6851.157629] Key type .llcrypt registered [ 6851.280674] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [ 6852.172934] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6852.327587] alg: No test for adler32 (adler32-zlib) [ 6853.466103] Lustre: Lustre: Build Version: 2.17.50_30_gbb2e37c [ 6853.779891] LNet: Added LNI 192.168.202.159@tcp [8/256/0/180] [ 6855.497332] Key type lgssc registered [ 6856.607873] Lustre: Echo OBD driver; http://www.lustre.org/ [ 6866.116828] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 6866.144201] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6867.850356] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6872.377411] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 6878.187036] LustreError: 225269:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6878.207329] LustreError: 225269:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 6881.714980] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 6882.330272] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6887.067767] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 6890.294265] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 6898.798454] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 6899.649479] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6907.261061] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 6912.955031] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49699 to 0x280000401:49729) [ 6916.579142] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 6916.759051] Lustre: lustre-OST0001: new disk, initializing [ 6916.768197] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 6916.904669] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 6923.546137] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 6923.941260] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 6923.959984] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 6924.163963] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 6936.586910] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 6945.345587] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 6969.313574] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 6969.323120] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6969.332989] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6970.346640] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6970.348081] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6970.362245] Lustre: Skipped 1 previous similar message [ 6970.386416] Lustre: Skipped 2 previous similar messages [ 6973.188561] LustreError: 228620:0:(obd_class.h:479:obd_check_dev()) Device 28 not setup [ 6973.293980] Lustre: server umount lustre-MDT0000 complete [ 6975.470033] LustreError: 225263:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6975.488161] LustreError: 225263:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 6976.602880] LustreError: 225250:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768553508 with bad export cookie 16224302226734357239 [ 6976.605644] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6976.612154] LustreError: 225250:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 6976.814560] LustreError: 228821:0:(obd_class.h:479:obd_check_dev()) Device 27 not setup [ 6976.827980] LustreError: 228821:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 6977.005841] Lustre: server umount lustre-MDT0001 complete [ 6989.839203] LustreError: 229021:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 6989.842749] LustreError: 229021:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 6989.936810] Lustre: server umount lustre-OST0000 complete [ 7004.512717] LustreError: 229223:0:(obd_class.h:479:obd_check_dev()) Device 2 not setup [ 7004.523558] LustreError: 229223:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 7004.772446] Lustre: server umount lustre-OST0001 complete [ 7027.083451] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [ 7037.887354] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7038.397981] LustreError: 230605:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7038.511971] Lustre: mylustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7043.556314] LustreError: 230605:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7043.668963] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 7048.680526] LustreError: 230605:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7052.956760] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 7053.781536] Lustre: mylustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7058.664085] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 7062.301651] Lustre: 231714:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 7070.432752] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 7070.874980] Lustre: mylustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7078.019455] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 7078.122594] LustreError: 232070:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7083.266883] Lustre: mylustre-OST0000: new connection from mylustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49732 to 0x280000401:49761) [ 7087.542976] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 7095.451573] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 7102.715343] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 7106.017102] Lustre: 233556:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 7123.939288] Lustre: mylustre-MDT0000-osp-MDT0001: Connection to mylustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7123.951731] Lustre: Skipped 2 previous similar messages [ 7123.954127] Lustre: mylustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7123.958099] Lustre: Skipped 3 previous similar messages [ 7127.802447] LustreError: 233866:0:(obd_class.h:479:obd_check_dev()) Device 10 not setup [ 7127.806428] LustreError: 233866:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 7127.961521] Lustre: server umount mylustre-MDT0000 complete [ 7129.061561] LustreError: 230605:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7129.077819] LustreError: 230605:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 5 previous similar messages [ 7132.214236] LustreError: 233559:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768553664 with bad export cookie 16224302226734360011 [ 7132.228428] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7132.233441] LustreError: 233559:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 7132.662843] Lustre: server umount mylustre-MDT0001 complete [ 7147.285100] LustreError: 234269:0:(obd_class.h:479:obd_check_dev()) Device 23 not setup [ 7147.289290] LustreError: 234269:0:(obd_class.h:479:obd_check_dev()) Skipped 15 previous similar messages [ 7147.382207] Lustre: server umount mylustre-OST0000 complete [ 7150.559496] Lustre: 224530:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1768553666/real 1768553666] req@ffff9b6f1fe66d80 x1854462635443200/t0(0) o400->mylustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1768553682 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 7150.617211] Lustre: mylustre-MDT0001-lwp-OST0001: Connection to mylustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7150.640495] Lustre: Skipped 1 previous similar message [ 7151.070918] Lustre: server umount mylustre-OST0001 complete [ 7174.939773] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [ 7184.472815] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7184.909778] LustreError: 235851:0:(ldlm_lib.c:1179:target_handle_connect()) tfs-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7184.991041] Lustre: tfs-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7184.995482] Lustre: Skipped 1 previous similar message [ 7189.391031] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 7197.499881] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 7201.240661] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 7204.609799] Lustre: 236958:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 7211.806069] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 7218.331668] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 7227.456599] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 7230.619652] Lustre: tfs-OST0001: new connection from tfs-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) [ 7230.630120] Lustre: tfs-OST0000: new connection from tfs-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49732 to 0x280000401:49793) [ 7236.223468] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 7245.430552] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 7248.535737] Lustre: 238801:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 7261.670147] Lustre: tfs-MDT0000-osp-MDT0001: Connection to tfs-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7261.677994] Lustre: tfs-MDT0000: Not available for connect from 0@lo (stopping) [ 7261.692078] Lustre: Skipped 1 previous similar message [ 7261.706756] Lustre: Skipped 5 previous similar messages [ 7262.292396] LustreError: 239048:0:(obd_class.h:479:obd_check_dev()) Device 10 not setup [ 7262.297281] LustreError: 239048:0:(obd_class.h:479:obd_check_dev()) Skipped 9 previous similar messages [ 7262.479901] Lustre: server umount tfs-MDT0000 complete [ 7266.591307] LustreError: 235825:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768553798 with bad export cookie 16224302226734361670 [ 7266.609973] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7266.622962] LustreError: 235825:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 7266.789205] LustreError: 238125:0:(ldlm_lib.c:1179:target_handle_connect()) tfs-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7266.791904] Lustre: tfs-MDT0001: Not available for connect from 0@lo (stopping) [ 7266.803514] LustreError: 238125:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 4 previous similar messages [ 7266.815631] Lustre: Skipped 1 previous similar message [ 7266.986350] Lustre: server umount tfs-MDT0001 complete [ 7273.554351] Lustre: server umount tfs-OST0000 complete [ 7278.889666] Lustre: server umount tfs-OST0001 complete [ 7300.630813] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [ 7309.367866] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7309.748811] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7309.754428] Lustre: Skipped 3 previous similar messages [ 7313.369488] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 7320.234292] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 7324.347424] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 7327.370811] Lustre: 242136:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 7333.828571] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 7340.517222] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 7352.681154] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 7354.148714] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:97) [ 7354.217003] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49732 to 0x280000401:49825) [ 7362.000586] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 7371.831282] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 7376.006847] Lustre: 243986:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 7387.245076] Lustre: DEBUG MARKER: == conf-sanity test 104a: Make sure user defined options are reflected in mount ========================================================== 03:58:38 (1768553918) [ 7405.542140] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7405.564776] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7405.577127] Lustre: Skipped 7 previous similar messages [ 7405.603059] Lustre: Skipped 3 previous similar messages [ 7409.514210] LustreError: 244355:0:(obd_class.h:479:obd_check_dev()) Device 10 not setup [ 7409.536229] LustreError: 244355:0:(obd_class.h:479:obd_check_dev()) Skipped 25 previous similar messages [ 7409.747818] Lustre: server umount lustre-MDT0000 complete [ 7410.664414] LustreError: 241031:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7410.687937] LustreError: 241031:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 8 previous similar messages [ 7413.406913] LustreError: 244356:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768553945 with bad export cookie 16224302226734363343 [ 7413.420307] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7413.440171] LustreError: 244356:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 7419.984962] Lustre: server umount lustre-MDT0001 complete [ 7429.829375] Lustre: server umount lustre-OST0000 complete [ 7440.455944] Lustre: server umount lustre-OST0001 complete [ 7447.922770] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_hostid [ 7458.323869] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [ 7494.333844] LDISKFS-fs (dm-0): Mount option "noacl" will be removed by 3.5 [ 7494.333844] Contact linux-ldiskfs@vger.kernel.org if you think we should keep it. [ 7494.333844] [ 7494.359049] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: acl,user_xattr,errors=remount-ro,noacl,no_mbcache,nodelalloc [ 7494.558512] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 7494.612772] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 7494.687496] Lustre: lustre-MDT0000: new disk, initializing [ 7494.763299] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7494.768163] Lustre: Skipped 3 previous similar messages [ 7494.783439] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 7498.662531] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 7509.880854] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 7510.001325] Lustre: 247136:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 7510.088874] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 7510.103833] Lustre: Skipped 1 previous similar message [ 7510.195872] Lustre: lustre-MDT0001: new disk, initializing [ 7510.335453] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 7510.348137] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 7515.644187] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 7526.524529] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 7526.890174] Lustre: lustre-OST0000: new disk, initializing [ 7526.897411] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 7528.824237] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 7528.839138] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 7529.027077] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 7533.307758] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 7544.062475] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 7544.208375] Lustre: lustre-OST0001: new disk, initializing [ 7544.212045] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 7545.592080] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 7545.603868] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 7545.662490] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 7550.114766] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 7560.821735] Lustre: DEBUG MARKER: == conf-sanity test 104b: Mount uses last flock argument ========================================================== 04:01:31 (1768554091) [ 7574.041765] Lustre: DEBUG MARKER: == conf-sanity test 105: check file creation for ro and rw bind mnt pt ========================================================== 04:01:44 (1768554104) [ 7590.368794] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 7590.377203] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7590.390430] Lustre: Skipped 2 previous similar messages [ 7590.393552] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7590.399588] Lustre: Skipped 5 previous similar messages [ 7603.167284] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 7603.286809] LustreError: 250562:0:(obd_class.h:479:obd_check_dev()) Device 19 not setup [ 7603.292512] LustreError: 250562:0:(obd_class.h:479:obd_check_dev()) Skipped 25 previous similar messages [ 7603.346983] Lustre: server umount lustre-OST0000 complete [ 7613.430784] Lustre: server umount lustre-MDT0000 complete [ 7617.196068] LustreError: 247129:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768554149 with bad export cookie 16224302226734364897 [ 7617.198684] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7617.205381] LustreError: 247129:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 7622.624265] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 7622.634275] Lustre: Skipped 13 previous similar messages [ 7623.665864] Lustre: server umount lustre-MDT0001 complete [ 7634.265429] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing unload_modules_local [ 7644.687691] Lustre: server umount lustre-OST0001 complete [ 7650.609400] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_hostid [ 7665.585611] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [ 7701.101533] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7701.312867] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 7701.352756] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 7701.439451] Lustre: lustre-MDT0000: new disk, initializing [ 7701.552329] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 7705.684174] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 7718.027830] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 7718.160412] Lustre: 254037:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 7718.219250] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 7718.223272] Lustre: Skipped 1 previous similar message [ 7718.301897] Lustre: lustre-MDT0001: new disk, initializing [ 7718.517237] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 7718.538960] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 7722.874581] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 7730.126925] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 7733.994346] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 7741.800262] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 7743.961108] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 7744.123229] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 7749.952041] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 7758.075193] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7769.571916] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 7769.574570] LustreError: Skipped 1 previous similar message [ 7769.575983] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7769.616763] Lustre: Skipped 6 previous similar messages [ 7769.619140] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7769.623535] Lustre: Skipped 1 previous similar message [ 7770.702157] LustreError: 256475:0:(obd_class.h:479:obd_check_dev()) Device 19 not setup [ 7770.707384] LustreError: 256475:0:(obd_class.h:479:obd_check_dev()) Skipped 25 previous similar messages [ 7770.979669] Lustre: server umount lustre-OST0000 complete [ 7779.818197] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7781.751987] Lustre: server umount lustre-MDT0000 complete [ 7784.928262] LustreError: 254048:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7784.954293] LustreError: 254048:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 9 previous similar messages [ 7785.826681] LustreError: 254029:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768554318 with bad export cookie 16224302226734366367 [ 7785.828427] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7785.836867] LustreError: 254029:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 1 previous similar message [ 7786.320448] Lustre: server umount lustre-MDT0001 complete [ 7797.166807] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing unload_modules_local [ 7799.700939] Key type lgssc unregistered [ 7800.016521] LNet: 257410:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7800.022593] LNetError: 257410:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7800.033616] LNet: Removed LNI 192.168.202.159@tcp [ 7800.791191] Key type .llcrypt unregistered [ 7800.794444] Key type ._llcrypt unregistered [ 7826.733697] Key type ._llcrypt registered [ 7826.736563] Key type .llcrypt registered [ 7826.819274] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [ 7827.731572] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7827.767517] alg: No test for adler32 (adler32-zlib) [ 7828.783798] Lustre: Lustre: Build Version: 2.17.50_30_gbb2e37c [ 7828.983900] LNet: Added LNI 192.168.202.159@tcp [8/256/0/180] [ 7830.655425] Key type lgssc registered [ 7831.779705] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7839.181398] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7839.192490] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7840.728111] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7844.865692] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 7850.022434] LustreError: 258852:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7850.049901] LustreError: 258852:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 7852.558777] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 7852.923435] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7857.336479] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 7862.808807] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 7867.035978] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 7874.106240] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 7874.313685] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7880.640756] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 7885.620932] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:33) [ 7886.452940] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 7888.156499] Lustre: Setting parameter lustre-OST0000.ost.unknown_param=50 in log lustre-OST0000 [ 7890.913243] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 7890.931208] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7890.941942] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7890.956077] Lustre: Skipped 1 previous similar message [ 7890.979730] Lustre: Skipped 1 previous similar message [ 7892.689102] LustreError: 261142:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 7892.840655] Lustre: server umount lustre-OST0000 complete [ 7899.104766] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7899.119953] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7899.161371] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7901.161045] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7901.162548] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7903.638525] LustreError: 261348:0:(obd_class.h:479:obd_check_dev()) Device 9 not setup [ 7903.649807] LustreError: 261348:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 7903.996598] Lustre: server umount lustre-MDT0000 complete [ 7906.273254] LustreError: 258852:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7906.299232] LustreError: 258852:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 7908.909216] LustreError: 258832:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768554441 with bad export cookie 13730004582839903402 [ 7908.913069] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7908.923415] LustreError: 258832:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 7909.143821] LustreError: 261550:0:(obd_class.h:479:obd_check_dev()) Device 16 not setup [ 7909.150697] LustreError: 261550:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 7909.312583] Lustre: server umount lustre-MDT0001 complete [ 7919.443526] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing unload_modules_local [ 7922.253351] Key type lgssc unregistered [ 7922.571989] LNet: 262082:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7922.580673] LNetError: 262082:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7923.624665] LNet: Removed LNI 192.168.202.159@tcp [ 7924.627377] Key type .llcrypt unregistered [ 7924.631923] Key type ._llcrypt unregistered [ 7943.284695] Key type ._llcrypt registered [ 7943.291107] Key type .llcrypt registered [ 7943.421320] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [ 7944.649466] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7944.720123] alg: No test for adler32 (adler32-zlib) [ 7945.688848] Lustre: Lustre: Build Version: 2.17.50_30_gbb2e37c [ 7945.975916] LNet: Added LNI 192.168.202.159@tcp [8/256/0/180] [ 7947.655193] Key type lgssc registered [ 7948.804303] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7957.857796] Lustre: lustre-OST0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7957.887084] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 7973.535635] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 7978.655237] LustreError: 263257:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.202.159@tcp: failed processing log, type 4: rc = -110 [ 8005.343479] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8011.847961] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 8017.759266] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8020.614134] LustreError: 263921:0:(obd_class.h:479:obd_check_dev()) Device 1 not setup [ 8020.711953] Lustre: server umount lustre-OST0000 complete [ 8039.854217] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing unload_modules_local [ 8043.455686] Key type lgssc unregistered [ 8043.841123] LNet: 264759:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8043.859029] LNetError: 264759:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8044.905303] LNet: Removed LNI 192.168.202.159@tcp [ 8045.845179] Key type .llcrypt unregistered [ 8045.847127] Key type ._llcrypt unregistered [ 8092.408664] Key type ._llcrypt registered [ 8092.410680] Key type .llcrypt registered [ 8092.515177] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [ 8093.831964] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8093.985491] alg: No test for adler32 (adler32-zlib) [ 8095.203295] Lustre: Lustre: Build Version: 2.17.50_30_gbb2e37c [ 8095.412350] LNet: Added LNI 192.168.202.159@tcp [8/256/0/180] [ 8097.087229] Key type lgssc registered [ 8098.332567] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8114.162829] loop0: detected capacity change from 0 to 204800000 [ 8114.435163] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8114.460736] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8115.071398] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8116.335667] loop0: detected capacity change from 0 to 204800000 [ 8116.579608] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8116.585314] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8117.028869] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8118.051869] loop0: detected capacity change from 0 to 204800000 [ 8118.242701] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8118.252478] blk_update_request: operation not supported error, dev loop0, sector 8224 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8118.451809] blk_update_request: operation not supported error, dev loop0, sector 58264 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8119.710836] loop0: detected capacity change from 0 to 204800000 [ 8119.895713] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8119.922093] blk_update_request: operation not supported error, dev loop0, sector 8224 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8120.052234] blk_update_request: operation not supported error, dev loop0, sector 58264 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8121.268387] loop0: detected capacity change from 0 to 204800000 [ 8121.321973] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 8127.324707] loop0: detected capacity change from 0 to 204800000 [ 8127.356746] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 8133.333831] loop0: detected capacity change from 0 to 204800000 [ 8133.402286] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 8139.123180] loop0: detected capacity change from 0 to 204800000 [ 8139.176377] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 8143.679784] loop0: detected capacity change from 0 to 204800000 [ 8143.807419] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 8143.889110] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8144.036716] Lustre: 268164:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 8144.060419] Lustre: 268164:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0000: restore index 'nodemap' with [0x200000003:0x3:0x0]: rc = 0 [ 8144.089443] Lustre: 268164:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000003:0xb:0x0]: rc = 0 [ 8144.107594] Lustre: 268164:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0000: restore index '0x10000-MDT0000' with [0x200000005:0x1:0x0]: rc = 0 [ 8144.124056] Lustre: 268164:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0000: restore index '0x2010000-MDT0000' with [0x200000005:0x3:0x0]: rc = 0 [ 8144.153557] Lustre: 268164:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000003:0xa:0x0]: rc = 0 [ 8144.190703] Lustre: 268164:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0000: restore index '0x1010000-MDT0000' with [0x200000005:0x2:0x0]: rc = 0 [ 8144.207675] Lustre: 268164:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000003:0xc:0x0]: rc = 0 [ 8144.221548] Lustre: 268164:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000006:0x1010000:0x0]: rc = 0 [ 8144.247586] Lustre: 268164:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000006:0x10000:0x0]: rc = 0 [ 8144.275984] Lustre: 268164:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000006:0x2010000:0x0]: rc = 0 [ 8144.294677] Lustre: 268164:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0000: restore index '0x20000' with [0x200000006:0x20000:0x0]: rc = 0 [ 8144.309776] Lustre: 268164:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0000: restore index '0x2020000' with [0x200000006:0x2020000:0x0]: rc = 0 [ 8144.326492] Lustre: 268164:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0000: restore index '0x1020000' with [0x200000006:0x1020000:0x0]: rc = 0 [ 8151.517696] LustreError: 268429:0:(obd_class.h:479:obd_check_dev()) Device 2 not setup [ 8151.608472] Lustre: server umount MGS complete [ 8152.404197] loop0: detected capacity change from 0 to 204800000 [ 8152.478553] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8153.163955] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8153.203919] Lustre: lustre-MDT0000: Aborting client recovery [ 8154.211655] loop1: detected capacity change from 0 to 204800000 [ 8154.390304] LDISKFS-fs (loop1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 8154.547920] Lustre: 268596:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 8154.570706] Lustre: 268596:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0001: restore index '0x2010000' with [0x200000003:0x6:0x0]: rc = 0 [ 8154.583637] Lustre: 268596:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0001: restore index '0x10000' with [0x200000003:0x4:0x0]: rc = 0 [ 8154.597826] Lustre: 268596:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0001: restore index '0x10000-MDT0001' with [0x200000005:0x1:0x0]: rc = 0 [ 8154.614728] Lustre: 268596:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0001: restore index '0x2010000-MDT0001' with [0x200000005:0x3:0x0]: rc = 0 [ 8154.634213] Lustre: 268596:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0001: restore index '0x1010000' with [0x200000003:0x5:0x0]: rc = 0 [ 8154.643288] Lustre: 268596:0:(osd_scrub.c:1842:osd_index_restore()) lustre-MDT0001: restore index '0x1010000-MDT0001' with [0x200000005:0x2:0x0]: rc = 0 [ 8154.661444] Lustre: Found index 1 for lustre-MDT0001, updating log [ 8154.848764] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8154.942877] Lustre: lustre-MDT0001: Aborting client recovery [ 8155.780679] loop2: detected capacity change from 0 to 204800000 [ 8155.913847] LDISKFS-fs (loop2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 8155.986347] Lustre: 268675:0:(osd_scrub.c:1842:osd_index_restore()) lustre-OST0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 8156.000476] Lustre: 268675:0:(osd_scrub.c:1842:osd_index_restore()) lustre-OST0000: restore index '0x20000-OST0000' with [0x200000005:0x1:0x0]: rc = 0 [ 8156.009507] Lustre: 268675:0:(osd_scrub.c:1842:osd_index_restore()) lustre-OST0000: restore index '0x1020000-OST0000' with [0x200000005:0x2:0x0]: rc = 0 [ 8156.016932] Lustre: 268675:0:(osd_scrub.c:1842:osd_index_restore()) lustre-OST0000: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 8156.023895] Lustre: 268675:0:(osd_scrub.c:1842:osd_index_restore()) lustre-OST0000: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 8156.031200] Lustre: 268675:0:(osd_scrub.c:1842:osd_index_restore()) lustre-OST0000: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 8156.038731] Lustre: 268675:0:(osd_scrub.c:1842:osd_index_restore()) lustre-OST0000: restore index '0x2020000-OST0000' with [0x200000005:0x3:0x0]: rc = 0 [ 8156.175334] Lustre: Found index 0 for lustre-OST0000, updating log [ 8156.301794] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8156.322241] Lustre: lustre-OST0000: Aborting recovery [ 8157.420980] loop3: detected capacity change from 0 to 204800000 [ 8157.561100] LDISKFS-fs (loop3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 8157.720015] Lustre: 268758:0:(osd_scrub.c:1842:osd_index_restore()) lustre-OST0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 8157.752434] Lustre: 268758:0:(osd_scrub.c:1842:osd_index_restore()) lustre-OST0001: restore index '0x2020000-OST0001' with [0x200000005:0x3:0x0]: rc = 0 [ 8157.770185] Lustre: 268758:0:(osd_scrub.c:1842:osd_index_restore()) lustre-OST0001: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 8157.792536] Lustre: 268758:0:(osd_scrub.c:1842:osd_index_restore()) lustre-OST0001: restore index '0x1020000-OST0001' with [0x200000005:0x2:0x0]: rc = 0 [ 8157.813582] Lustre: 268758:0:(osd_scrub.c:1842:osd_index_restore()) lustre-OST0001: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 8157.823218] Lustre: 268758:0:(osd_scrub.c:1842:osd_index_restore()) lustre-OST0001: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 8157.838237] Lustre: 268758:0:(osd_scrub.c:1842:osd_index_restore()) lustre-OST0001: restore index '0x20000-OST0001' with [0x200000005:0x1:0x0]: rc = 0 [ 8157.867772] Lustre: Found index 1 for lustre-OST0001, updating log [ 8157.980420] Lustre: lustre-OST0001: Aborting recovery [ 8163.150898] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 8163.153468] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 8163.201531] LustreError: 268540:0:(lod_dev.c:510:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 10, retries 0, failed: rc = -108 [ 8163.226314] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000bd0 [ 8163.232011] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000bd0 [ 8165.272530] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:5 to 0x2c0000400:33) [ 8165.276219] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:5 to 0x280000400:33) [ 8165.896915] LustreError: 268508:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0000: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0000 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0000/identity_upcall, time 7921us: rc = -2 [ 8166.418501] LustreError: 268508:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0001: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0001 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0001/identity_upcall, time 511us: rc = -2 [ 8166.434255] LustreError: 268508:0:(mdt_identity.c:115:mdt_identity_do_upcall()) Skipped 27 previous similar messages [ 8180.711224] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8180.724442] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8180.736250] Lustre: Skipped 2 previous similar messages [ 8180.755210] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8184.793161] LustreError: 269107:0:(obd_class.h:479:obd_check_dev()) Device 10 not setup [ 8184.802342] LustreError: 269107:0:(obd_class.h:479:obd_check_dev()) Skipped 1 previous similar message [ 8185.151064] Lustre: server umount lustre-MDT0000 complete [ 8185.831725] LustreError: 268505:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8185.854479] LustreError: 268505:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 5 previous similar messages [ 8186.018991] LustreError: 268491:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768554718 with bad export cookie 3849263768326563743 [ 8186.026386] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8186.027750] LustreError: 268491:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 1 previous similar message [ 8190.946974] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8190.947196] LustreError: 268505:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8190.950037] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 8190.950048] Lustre: Skipped 3 previous similar messages [ 8190.953520] Lustre: Skipped 2 previous similar messages [ 8190.960178] LustreError: 268505:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 8192.005355] LustreError: 268506:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8192.005696] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 8192.023702] LustreError: 268506:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 8192.041629] Lustre: Skipped 2 previous similar messages [ 8192.250623] LustreError: 269158:0:(obd_class.h:479:obd_check_dev()) Device 18 not setup [ 8192.261393] LustreError: 269158:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 8192.500324] Lustre: server umount lustre-MDT0001 complete [ 8199.605496] LustreError: 269210:0:(obd_class.h:479:obd_check_dev()) Device 23 not setup [ 8199.617672] LustreError: 269210:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 8199.978431] Lustre: server umount lustre-OST0000 complete [ 8207.192058] LustreError: 269262:0:(obd_class.h:479:obd_check_dev()) Device 2 not setup [ 8207.208593] LustreError: 269262:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 8207.632370] Lustre: server umount lustre-OST0001 complete [ 8215.706336] Lustre: DEBUG MARKER: == conf-sanity test 109a: test lctl clear_conf fsname ==== 04:12:26 (1768554746) [ 8247.593650] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_hostid [ 8258.096781] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [ 8292.476063] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8292.897279] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 8292.960179] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 8293.026350] Lustre: lustre-MDT0000: new disk, initializing [ 8293.111739] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8293.116404] Lustre: Skipped 1 previous similar message [ 8293.129777] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 8298.386453] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 8310.123944] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 8310.335864] Lustre: 272801:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8310.466214] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 8310.477815] Lustre: Skipped 1 previous similar message [ 8310.578189] Lustre: lustre-MDT0001: new disk, initializing [ 8310.697419] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8310.755348] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 8310.779816] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 8316.014431] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 8325.206676] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8330.015640] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8337.794669] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 8338.125554] Lustre: lustre-OST0000: new disk, initializing [ 8338.128946] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 8338.234253] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8344.501209] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 8347.709477] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 8347.727846] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 8347.896685] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 8352.223411] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8358.140504] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 8367.731942] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 8375.958307] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 8384.288849] Lustre: Modifying parameter lustre-client.llite.max_read_ahead_mb=64 in log lustre-client [ 8430.054976] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 8430.055797] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8430.064772] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8430.065320] LustreError: Skipped 1 previous similar message [ 8430.121429] Lustre: Skipped 1 previous similar message [ 8435.177120] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8435.192823] Lustre: Skipped 2 previous similar messages [ 8441.312063] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 8441.357140] LustreError: 276319:0:(obd_class.h:479:obd_check_dev()) Device 19 not setup [ 8441.360210] LustreError: 276319:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 8441.656372] Lustre: server umount lustre-OST0000 complete [ 8448.996687] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8449.006307] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8449.041772] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8449.055671] Lustre: Skipped 2 previous similar messages [ 8460.256148] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 8460.388375] LustreError: 276524:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup [ 8460.400725] LustreError: 276524:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 8460.660689] Lustre: server umount lustre-MDT0000 complete [ 8460.772336] LustreError: 274275:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8460.802430] LustreError: 274275:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 8465.233642] LustreError: 272794:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768554997 with bad export cookie 3849263768326566452 [ 8465.234849] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8465.255073] LustreError: 272794:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 5 previous similar messages [ 8465.694275] Lustre: server umount lustre-MDT0001 complete [ 8474.333749] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8479.008773] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 8483.812990] Lustre: server umount MGS complete [ 8494.915149] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8495.280238] LustreError: 278293:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8495.309384] LustreError: 278305:0:(qmt_pool.c:1523:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 8495.373866] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8499.567795] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 8504.801272] LustreError: 278293:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8504.823984] LustreError: 278293:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 8508.384738] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 8512.970987] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 8518.315572] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8521.871651] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8528.646177] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 8528.981152] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8528.988027] Lustre: Skipped 1 previous similar message [ 8534.902476] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 8540.472432] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8564.196110] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 8564.210447] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8564.237939] Lustre: Skipped 1 previous similar message [ 8564.254471] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8564.265658] Lustre: Skipped 4 previous similar messages [ 8568.120486] LustreError: 280945:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 8568.127046] LustreError: 280945:0:(obd_class.h:479:obd_check_dev()) Skipped 15 previous similar messages [ 8568.214212] Lustre: server umount lustre-OST0000 complete [ 8575.456779] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8575.463346] LustreError: Skipped 1 previous similar message [ 8575.466609] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8575.502640] Lustre: Skipped 1 previous similar message [ 8577.968577] Lustre: server umount lustre-MDT0000 complete [ 8581.614083] LustreError: 279004:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8581.654401] LustreError: 279004:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 8582.665102] LustreError: 280682:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768555114 with bad export cookie 3849263768326568391 [ 8582.668952] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8582.677776] LustreError: 280682:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 1 previous similar message [ 8583.262262] Lustre: server umount lustre-MDT0001 complete [ 8598.200902] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing unload_modules_local [ 8601.624879] Key type lgssc unregistered [ 8601.895865] LNet: 281882:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8601.907519] LNetError: 281882:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8601.930119] LNet: Removed LNI 192.168.202.159@tcp [ 8603.038272] Key type .llcrypt unregistered [ 8603.043317] Key type ._llcrypt unregistered [ 8644.603203] Key type ._llcrypt registered [ 8644.605659] Key type .llcrypt registered [ 8644.728191] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_hostid [ 8660.265630] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [ 8661.312991] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8661.427753] alg: No test for adler32 (adler32-zlib) [ 8662.452160] Lustre: Lustre: Build Version: 2.17.50_30_gbb2e37c [ 8662.697975] LNet: Added LNI 192.168.202.159@tcp [8/256/0/180] [ 8664.351414] Key type lgssc registered [ 8665.599857] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8703.137545] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 8703.200866] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8704.514116] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 8704.545609] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 8704.606700] Lustre: lustre-MDT0000: new disk, initializing [ 8704.692127] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8704.718326] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 8708.425996] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 8719.085821] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 8719.194448] Lustre: 285802:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8719.226297] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 8719.229900] Lustre: Skipped 1 previous similar message [ 8719.281164] Lustre: lustre-MDT0001: new disk, initializing [ 8719.398457] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8719.449468] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 8719.459146] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 8723.546920] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 8730.235200] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8733.926835] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8740.892673] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 8741.224224] Lustre: lustre-OST0000: new disk, initializing [ 8741.243039] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 8741.382136] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8748.394326] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 8748.644106] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 8748.659088] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 8748.804281] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 8756.795858] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8764.970593] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 8779.139771] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 8783.691431] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 8790.211347] Lustre: Modifying parameter lustre-client.llite.max_read_ahead_mb=64 in log lustre-client [ 8830.945449] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 8830.945930] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8830.963270] LustreError: Skipped 1 previous similar message [ 8830.964789] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8831.015391] Lustre: Skipped 1 previous similar message [ 8833.105672] LustreError: 289321:0:(obd_class.h:479:obd_check_dev()) Device 19 not setup [ 8833.518993] Lustre: server umount lustre-OST0000 complete [ 8839.144276] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8839.146778] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8839.152227] Lustre: Skipped 1 previous similar message [ 8839.161104] Lustre: Skipped 2 previous similar messages [ 8844.207905] LustreError: 289523:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup [ 8844.213426] LustreError: 289523:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 8844.476478] Lustre: server umount lustre-MDT0000 complete [ 8848.102163] LustreError: 285796:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768555380 with bad export cookie 17582630615199445039 [ 8848.114674] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8848.117774] LustreError: 285796:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 8848.286687] LustreError: 289724:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 8848.293486] LustreError: 289724:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [ 8848.477848] Lustre: server umount lustre-MDT0001 complete [ 8856.851604] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8861.560906] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 8865.748093] LustreError: 290665:0:(obd_class.h:479:obd_check_dev()) Device 2 not setup [ 8865.750956] LustreError: 290665:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [ 8865.784151] Lustre: server umount MGS complete [ 8877.695636] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8878.244376] LustreError: 291288:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8878.261375] LustreError: 291288:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 8878.277785] LustreError: 291300:0:(qmt_pool.c:1523:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 8878.360689] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8883.688480] LustreError: 291288:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8884.078724] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 8887.821051] LustreError: 291288:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8892.899978] LustreError: 291288:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8894.401500] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 8894.873741] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8900.500988] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 8906.879672] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 8910.562564] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 8917.318326] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 8917.647986] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8924.870681] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 8931.098622] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 8962.016334] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 8962.023474] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8962.050966] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8964.068180] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 8964.068575] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8964.075815] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8967.553145] LustreError: 293943:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [ 8967.559633] LustreError: 293943:0:(obd_class.h:479:obd_check_dev()) Skipped 1 previous similar message [ 8967.693855] Lustre: server umount lustre-OST0000 complete [ 8974.305727] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8974.322620] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8974.348993] Lustre: Skipped 2 previous similar messages [ 8978.203966] LustreError: 294145:0:(obd_class.h:479:obd_check_dev()) Device 9 not setup [ 8978.214611] LustreError: 294145:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 8978.472301] Lustre: server umount lustre-MDT0000 complete [ 8979.426813] LustreError: 292000:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8979.461279] LustreError: 292000:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 8983.391331] LustreError: 291268:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768555515 with bad export cookie 17582630615199446957 [ 8983.393597] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8983.404446] LustreError: 291268:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 8983.837542] Lustre: server umount lustre-MDT0001 complete [ 8996.670570] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing unload_modules_local [ 8999.422063] Key type lgssc unregistered [ 8999.783958] LNet: 294879:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8999.792234] LNetError: 294879:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8999.809450] LNet: Removed LNI 192.168.202.159@tcp [ 9000.729188] Key type .llcrypt unregistered [ 9000.732916] Key type ._llcrypt unregistered [ 9023.013561] Key type ._llcrypt registered [ 9023.016450] Key type .llcrypt registered [ 9023.128902] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_hostid [ 9035.917602] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [ 9036.933774] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 9037.071878] alg: No test for adler32 (adler32-zlib) [ 9038.231588] Lustre: Lustre: Build Version: 2.17.50_30_gbb2e37c [ 9038.549840] LNet: Added LNI 192.168.202.159@tcp [8/256/0/180] [ 9040.271460] Key type lgssc registered [ 9041.932459] Lustre: Echo OBD driver; http://www.lustre.org/ [ 9068.686099] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [ 9085.073274] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 9085.165705] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9086.577704] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 9086.615590] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 9086.709240] Lustre: lustre-MDT0000: new disk, initializing [ 9086.838116] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9086.864523] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 9091.883864] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 9102.117339] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 9102.369609] Lustre: lustre-OST0000: new disk, initializing [ 9102.373470] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 9102.377616] Lustre: Skipped 1 previous similar message [ 9102.454178] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9105.702211] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 9105.708424] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 9105.757731] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 9108.331588] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 9889.250043] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9889.263700] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9892.753296] LustreError: 299877:0:(obd_class.h:479:obd_check_dev()) Device 13 not setup [ 9893.035781] Lustre: server umount lustre-MDT0000 complete [ 9897.597730] LustreError: 298040:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768556429 with bad export cookie 18293506471350835166 [ 9897.616022] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9897.619979] LustreError: 298040:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 9897.683538] LustreError: 300078:0:(obd_class.h:479:obd_check_dev()) Device 2 not setup [ 9897.689554] LustreError: 300078:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [ 9897.915678] Lustre: server umount lustre-OST0000 complete [ 9925.025168] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_hostid [ 9934.973945] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [ 9972.318986] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9972.593699] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 9972.622588] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 9972.682259] Lustre: lustre-MDT0000: new disk, initializing [ 9972.742496] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9972.758220] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 9977.765983] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [ 9987.592513] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [ 9987.752865] Lustre: 303113:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 9987.839572] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 9987.847917] Lustre: Skipped 1 previous similar message [ 9987.947691] Lustre: lustre-MDT0001: new disk, initializing [ 9988.054603] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9988.091927] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 9988.105936] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 9991.975245] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [10000.176087] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [10004.216394] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [10010.491736] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [10010.861507] Lustre: lustre-OST0000: new disk, initializing [10010.867262] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [10011.038378] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [10018.212901] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [10018.401069] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [10018.421622] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [10018.714556] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [10025.869522] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [10030.966413] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [10031.178218] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [10036.274916] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [10036.453593] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [10039.273487] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [10039.280145] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10039.281793] LustreError: Skipped 1 previous similar message [10039.283085] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [10039.305791] Lustre: Skipped 1 previous similar message [10039.321110] Lustre: Skipped 1 previous similar message [10044.397429] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [10044.401612] Lustre: Skipped 1 previous similar message [10044.742523] LustreError: 306043:0:(obd_class.h:479:obd_check_dev()) Device 19 not setup [10044.753601] LustreError: 306043:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [10044.867423] Lustre: server umount lustre-OST0000 complete [10049.507745] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10049.518852] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10049.519759] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [10054.625956] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10054.629517] Lustre: Skipped 2 previous similar messages [10055.431622] LustreError: 306245:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup [10055.442430] LustreError: 306245:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [10055.553818] Lustre: server umount lustre-MDT0000 complete [10059.117729] LustreError: 303105:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768556591 with bad export cookie 18293506471353776013 [10059.133888] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [10059.136183] LustreError: 303105:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 1 previous similar message [10059.383289] Lustre: server umount lustre-MDT0001 complete [10063.185323] Lustre: DEBUG MARKER: SKIP: conf-sanity test_111 skipping SLOW test 111 [10065.299457] Lustre: DEBUG MARKER: == conf-sanity test 112a: mount OST with no_create option ========================================================== 04:43:15 (1768556595) [10072.060839] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10072.628778] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10076.447264] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [10077.664541] LustreError: 307020:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10077.683957] LustreError: 307020:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [10081.769518] LustreError: 307020:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10084.267232] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [10084.598753] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [10089.331549] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [10095.589503] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [10099.302926] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [10106.072626] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [10106.470319] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [10112.648952] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [10118.076365] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [10124.887816] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [10125.020970] Lustre: lustre-OST0001: new disk, initializing [10125.026249] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [10125.121430] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [10130.875870] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [10133.638794] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [10133.655783] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [10133.724857] LustreError: 309960:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [10134.761239] LustreError: 309966:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [10134.781176] LustreError: 309966:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) Skipped 2 previous similar messages [10135.786973] LustreError: 309960:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [10137.959520] LustreError: 309966:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [10137.983269] LustreError: 309966:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) Skipped 4 previous similar messages [10139.889405] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [10140.212593] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [10142.050804] LustreError: 309960:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [10142.069115] LustreError: 309960:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) Skipped 6 previous similar messages [10144.345935] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8c7f501ba800.ost_server_uuid 50 [10146.181599] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff8c7f501ba800.ost_server_uuid in FULL state after 0 sec [10150.306643] LustreError: 309960:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [10150.313687] LustreError: 309960:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) Skipped 15 previous similar messages [10150.353992] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8c7f501ba800.ost_server_uuid 50 [10151.900682] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-ffff8c7f501ba800.ost_server_uuid in FULL state after 0 sec [10158.571465] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [10168.806874] LustreError: lustre-OST0001-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [10168.809967] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10168.815220] Lustre: Skipped 1 previous similar message [10168.818439] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [10173.178537] LustreError: 310821:0:(obd_class.h:479:obd_check_dev()) Device 25 not setup [10173.187589] LustreError: 310821:0:(obd_class.h:479:obd_check_dev()) Skipped 13 previous similar messages [10173.303765] Lustre: server umount lustre-OST0001 complete [10174.948434] LustreError: 308613:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10174.964640] LustreError: 308613:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [10179.556915] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [10179.561735] LustreError: Skipped 1 previous similar message [10179.564961] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10179.577883] Lustre: Skipped 1 previous similar message [10180.065380] LustreError: 308613:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10180.084216] LustreError: 308613:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [10184.371599] LustreError: 311023:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [10184.376421] LustreError: 311023:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [10184.537353] Lustre: server umount lustre-OST0000 complete [10190.308747] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10190.312777] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10190.332890] Lustre: Skipped 2 previous similar messages [10190.342038] Lustre: Skipped 7 previous similar messages [10194.483299] Lustre: server umount lustre-MDT0000 complete [10195.431311] LustreError: 307019:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10195.451566] LustreError: 307019:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [10197.624654] LustreError: 309515:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768556729 with bad export cookie 18293506471353776895 [10197.630904] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [10197.649032] LustreError: 309515:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 7 previous similar messages [10197.979423] Lustre: server umount lustre-MDT0001 complete [10208.230693] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing unload_modules_local [10210.849587] Key type lgssc unregistered [10211.119570] LNet: 311958:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [10211.124552] LNetError: 311958:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [10211.140635] LNet: Removed LNI 192.168.202.159@tcp [10211.883243] Key type .llcrypt unregistered [10211.884918] Key type ._llcrypt unregistered [10238.187554] Key type ._llcrypt registered [10238.190785] Key type .llcrypt registered [10238.326930] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [10240.265732] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [10240.638911] alg: No test for adler32 (adler32-zlib) [10241.634816] Lustre: Lustre: Build Version: 2.17.50_30_gbb2e37c [10241.909508] LNet: Added LNI 192.168.202.159@tcp [8/256/0/180] [10243.663166] Key type lgssc registered [10245.539402] Lustre: Echo OBD driver; http://www.lustre.org/ [10253.667695] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [10253.684989] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10255.248728] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10259.253195] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [10265.137066] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [10265.573301] LustreError: 313364:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10265.596806] LustreError: 313364:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [10270.690867] LustreError: 313364:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10272.039049] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [10272.358525] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [10277.343667] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [10285.811197] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [10286.306646] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [10292.532314] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [10297.573321] LustreError: 314913:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10299.083897] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [10300.645351] LustreError: 314915:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10300.667922] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:65) [10300.671160] LustreError: 314915:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [10305.988601] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [10306.018613] LustreError: 315522:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10306.042990] LustreError: 315522:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [10306.221609] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [10311.684483] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:33) [10312.241802] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [10317.931545] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [10324.334407] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing wait_import_state (FULL|IDLE) os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [10324.608390] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [10429.417789] LustreError: lustre-OST0001-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [10429.441054] Lustre: lustre-OST0001-osc-MDT0001: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10429.482646] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [10429.499389] Lustre: Skipped 1 previous similar message [10434.175087] LustreError: 316785:0:(obd_class.h:479:obd_check_dev()) Device 27 not setup [10434.221516] Lustre: server umount lustre-OST0001 complete [10434.533574] LustreError: 314913:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10434.552736] LustreError: 314913:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [10441.187686] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [10441.196044] LustreError: Skipped 1 previous similar message [10441.203589] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10441.216210] Lustre: Skipped 1 previous similar message [10441.225589] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [10444.260550] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [10444.286829] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10444.311385] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [10449.898553] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [10449.908359] Lustre: Skipped 2 previous similar messages [10455.008997] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [10455.010851] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [10455.011059] LustreError: 314912:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10455.011066] LustreError: 314912:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 6 previous similar messages [10455.050534] Lustre: Skipped 1 previous similar message [10455.105184] LustreError: 316987:0:(obd_class.h:479:obd_check_dev()) Device 23 not setup [10455.110705] LustreError: 316987:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [10455.268478] Lustre: server umount lustre-OST0000 complete [10460.130758] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10460.156759] Lustre: Skipped 1 previous similar message [10465.249066] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10465.261093] Lustre: Skipped 3 previous similar messages [10465.592030] LustreError: 317190:0:(obd_class.h:479:obd_check_dev()) Device 10 not setup [10465.599183] LustreError: 317190:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [10465.837722] Lustre: server umount lustre-MDT0000 complete [10469.587865] LustreError: 316681:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768557001 with bad export cookie 13859502956033150465 [10469.590353] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [10469.598142] LustreError: 316681:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [10469.711402] LustreError: 317391:0:(obd_class.h:479:obd_check_dev()) Device 18 not setup [10469.717438] LustreError: 317391:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [10470.015372] Lustre: server umount lustre-MDT0001 complete [10479.350186] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing unload_modules_local [10481.684843] Key type lgssc unregistered [10481.994369] LNet: 317923:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [10482.002713] LNetError: 317923:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [10483.056505] LNet: Removed LNI 192.168.202.159@tcp [10483.831863] Key type .llcrypt unregistered [10483.834155] Key type ._llcrypt unregistered [10522.515404] Key type ._llcrypt registered [10522.517781] Key type .llcrypt registered [10522.589292] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [10523.504073] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [10523.633767] alg: No test for adler32 (adler32-zlib) [10524.634679] Lustre: Lustre: Build Version: 2.17.50_30_gbb2e37c [10524.827970] LNet: Added LNI 192.168.202.159@tcp [8/256/0/180] [10526.536258] Key type lgssc registered [10527.523816] Lustre: Echo OBD driver; http://www.lustre.org/ [10534.932665] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [10534.946538] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10536.360755] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10540.340290] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [10546.660719] LustreError: 320192:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10546.684703] LustreError: 320192:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [10548.023042] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [10548.353232] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [10552.306390] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [10554.853579] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [10561.197711] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [10561.722655] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [10567.278147] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [10572.969796] LustreError: 321647:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10574.674849] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [10574.824528] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [10580.259409] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [10580.786163] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:65) [10580.796055] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:97) [10588.156587] Lustre: DEBUG MARKER: Using TIMEOUT=20 [10593.301849] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [10611.690949] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10611.708176] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10611.721136] Lustre: Skipped 2 previous similar messages [10611.739367] Lustre: Skipped 3 previous similar messages [10616.813067] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10616.827713] Lustre: Skipped 3 previous similar messages [10616.871952] LustreError: 323595:0:(obd_class.h:479:obd_check_dev()) Device 10 not setup [10617.003890] Lustre: server umount lustre-MDT0000 complete [10620.959272] LustreError: 323138:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768557153 with bad export cookie 9770259089994619640 [10620.970741] LustreError: 323138:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 1 previous similar message [10620.972896] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [10621.159337] LustreError: 323797:0:(obd_class.h:479:obd_check_dev()) Device 18 not setup [10621.166183] LustreError: 323797:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [10621.480402] Lustre: server umount lustre-MDT0001 complete [10634.862322] LustreError: 323998:0:(obd_class.h:479:obd_check_dev()) Device 23 not setup [10634.875799] LustreError: 323998:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages [10634.999586] Lustre: server umount lustre-OST0000 complete [10638.303780] Lustre: 319453:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1768557154/real 1768557154] req@ffff9b70372cd500 x1854466484663168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1768557170 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [10638.334129] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10638.350045] Lustre: Skipped 1 previous similar message [10638.865828] LustreError: 324200:0:(obd_class.h:479:obd_check_dev()) Device 2 not setup [10638.868890] LustreError: 324200:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages [10639.023893] Lustre: server umount lustre-OST0001 complete [10653.804305] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [10663.666278] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10664.034486] LustreError: 325375:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10664.105261] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10668.172759] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [10669.538335] LustreError: 325375:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10674.658556] LustreError: 325375:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10675.722824] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [10676.232251] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [10679.939554] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [10682.393938] Lustre: 326481:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [10688.245524] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [10689.643839] LustreError: 326836:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10689.666628] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:129) [10694.900794] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [10703.272596] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [10703.529432] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [10703.538886] Lustre: Skipped 1 previous similar message [10705.482442] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:97) [10709.652397] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [10717.207922] Lustre: DEBUG MARKER: Using TIMEOUT=20 [10720.789539] Lustre: 328324:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [10732.512260] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [10732.529918] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10732.555068] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10734.569911] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10734.574867] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10734.586952] Lustre: Skipped 1 previous similar message [10734.607594] Lustre: Skipped 1 previous similar message [10737.181309] LustreError: 328429:0:(obd_class.h:479:obd_check_dev()) Device 10 not setup [10737.187258] LustreError: 328429:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [10737.594462] Lustre: server umount lustre-MDT0000 complete [10739.684777] LustreError: 325369:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10739.702719] LustreError: 325369:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 7 previous similar messages [10740.912898] LustreError: 325357:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768557273 with bad export cookie 9770259089994621341 [10740.917367] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [10740.920740] LustreError: 325357:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [10741.206894] Lustre: server umount lustre-MDT0001 complete [10755.210598] LustreError: 328832:0:(obd_class.h:479:obd_check_dev()) Device 23 not setup [10755.216082] LustreError: 328832:0:(obd_class.h:479:obd_check_dev()) Skipped 15 previous similar messages [10755.306438] Lustre: server umount lustre-OST0000 complete [10770.905549] Lustre: server umount lustre-OST0001 complete [10775.826383] Lustre: DEBUG MARKER: SKIP: conf-sanity test_114 skipping SLOW test 114 [10778.568801] Lustre: DEBUG MARKER: SKIP: conf-sanity test_115 skipping excluded test 115 [10780.895639] Lustre: DEBUG MARKER: == conf-sanity test 116: big size MDT support ============ 04:55:11 (1768557311) [10804.825984] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [10816.213059] loop0: detected capacity change from 0 to 1099511627776 [10816.914861] SGI XFS with ACLs, security attributes, quota, no debug enabled [10816.919159] *** VALIDATE xfs *** [10816.925894] XFS (loop0): Mounting V5 Filesystem [10816.953214] XFS (loop0): Ending clean mount [10818.007482] loop1: detected capacity change from 0 to 18691697672192 [10946.156121] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_hostid [10955.821032] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [10992.149515] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10992.664360] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [10992.716416] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [10992.843622] Lustre: lustre-MDT0000: new disk, initializing [10992.979374] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10993.009464] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [10998.451955] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [11010.203610] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [11010.311475] Lustre: 333418:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [11010.370420] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [11010.375265] Lustre: Skipped 1 previous similar message [11010.442857] Lustre: lustre-MDT0001: new disk, initializing [11010.605681] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [11010.619230] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [11015.070942] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [11022.682380] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [11026.416443] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [11033.034312] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [11033.363962] Lustre: lustre-OST0000: new disk, initializing [11033.369346] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [11034.610836] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [11034.617963] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [11034.767763] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [11039.446221] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [11048.529400] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [11054.591576] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [11054.812652] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [11059.561618] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [11059.789301] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [11065.314400] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [11065.332129] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11065.347111] Lustre: Skipped 1 previous similar message [11065.361130] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [11067.581044] LustreError: 336349:0:(obd_class.h:479:obd_check_dev()) Device 19 not setup [11067.589760] LustreError: 336349:0:(obd_class.h:479:obd_check_dev()) Skipped 9 previous similar messages [11067.777937] Lustre: server umount lustre-OST0000 complete [11071.974575] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [11076.064801] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [11076.069136] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11076.069144] Lustre: Skipped 2 previous similar messages [11076.127688] Lustre: Skipped 3 previous similar messages [11086.305882] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [11086.557757] Lustre: server umount lustre-MDT0000 complete [11091.428572] LustreError: 333423:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11091.461837] LustreError: 333423:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [11091.664289] LustreError: 333408:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768557623 with bad export cookie 9770259089994622895 [11091.670923] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [11091.675867] LustreError: 333408:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [11092.055444] Lustre: server umount lustre-MDT0001 complete [11103.263509] XFS (loop0): Unmounting Filesystem [11107.506205] Lustre: DEBUG MARKER: == conf-sanity test 117: lctl get_param return errors properly ========================================================== 05:00:38 (1768557638) [11113.811885] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11114.255177] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [11114.264603] Lustre: Skipped 2 previous similar messages [11119.552678] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [11129.396983] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [11129.827248] Lustre: lustre-MDT0001: Not available for connect from 0@lo (not set up) [11129.840937] Lustre: Skipped 4 previous similar messages [11133.996120] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [11140.310684] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [11145.135859] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [11151.826936] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [11157.889799] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [11164.041985] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [11174.882508] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [11174.901622] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11174.915547] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [11174.927407] Lustre: Skipped 1 previous similar message [11174.942516] Lustre: Skipped 1 previous similar message [11178.940491] LustreError: 339919:0:(obd_class.h:479:obd_check_dev()) Device 21 not setup [11178.946742] LustreError: 339919:0:(obd_class.h:479:obd_check_dev()) Skipped 17 previous similar messages [11179.243723] Lustre: server umount lustre-OST0000 complete [11189.908932] Lustre: server umount lustre-MDT0000 complete [11190.243306] LustreError: 337569:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11190.274993] LustreError: 337569:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 4 previous similar messages [11195.483678] LustreError: 338298:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768557727 with bad export cookie 9770259089994623777 [11195.488067] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [11195.490710] LustreError: 338298:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 1 previous similar message [11195.920828] Lustre: server umount lustre-MDT0001 complete [11207.465673] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing unload_modules_local [11210.915568] Key type lgssc unregistered [11211.140682] LNet: 340855:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [11211.146340] LNetError: 340855:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [11211.157831] LNet: Removed LNI 192.168.202.159@tcp [11211.943130] Key type .llcrypt unregistered [11211.947067] Key type ._llcrypt unregistered [11242.309768] Key type ._llcrypt registered [11242.311500] Key type .llcrypt registered [11242.475260] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [11243.791436] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [11243.880647] alg: No test for adler32 (adler32-zlib) [11245.049228] Lustre: Lustre: Build Version: 2.17.50_30_gbb2e37c [11245.334573] LNet: Added LNI 192.168.202.159@tcp [8/256/0/180] [11247.103688] Key type lgssc registered [11248.056397] Lustre: Echo OBD driver; http://www.lustre.org/ [11257.163146] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [11257.178424] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11258.813631] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [11263.755663] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [11269.095663] LustreError: 342404:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11269.130288] LustreError: 342404:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [11273.254312] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [11273.756423] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [11278.100615] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [11284.071179] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [11287.356924] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [11295.035798] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [11295.339367] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [11302.069996] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [11308.338868] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [11315.916846] LustreError: 344696:0:(obd_class.h:479:obd_check_dev()) Device 16 not setup [11316.022231] Lustre: server umount lustre-MDT0001 complete [11316.220277] LustreError: 344179:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.202.59@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [11319.791217] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [11319.801497] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11319.836620] LustreError: 342404:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11320.306618] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11325.414919] LustreError: 342405:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11325.426406] LustreError: 342405:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 4 previous similar messages [11325.656715] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [11325.714325] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [11325.716049] Lustre: Found index 1 for lustre-MDT0001, updating log [11325.735407] Lustre: 342393:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [11325.930618] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [11329.947844] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [11331.052800] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [11335.174064] LustreError: 345655:0:(obd_mount.c:188:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [11335.183761] LustreError: 345655:0:(tgt_mount.c:669:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [11335.190541] LustreError: 342396:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [11335.247364] LustreError: 345658:0:(obd_config.c:2001:class_config_llog_handler()) MGC192.168.202.159@tcp: cfg command failed: rc = -17 [11335.255768] Lustre: cmd=cf001 0:lustre-MDT0001-osp-MDT0000 1:osp 2:lustre-MDT0000-mdtlov_UUID [11335.255768] [11638.240555] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [11638.256088] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11638.284874] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [11638.881750] Lustre: lustre-MDT0001: Not available for connect from 192.168.202.59@tcp (stopping) [11641.314223] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [11641.320338] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11643.068220] LustreError: 353054:0:(obd_class.h:479:obd_check_dev()) Device 16 not setup [11643.082274] LustreError: 353054:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [11643.416462] Lustre: server umount lustre-MDT0001 complete [11643.885822] LustreError: 344179:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.202.59@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [11654.113620] LustreError: 342401:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.202.59@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [11654.142221] LustreError: 342401:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 5 previous similar messages [11658.041967] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [11658.150239] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [11658.157561] Lustre: Found index 1 for lustre-MDT0001, updating log [11658.189185] Lustre: 342392:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [11658.540924] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [11663.153352] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [11663.848109] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [11665.400054] LustreError: 353971:0:(obd_mount.c:188:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [11665.412510] LustreError: 353971:0:(tgt_mount.c:669:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [11665.425494] LustreError: 342396:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [11665.429719] LustreError: 342396:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [11665.514478] LustreError: 353978:0:(obd_config.c:689:class_setup()) Device 8 already setup (type osp) [11665.520756] LustreError: 353978:0:(obd_config.c:797:class_detach()) OBD device 8 still set up [11665.525718] LustreError: 353978:0:(obd_config.c:2001:class_config_llog_handler()) MGC192.168.202.159@tcp: cfg command failed: rc = -17 [11665.540025] Lustre: cmd=cf003 0:lustre-MDT0001-osp-MDT0000 1:lustre-MDT0001_UUID 2:192.168.202.159@tcp [11665.540025] [11971.040428] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [11971.049045] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11971.054831] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [11971.060831] Lustre: Skipped 1 previous similar message [11971.071813] Lustre: Skipped 2 previous similar messages [11976.163775] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [11976.178354] Lustre: Skipped 1 previous similar message [11982.303133] Lustre: lustre-MDT0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [11982.414871] LustreError: 361463:0:(obd_class.h:479:obd_check_dev()) Device 16 not setup [11982.428458] LustreError: 361463:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [11982.517824] Lustre: server umount lustre-MDT0001 complete [11986.404725] LustreError: 342400:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11986.430622] LustreError: 342400:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [11993.841549] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [11993.995415] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [11994.008748] Lustre: Found index 1 for lustre-MDT0001, updating log [11994.080501] Lustre: 342393:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [11994.445576] Lustre: lustre-MDT0001: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [11999.153728] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [11999.718229] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [12003.864720] LustreError: 362421:0:(obd_mount.c:188:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [12003.879871] LustreError: 362421:0:(tgt_mount.c:669:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [12003.906613] LustreError: 342396:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [12003.921335] LustreError: 342396:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [12003.993121] LustreError: 362424:0:(lod_lov.c:212:lod_add_device()) lustre-MDT0001-osp-MDT0000: cannot connect to next dev lustre-MDT0001_UUID (-114) [12004.009898] LustreError: 362424:0:(obd_config.c:2001:class_config_llog_handler()) MGC192.168.202.159@tcp: cfg command failed: rc = -114 [12004.016917] Lustre: cmd=cf014 0:lustre-MDT0000-mdtlov 1:lustre-MDT0001_UUID 2:1 3:1 [12004.016917] [12322.272991] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [12322.281974] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [12322.300583] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [12322.303133] Lustre: Skipped 5 previous similar messages [12327.508605] LustreError: 369691:0:(obd_class.h:479:obd_check_dev()) Device 9 not setup [12327.532976] LustreError: 369691:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [12327.789535] Lustre: server umount lustre-MDT0000 complete [12330.469728] LustreError: 342400:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [12330.490071] LustreError: 342400:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 6 previous similar messages [12331.074965] LustreError: 342386:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768558863 with bad export cookie 717079155933160803 [12331.078827] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [12331.083638] LustreError: 342386:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 4 previous similar messages [12337.297270] LustreError: 369892:0:(obd_class.h:479:obd_check_dev()) Device 16 not setup [12337.307133] LustreError: 369892:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages [12337.617659] Lustre: server umount lustre-MDT0001 complete [12341.465433] Lustre: server umount lustre-OST0000 complete [12351.423064] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_hostid [12363.299909] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [12401.217653] Lustre: DEBUG MARKER: == conf-sanity test 120: cross-target rename should not create bad symlinks ========================================================== 05:22:12 (1768558932) [12407.152309] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12407.417727] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [12407.472811] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [12407.565240] Lustre: lustre-MDT0000: new disk, initializing [12407.698853] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [12407.725205] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [12411.953352] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [12423.564440] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [12423.726564] Lustre: 372620:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [12423.813583] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [12423.817906] Lustre: Skipped 1 previous similar message [12423.947579] Lustre: lustre-MDT0001: new disk, initializing [12424.215678] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [12424.294299] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [12424.300273] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [12430.292750] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [12439.225450] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [12443.633112] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [12450.839303] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc [12451.126642] Lustre: lustre-OST0000: new disk, initializing [12451.134893] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [12451.217520] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [12457.302742] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug -1 all [12459.636841] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [12459.655543] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [12459.740339] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [12464.705771] Lustre: DEBUG MARKER: oleg259-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [12473.836115] LustreError: lustre-MDT0000-osp-MDT0001: operation out_update to node 0@lo failed: rc = -107 [12473.843212] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [12473.857659] Lustre: Skipped 3 previous similar messages [12473.863107] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [12473.866099] Lustre: Skipped 5 previous similar messages [12474.291305] LustreError: 375053:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup [12474.299592] LustreError: 375053:0:(obd_class.h:479:obd_check_dev()) Skipped 11 previous similar messages [12474.434567] Lustre: server umount lustre-MDT0000 complete [12475.372536] LustreError: 372631:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [12475.408067] LustreError: 372631:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 4 previous similar messages [12478.209289] LustreError: 372610:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768559010 with bad export cookie 717079155933162770 [12478.220934] LustreError: MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [12478.222627] LustreError: 373407:0:(osp_object.c:617:osp_attr_get()) lustre-MDT0000-osp-MDT0001: osp_attr_get update error [0x200000401:0x2:0x0]: rc = -5 [12478.224291] LustreError: 372610:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 2 previous similar messages [12478.785598] Lustre: server umount lustre-MDT0001 complete [12491.868117] LustreError: 375455:0:(obd_class.h:479:obd_check_dev()) Device 2 not setup [12491.878881] LustreError: 375455:0:(obd_class.h:479:obd_check_dev()) Skipped 11 previous similar messages [12492.160446] Lustre: server umount lustre-OST0000 complete [12523.019397] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing set_hostid [12534.571778] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local [12569.978898] Lustre: DEBUG MARKER: == conf-sanity test complete, duration 12343 sec ========= 05:25:00 (1768559100) [12571.792156] Lustre: DEBUG MARKER: === conf-sanity: start cleanup 05:25:02 (1768559102) === [12575.356104] Lustre: DEBUG MARKER: === conf-sanity: finish cleanup 05:25:06 (1768559106) === [12615.834817] Lustre: DEBUG MARKER: oleg259-server.virtnet: executing unload_modules_local [12618.400659] Key type lgssc unregistered [12618.662555] LNet: 380559:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [12618.674775] LNetError: 380559:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found [12619.690504] LNet: Removed LNI 192.168.202.159@tcp [12620.521167] Key type .llcrypt unregistered [12620.523965] Key type ._llcrypt unregistered