[ 0.000000] Linux version 4.18.0rh8.10-debug (green@maintenance) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-26) (GCC)) #2 SMP Mon Jul 14 01:24:22 EDT 2025 [ 0.000000] Command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffcdfff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffce000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x0000000146dfffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.8 present. [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 [ 0.000000] Hypervisor detected: KVM [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 516854057 cycles [ 0.000000] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns [ 0.000000] tsc: Detected 2400.000 MHz processor [ 0.000000] last_pfn = 0x146e00 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0xbffce max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000f54b0-0x000f54bf] [ 0.000000] RAMDISK: [mem 0xbcc54000-0xbffbffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F52D0 000014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 0x00000000BFFE247C 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 0x00000000BFFE2318 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 0x00000000BFFE0040 0022D8 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 0x00000000BFFE0000 000040 [ 0.000000] ACPI: APIC 0x00000000BFFE238C 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: HPET 0x00000000BFFE241C 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: WAET 0x00000000BFFE2454 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0xbffe2318-0xbffe238b] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe2317] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0xbffe238c-0xbffe241b] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0xbffe241c-0xbffe2453] [ 0.000000] ACPI: Reserving WAET table memory at [mem 0xbffe2454-0xbffe247b] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x0000000146dfffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x1465a3000-0x1465cdfff] [ 0.000000] Reserving 256MB of memory at 2752MB for crashkernel (System RAM: 4205MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009efff] [ 0.000000] node 0: [mem 0x0000000000100000-0x00000000bffcdfff] [ 0.000000] node 0: [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Zeroed struct page in unavailable ranges: 4756 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x0000000146dfffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] TSC deadline timer available [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] kvm-guest: KVM setup pv remote TLB flush [ 0.000000] kvm-guest: setup PV sched yield [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbffce000-0xbfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.000000] [mem 0xc0000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u524288 [ 0.000000] kvm-guest: PV spinlocks enabled [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1059606 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] audit: disabled (until reboot) [ 0.000000] software IO TLB: area num 4. [ 0.000000] Memory: 2829652K/4306352K available (18435K kernel code, 11221K rwdata, 7248K rodata, 2908K init, 18040K bss, 524580K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] ftrace: allocating 41240 entries in 162 pages [ 0.000000] ftrace: allocated 162 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU event tracing is enabled. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=4. [ 0.000000] rcu: RCU callback double-/use-after-free debug enabled. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 [ 0.000000] NR_IRQS: 524544, nr_irqs: 456, preallocated irqs: 16 [ 0.000000] random: get_random_bytes called from start_kernel+0x622/0x9a8 with crng_init=0 [ 0.001000] Console: colour *CGA 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns [ 0.001015] APIC: Switch to symmetric I/O mode setup [ 0.002444] x2apic enabled [ 0.003011] Switched APIC routing to physical x2apic. [ 0.004016] kvm-guest: setup PV IPIs [ 0.007741] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.008000] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x22983777dd9, max_idle_ns: 440795300422 ns [ 0.008022] Calibrating delay loop (skipped) preset value.. 4800.00 BogoMIPS (lpj=2400000) [ 0.009014] pid_max: default: 32768 minimum: 301 [ 0.010000] LSM: Security Framework initializing [ 0.010081] Yama: becoming mindful. [ 0.012045] SELinux: Initializing. [ 0.014002] *** VALIDATE selinux *** [ 0.024368] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, vmalloc) [ 0.029511] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc) [ 0.031237] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.033098] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.034102] *** VALIDATE tmpfs *** [ 0.036372] *** VALIDATE proc *** [ 0.037406] *** VALIDATE cgroup *** [ 0.039009] *** VALIDATE cgroup2 *** [ 0.041344] x86/cpu: User Mode Instruction Prevention (UMIP) activated [ 0.042160] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.043015] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 [ 0.044037] Spectre V2 : User space: Vulnerable [ 0.045016] Speculative Store Bypass: Vulnerable [ 0.047000] debug: unmapping init [mem 0xffffffffb8e59000-0xffffffffb8e60fff] [ 0.048273] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (family: 0x6, model: 0x3e, stepping: 0x4) [ 0.049801] Performance Events: IvyBridge events, full-width counters, Intel PMU driver. [ 0.050024] ... version: 2 [ 0.051072] ... bit width: 48 [ 0.052010] ... generic registers: 4 [ 0.053009] ... value mask: 0000ffffffffffff [ 0.054017] ... max period: 00007fffffffffff [ 0.055021] ... fixed-purpose events: 3 [ 0.056016] ... event mask: 000000070000000f [ 0.057326] rcu: Hierarchical SRCU implementation. [ 0.061415] smp: Bringing up secondary CPUs ... [ 0.063508] x86: Booting SMP configuration: [ 0.064124] .... node #0, CPUs: #1 #2 #3 [ 0.081422] smp: Brought up 1 node, 4 CPUs [ 0.083011] smpboot: Max logical packages: 1 [ 0.084013] smpboot: Total of 4 processors activated (19200.00 BogoMIPS) [ 0.126492] node 0 deferred pages initialised in 40ms [ 0.133140] devtmpfs: initialized [ 0.134263] x86/mm: Memory block size: 128MB [ 0.137293] gcov: version magic: 0x41383552 [ 0.139331] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.140101] futex hash table entries: 1024 (order: 4, 65536 bytes, vmalloc) [ 0.141356] pinctrl core: initialized pinctrl subsystem [ 0.142290] [ 0.142860] ************************************************************* [ 0.143065] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.144022] ** ** [ 0.145016] ** IOMMU DebugFS SUPPORT HAS BEEN ENABLED IN THIS KERNEL ** [ 0.146014] ** ** [ 0.147019] ** This means that this kernel is built to expose internal ** [ 0.148014] ** IOMMU data structures, which may compromise security on ** [ 0.149018] ** your system. ** [ 0.150013] ** ** [ 0.151016] ** If you see this message and you are not debugging the ** [ 0.152011] ** kernel, report this immediately to your vendor! ** [ 0.153019] ** ** [ 0.154013] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.155017] ************************************************************* [ 0.157161] NET: Registered protocol family 16 [ 0.159471] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations [ 0.162061] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.165067] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.170108] cpuidle: using governor menu [ 0.173395] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.178247] PCI: Using configuration type 1 for base access [ 0.179463] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.186121] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.187038] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.189116] cryptd: max_cpu_qlen set to 1000 [ 0.192915] ACPI: Added _OSI(Module Device) [ 0.193020] ACPI: Added _OSI(Processor Device) [ 0.195017] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.197607] ACPI: Added _OSI(Processor Aggregator Device) [ 0.205101] ACPI: 1 ACPI AML tables successfully acquired and loaded [ 0.216461] ACPI: Interpreter enabled [ 0.218065] ACPI: PM: (supports S0 S3 S4 S5) [ 0.220107] ACPI: Using IOAPIC for interrupt routing [ 0.224126] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.227406] ACPI: Enabled 2 GPEs in block 00 to 0F [ 0.244223] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.249049] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3] [ 0.253024] acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI] [ 0.258080] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.265454] acpiphp: Slot [2] registered [ 0.266126] acpiphp: Slot [5] registered [ 0.267000] acpiphp: Slot [6] registered [ 0.268144] acpiphp: Slot [7] registered [ 0.270127] acpiphp: Slot [8] registered [ 0.272148] acpiphp: Slot [9] registered [ 0.273000] acpiphp: Slot [10] registered [ 0.274224] acpiphp: Slot [3] registered [ 0.276164] acpiphp: Slot [4] registered [ 0.278113] acpiphp: Slot [11] registered [ 0.280149] acpiphp: Slot [12] registered [ 0.284143] acpiphp: Slot [13] registered [ 0.286275] acpiphp: Slot [14] registered [ 0.289120] acpiphp: Slot [15] registered [ 0.291275] acpiphp: Slot [16] registered [ 0.294135] acpiphp: Slot [17] registered [ 0.295000] acpiphp: Slot [18] registered [ 0.297121] acpiphp: Slot [19] registered [ 0.304149] acpiphp: Slot [20] registered [ 0.306129] acpiphp: Slot [21] registered [ 0.312155] acpiphp: Slot [22] registered [ 0.317163] acpiphp: Slot [23] registered [ 0.321132] acpiphp: Slot [24] registered [ 0.327223] acpiphp: Slot [25] registered [ 0.328000] acpiphp: Slot [26] registered [ 0.329201] acpiphp: Slot [27] registered [ 0.330132] acpiphp: Slot [28] registered [ 0.335140] acpiphp: Slot [29] registered [ 0.338154] acpiphp: Slot [30] registered [ 0.340163] acpiphp: Slot [31] registered [ 0.344108] PCI host bridge to bus 0000:00 [ 0.348028] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.351022] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.356035] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.361029] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 0.364031] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] [ 0.367030] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.369206] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.373559] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.378602] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 0.405033] pci 0000:00:01.1: reg 0x20: [io 0xc320-0xc32f] [ 0.412000] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.416020] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.420022] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.426018] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.434117] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 0.443846] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 0.445070] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 0.452889] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 [ 0.473018] pci 0000:00:02.0: reg 0x10: [io 0xc300-0xc31f] [ 0.493155] pci 0000:00:02.0: reg 0x20: [mem 0xe0000000000-0xe0000003fff 64bit pref] [ 0.501021] pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 0.509000] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 [ 0.520019] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] [ 0.530016] pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] [ 0.550016] pci 0000:00:05.0: reg 0x20: [mem 0xe0000004000-0xe0000007fff 64bit pref] [ 0.560000] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 [ 0.566019] pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] [ 0.577018] pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 0.595013] pci 0000:00:06.0: reg 0x20: [mem 0xe0000008000-0xe000000bfff 64bit pref] [ 0.603559] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 [ 0.608015] pci 0000:00:07.0: reg 0x10: [io 0xc100-0xc17f] [ 0.613017] pci 0000:00:07.0: reg 0x14: [mem 0xfebc2000-0xfebc2fff] [ 0.625016] pci 0000:00:07.0: reg 0x20: [mem 0xe000000c000-0xe000000ffff 64bit pref] [ 0.631140] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 [ 0.637017] pci 0000:00:08.0: reg 0x10: [io 0xc180-0xc1ff] [ 0.642015] pci 0000:00:08.0: reg 0x14: [mem 0xfebc3000-0xfebc3fff] [ 0.655015] pci 0000:00:08.0: reg 0x20: [mem 0xe0000010000-0xe0000013fff 64bit pref] [ 0.660019] pci 0000:00:09.0: [1af4:1001] type 00 class 0x010000 [ 0.667019] pci 0000:00:09.0: reg 0x10: [io 0xc200-0xc27f] [ 0.674015] pci 0000:00:09.0: reg 0x14: [mem 0xfebc4000-0xfebc4fff] [ 0.689018] pci 0000:00:09.0: reg 0x20: [mem 0xe0000014000-0xe0000017fff 64bit pref] [ 0.698000] pci 0000:00:0a.0: [1af4:1001] type 00 class 0x010000 [ 0.702025] pci 0000:00:0a.0: reg 0x10: [io 0xc280-0xc2ff] [ 0.707019] pci 0000:00:0a.0: reg 0x14: [mem 0xfebc5000-0xfebc5fff] [ 0.717017] pci 0000:00:0a.0: reg 0x20: [mem 0xe0000018000-0xe000001bfff 64bit pref] [ 0.726248] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 [ 0.728338] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 0.730260] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 [ 0.731218] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 0.733213] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 [ 0.737023] iommu: Default domain type: Passthrough [ 0.739528] SCSI subsystem initialized [ 0.741314] ACPI: bus type USB registered [ 0.743163] usbcore: registered new interface driver usbfs [ 0.744046] usbcore: registered new interface driver hub [ 0.745056] usbcore: registered new device driver usb [ 0.747126] pps_core: LinuxPPS API ver. 1 registered [ 0.748007] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 0.750087] PTP clock support registered [ 0.752029] EDAC MC: Ver: 3.0.0 [ 0.753106] PCI: Using ACPI for IRQ routing [ 0.754908] NetLabel: Initializing [ 0.756007] NetLabel: domain hash size = 128 [ 0.757005] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 0.758062] NetLabel: unlabeled traffic allowed by default [ 0.759286] vgaarb: loaded [ 0.761227] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 0.762009] hpet0: 3 comparators, 64-bit 100.000000 MHz counter [ 0.766858] clocksource: Switched to clocksource kvm-clock [ 0.860859] VFS: Disk quotas dquot_6.6.0 [ 0.862333] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 0.864292] *** VALIDATE ramfs *** [ 0.865231] *** VALIDATE hugetlbfs *** [ 0.866685] pnp: PnP ACPI init [ 0.869681] pnp: PnP ACPI: found 6 devices [ 0.888288] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 0.892693] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 0.895621] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 0.898637] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 0.901869] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 0.905114] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] [ 0.908797] NET: Registered protocol family 2 [ 0.911750] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, vmalloc) [ 0.917109] tcp_listen_portaddr_hash hash table entries: 4096 (order: 5, 163840 bytes, vmalloc) [ 0.921411] TCP established hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.927568] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc) [ 0.931676] TCP: Hash tables configured (established 65536 bind 65536) [ 0.935582] MPTCP token hash table entries: 8192 (order: 6, 393216 bytes, vmalloc) [ 0.939632] UDP hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.943657] UDP-Lite hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.947544] NET: Registered protocol family 1 [ 0.951526] RPC: Registered named UNIX socket transport module. [ 0.954132] RPC: Registered udp transport module. [ 0.956842] RPC: Registered tcp transport module. [ 0.960059] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 0.963080] NET: Registered protocol family 44 [ 0.965223] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 0.967855] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 0.970617] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 0.973911] PCI: CLS 0 bytes, default 64 [ 0.975834] Unpacking initramfs... [ 4.137757] debug: unmapping init [mem 0xffff9751fcc54000-0xffff9751fffbffff] [ 4.148084] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 4.153672] software IO TLB: mapped [mem 0x00000000a8000000-0x00000000ac000000] (64MB) [ 4.162486] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x22983777dd9, max_idle_ns: 440795300422 ns [ 5.842441] Initialise system trusted keyrings [ 5.847118] Key type blacklist registered [ 5.849582] workingset: timestamp_bits=36 max_order=20 bucket_order=0 [ 5.861893] zbud: loaded [ 5.869053] *** VALIDATE nfs *** [ 5.873066] *** VALIDATE nfs4 *** [ 5.876085] pstore: using deflate compression [ 5.882293] Platform Keyring initialized [ 6.135159] NET: Registered protocol family 38 [ 6.137774] Key type asymmetric registered [ 6.140456] Asymmetric key parser 'x509' registered [ 6.145778] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 6.152902] io scheduler mq-deadline registered [ 6.157692] io scheduler kyber registered [ 6.163539] io scheduler bfq registered [ 6.167742] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 6.174458] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 6.181267] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 6.187703] ACPI: Power Button [PWRF] [ 6.197780] ACPI: \_SB_.LNKB: Enabled at IRQ 10 [ 6.207721] ACPI: \_SB_.LNKA: Enabled at IRQ 11 [ 6.238075] ACPI: \_SB_.LNKC: Enabled at IRQ 11 [ 6.261113] ACPI: \_SB_.LNKD: Enabled at IRQ 10 [ 6.302672] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 6.342883] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 6.386500] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 6.396850] Non-volatile memory driver v1.3 [ 6.401707] Linux agpgart interface v0.103 [ 6.529456] virtio_blk virtio1: [vda] 150016 512-byte logical blocks (76.8 MB/73.3 MiB) [ 6.543061] vda: detected capacity change from 0 to 76808192 [ 6.603563] virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) [ 6.608620] vdb: detected capacity change from 0 to 1073741824 [ 6.656696] virtio_blk virtio3: [vdc] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 6.663426] vdc: detected capacity change from 0 to 2621440000 [ 6.684967] virtio_blk virtio4: [vdd] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 6.688659] vdd: detected capacity change from 0 to 2621440000 [ 6.711099] virtio_blk virtio5: [vde] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 6.715554] vde: detected capacity change from 0 to 4294967296 [ 6.740343] virtio_blk virtio6: [vdf] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 6.744652] vdf: detected capacity change from 0 to 4294967296 [ 6.754428] libphy: Fixed MDIO Bus: probed [ 6.763514] usbcore: registered new interface driver usbserial_generic [ 6.767220] usbserial: USB Serial support registered for generic [ 6.770162] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 6.776346] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 6.778548] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 6.781958] mousedev: PS/2 mouse device common for all mice [ 6.786407] rtc_cmos 00:05: RTC can wake from S4 [ 6.785996] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 6.789970] rtc_cmos 00:05: registered as rtc0 [ 6.790147] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 6.790186] intel_pstate: CPU model not supported [ 6.796326] hid: raw HID events driver (C) Jiri Kosina [ 6.802107] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 [ 6.802857] usbcore: registered new interface driver usbhid [ 6.806262] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 [ 6.807462] usbhid: USB HID core driver [ 6.807661] drop_monitor: Initializing network drop monitor service [ 6.813345] Initializing XFRM netlink socket [ 6.814715] NET: Registered protocol family 10 [ 6.816943] Segment Routing with IPv6 [ 6.818036] NET: Registered protocol family 17 [ 6.819531] mpls_gso: MPLS GSO support [ 6.824287] RAS: Correctable Errors collector initialized. [ 6.825744] AVX version of gcm_enc/dec engaged. [ 6.826821] AES CTR mode by8 optimization enabled [ 6.940529] sched_clock: Marking stable (6940491259, 0)->(8693851122, -1753359863) [ 6.948940] registered taskstats version 1 [ 6.952423] Loading compiled-in X.509 certificates [ 6.959544] zswap: loaded using pool lzo/zbud [ 7.020531] Key type big_key registered [ 7.036280] Key type encrypted registered [ 7.037710] ima: No TPM chip found, activating TPM-bypass! [ 7.039346] ima: Allocated hash algorithm: sha1 [ 7.041387] ima: No architecture policies found [ 7.043800] evm: Initialising EVM extended attributes: [ 7.045714] evm: security.selinux [ 7.047328] evm: security.ima [ 7.048596] evm: security.capability [ 7.050178] evm: HMAC attrs: 0x1 [ 7.053799] rtc_cmos 00:05: setting system clock to 2026-09-12 04:02:51 UTC (1789185771) [ 7.062193] debug: unmapping init [mem 0xffffffffb9e03000-0xffffffffb9ffffff] [ 7.067247] debug: unmapping init [mem 0xffffffffb8b82000-0xffffffffb8e58fff] [ 7.084150] Write protecting the kernel read-only data: 28672k [ 7.107834] debug: unmapping init [mem 0xffffffffb7203000-0xffffffffb73fffff] [ 7.113120] debug: unmapping init [mem 0xffffffffb7b14000-0xffffffffb7bfffff] [ 7.197381] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 7.216205] systemd[1]: Detected virtualization kvm. [ 7.220516] systemd[1]: Detected architecture x86-64. [ 7.225388] systemd[1]: Running in initial RAM disk. Welcome to Rocky Linux 8.10 (Green Obsidian) dracut-049-233.git20240115.el8 (Initramfs)! [ 7.284782] systemd[1]: No hostname configured. [ 7.287907] systemd[1]: Set hostname to . [ 7.293617] random: systemd: uninitialized urandom read (16 bytes read) [ 7.301070] systemd[1]: Initializing machine ID from random generator. [ 7.439397] random: ln: uninitialized urandom read (6 bytes read) [ 7.649079] random: systemd: uninitialized urandom read (16 bytes read) [ 7.656570] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 7.689824] systemd[1]: Reached target Swap. [ OK ] Reached target Swap. [ 7.698313] systemd[1]: Reached target Slices. [ OK ] Reached target Slices. [ OK ] Reached target Initrd Root Device. [ OK ] Reached target Timers. [ OK ] Listening on udev Kernel Socket. [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Listening on udev Control Socket. [ OK ] Reached target Local File Systems. [ OK ] Reached target Paths. [ OK ] Listening on Journal Socket. Starting Create Volatile Files and Directories... [ OK ] Started Memstrack Anylazing Service. Starting Journal Service... [ OK ] Reached target Sockets. Starting Setup Virtual Console... Starting Create list of required st…ce nodes for the current kernel... Starting Apply Kernel Variables... [ OK ] Started Create Volatile Files and Directories. [ OK ] Started Setup Virtual Console. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Apply Kernel Variables. Starting Create Static Device Nodes in /dev... Starting dracut cmdline hook... [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started Journal Service. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ 9.228692] device-mapper: uevent: version 1.0.3 [ 9.232513] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting dracut pre-trigger hook... [ OK ] Started dracut pre-trigger hook. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. [ OK ] Reached target System Initialization. [ OK ] Reached target Basic System. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. Starting dracut initqueue hook... [ 11.139179] random: fast init done [ 11.165847] virtio_net virtio0 ens2: renamed from eth0 [ 11.189468] scsi host0: ata_piix [ 11.228320] scsi host1: ata_piix [ 11.230107] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc320 irq 14 [ 11.232707] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc328 irq 15 [ 15.565740] random: crng init done [ 15.569662] random: 7 urandom warning(s) missed due to ratelimiting [ 18.148626] dracut-initqueue[588]: RTNETLINK answers: File exists Starting nbd nbd0... [ OK ] Started nbd nbd0. [ OK ] Started dracut initqueue hook. Mounting /sysroot... [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. [ 19.389930] EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped target Timers. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped dracut initqueue hook. Stopping Hardware RNG Entropy Gatherer Daemon... [ OK ] Stopped Hardware RNG Entropy Gatherer Daemon. [ OK ] Stopped target Basic System. [ OK ] Stopped target Paths. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Swap. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped dracut pre-trigger hook. Stopping udev Kernel Device Manager... [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped target Local Encrypted Volumes. [ OK ] Stopped Dispatch Password Requests to Console Directory Watch. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Slices. [ OK ] Stopped target Sockets. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Closed udev Kernel Socket. [ OK ] Closed udev Control Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Reached target Switch Root. Starting Switch Root... [ 21.660658] printk: systemd: 26 output lines suppressed due to ratelimiting [ 22.354655] SELinux: Disabled at runtime. [ 22.495376] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 22.502692] systemd[1]: Detected virtualization kvm. [ 22.503965] systemd[1]: Detected architecture x86-64. Welcome to Rocky Linux 8.10 (Green Obsidian)! [ 23.628735] systemd[1]: initrd-switch-root.service: Succeeded. [ 23.633749] systemd[1]: Stopped Switch Root. [ OK ] Stopped Switch Root. [ 23.646828] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. [ 23.653903] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 23.657027] systemd[1]: Stopped Journal Service. [ OK ] Stopped Journal Service. [ 23.669898] systemd[1]: Starting Journal Service... Starting Journal Service... [ 23.681125] systemd[1]: Mounting Huge Pages File System... Mounting Huge Pages File System... [ OK ] Started Dispatch Password Requests to Console Directory Watch. Activating swap /dev/disk/by-label/SWAP... Mounting Kernel Debug File System... Starting Apply Kernel Variables... [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Created slice system-sshd\x2dkeygen.slice. [ OK ] Created slice system-getty.slice. [ 23.891152] Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS [ OK ] Listening on Process Core Dump Socket. [ OK ] Listening on udev Control Socket. [ OK ] Listening on udev Kernel Socket. Starting udev Coldplug all Devices... [ OK ] Listening on initctl Compatibility Named Pipe. Starting Remount Root and Kernel File Systems... [ OK ] Created slice User and Session Slice. [ OK ] Reached target Slices. [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd Root File System. [ OK ] Stopped target Initrd File Systems. Mounting POSIX Message Queue File System... [ OK ] Reached target rpc_pipefs.target. Starting Create list of required st…ce nodes for the current kernel... [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Paths. [FAILED] Failed to set up automount Arbitrar…rmats File System Automount Point. See 'systemctl status proc-sys-fs-binfmt_misc.automount' for details. [ OK ] Reached target RPC Port Mapper. [ OK ] Created slice system-serial\x2dgetty.slice. [ OK ] Started Journal Service. [ OK ] Mounted Huge Pages File System. [ OK ] Activated swap /dev/disk/by-label/SWAP. [ OK ] Mounted Kernel Debug File System. [ OK ] Started Apply Kernel Variables. [FAILED] Failed to start Remount Root and Kernel File Systems. See 'systemctl status systemd-remount-fs.service' for details. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Started Create list of required sta…vice nodes for the current kernel. Starting Configure read-only root support... Starting Create Static Device Nodes in /dev... [ OK ] Reached target Swap. Starting Flush Journal to Persistent Storage... [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started udev Coldplug all Devices. [ OK ] Started Create Static Device Nodes in /dev. Starting udev Kernel Device Manager... [ OK ] Reached target Local File Systems (Pre). Mounting /mnt... Mounting /home/green/git/lustre-release... [ OK ] Mounted /mnt. [ 24.791781] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ OK ] Mounted /home/green/git/lustre-release. [ OK ] Started udev Kernel Device Manager. [ 25.629537] input: PC Speaker as /devices/platform/pcspkr/input/input5 [ 25.740076] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 26.310329] RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer [ 26.445530] EDAC sbridge: Ver: 1.1.2 [ 30.013073] Key type dns_resolver registered [* ] A start job is running for Configur…-only root support (6s / no limit)[ 30.459042] NFS: Registering the id_resolver key type [ 30.461297] Key type id_resolver registered [ 30.463085] Key type id_legacy registered [** ] A start job is running for Configur…-only root support (7s / no limit) [ OK ] Started Configure read-only root support. [ OK ] Reached target Local File Systems. Starting Mark the need to relabel after reboot... Starting Create Volatile Files and Directories... Starting Rebuild Dynamic Linker Cache... Starting Load/Save Random Seed... [ OK ] Started Mark the need to relabel after reboot. [ OK ] Started Create Volatile Files and Directories. [ OK ] Started Load/Save Random Seed. Starting RPC Bind... Starting Update UTMP about System Boot/Shutdown... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Started RPC Bind. [ OK ] Started Rebuild Dynamic Linker Cache. Starting Update is Completed... [ OK ] Started Update is Completed. [ OK ] Reached target System Initialization. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Started dnf makecache --timer. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Reached target Timers. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. Starting Restore /run/initramfs on shutdown... [ OK ] Started Hardware RNG Entropy Gatherer Daemon. [ OK ] Started irqbalance daemon. Starting Login Service... [ OK ] Reached target sshd-keygen.target. [ OK ] Started D-Bus System Message Bus. Starting Network Manager... [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Network Manager. Starting Network Manager Wait Online... [ OK ] Reached target Network. Starting Dynamic System Tuning Daemon... Starting OpenSSH server daemon... Starting GSSAPI Proxy Daemon... [ OK ] Started Login Service. Starting Hostname Service... [ OK ] Started OpenSSH server daemon. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Started Permit User Sessions. [ OK ] Started Serial Getty on ttyS0. [ OK ] Started Serial Getty on ttyS1. [ OK ] Started Command Scheduler. [ OK ] Started Getty on tty1. [ OK ] Reached target Login Prompts. [ OK ] Started Hostname Service. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Notify NFS peers of a restart... Starting Crash recovery kernel arming... Starting System Logging Service... [ OK ] Started Notify NFS peers of a restart. [ OK ] Started System Logging Service. Rocky Linux 8.10 (Green Obsidian) Kernel 4.18.0rh8.10-debug on an x86_64 oleg158-server login: [ 87.844765] libcfs: loading out-of-tree module taints kernel. [ 87.870797] Key type ._llcrypt registered [ 87.872834] Key type .llcrypt registered [ 87.951139] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_hostid [ 109.231496] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 111.573434] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 111.595939] alg: No test for adler32 (adler32-zlib) [ 113.125785] Lustre: Lustre: Build Version: 2.17.58_40_g357d090 [ 113.720184] LNet: Added LNI 192.168.201.158@tcp [8/256/0/180] [ 115.455337] Key type lgssc registered [ 117.441371] Lustre: Echo OBD driver; http://www.lustre.org/ [ 132.612410] ZFS: Loaded module v2.3.2-1, ZFS pool version 5000, ZFS filesystem version 5 [ 146.894303] hrtimer: interrupt took 3182770 ns [ 172.355909] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 185.222518] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 185.280646] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 186.614300] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 186.671704] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 186.787298] Lustre: lustre-MDT0000: new disk, initializing [ 186.867048] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 186.882934] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 191.559396] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 205.862151] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 205.926937] Lustre: 6508:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 205.950883] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 205.955238] Lustre: Skipped 1 previous similar message [ 206.034464] Lustre: lustre-MDT0001: new disk, initializing [ 206.093310] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 206.126170] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 206.138175] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 210.536551] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 215.712786] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 227.126836] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 227.442726] Lustre: lustre-OST0000: new disk, initializing [ 227.454787] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 227.470883] Lustre: 8445:0:(osd_compat.c:1354:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 227.564922] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 234.014280] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 234.024209] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 234.110665] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 235.262188] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 250.385745] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 250.586611] Lustre: lustre-OST0001: new disk, initializing [ 250.590603] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 250.598782] Lustre: 9519:0:(osd_compat.c:1354:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 250.683516] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 256.325407] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 259.660790] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 259.670675] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 259.736957] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 269.572638] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 274.812791] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 281.240642] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing check_logdir /tmp/testlogs/ [ 286.301482] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing yml_node [ 291.140607] Lustre: DEBUG MARKER: Client: 2.17.58.40 [ 293.718485] Lustre: DEBUG MARKER: MDS: 2.17.58.40 [ 296.385339] Lustre: DEBUG MARKER: OSS: 2.17.58.40 [ 297.946422] Lustre: DEBUG MARKER: -----============= acceptance-small: conf-sanity ============----- Sat Sep 12 00:07:41 EDT 2026 [ 315.640662] Lustre: DEBUG MARKER: excepting tests: 102 106 115 32newtarball [ 316.996235] Lustre: DEBUG MARKER: skipping tests SLOW=no: 45 69 106 111 114 [ 334.307868] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 334.334404] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 334.352722] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 336.354852] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 336.356068] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 336.377888] Lustre: Skipped 3 previous similar messages [ 338.621789] Lustre: server umount lustre-MDT0000 complete [ 342.647245] LustreError: 6499:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789186107 with bad export cookie 8926748839414526520 [ 342.655281] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 342.670336] LustreError: 6499:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 346.592203] LustreError: 6514:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 346.598729] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 346.604456] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 346.616646] LustreError: 6514:0:(ldlm_lib.c:1199:target_handle_connect()) Skipped 6 previous similar messages [ 346.648550] Lustre: Skipped 3 previous similar messages [ 347.616135] LustreError: 6514:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 347.632761] LustreError: 6514:0:(ldlm_lib.c:1199:target_handle_connect()) Skipped 1 previous similar message [ 349.238321] Lustre: server umount lustre-MDT0001 complete [ 353.592977] Lustre: server umount lustre-OST0000 complete [ 357.953255] Lustre: server umount lustre-OST0001 complete [ 365.735838] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_hostid [ 374.611773] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 408.199657] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 408.356277] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 408.376384] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 408.435454] Lustre: lustre-MDT0000: new disk, initializing [ 408.509181] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 408.529372] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 412.830646] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 423.619726] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 423.818249] Lustre: 15072:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 423.937425] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 423.945936] Lustre: Skipped 1 previous similar message [ 424.075325] Lustre: lustre-MDT0001: new disk, initializing [ 424.176852] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 424.228358] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 424.242390] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 428.667763] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 436.765737] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 442.026509] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 448.394535] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 448.681305] Lustre: lustre-OST0000: new disk, initializing [ 448.685577] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 448.696449] Lustre: 17038:0:(osd_compat.c:1354:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 448.791621] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 450.126591] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 450.146613] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 450.254258] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 455.006838] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 464.383242] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 469.466982] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 469.701930] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 474.874139] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 475.166914] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 481.249268] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 481.250887] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 481.263656] LustreError: Skipped 1 previous similar message [ 481.293221] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 481.306806] Lustre: Skipped 4 previous similar messages [ 483.231921] Lustre: server umount lustre-OST0000 complete [ 490.976741] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 490.983253] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 491.003678] Lustre: Skipped 1 previous similar message [ 491.011249] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 493.759313] Lustre: server umount lustre-MDT0000 complete [ 496.611365] LustreError: 15081:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 496.627061] LustreError: 15081:0:(ldlm_lib.c:1199:target_handle_connect()) Skipped 1 previous similar message [ 497.645554] LustreError: 17037:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789186262 with bad export cookie 8926748839414528046 [ 497.657611] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 498.050937] Lustre: server umount lustre-MDT0001 complete [ 502.749412] Lustre: DEBUG MARKER: == conf-sanity test 76a: set permanent params with lctl across mounts ========================================================== 00:11:06 (1789186266) [ 509.021932] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 509.387540] LustreError: 19303:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 509.474303] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 514.533361] LustreError: 19304:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 515.132894] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 523.746680] LustreError: 19304:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 523.775552] LustreError: 19304:0:(ldlm_lib.c:1199:target_handle_connect()) Skipped 1 previous similar message [ 525.957506] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 532.233192] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 540.229333] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 546.818440] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 554.365711] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 554.474247] LustreError: 21123:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 560.565086] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 568.661806] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 575.341564] Lustre: Modifying parameter general.osc.*.max_dirty_mb=452 in log params [ 583.139107] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 583.163744] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 583.192619] Lustre: Skipped 1 previous similar message [ 583.210779] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 583.228469] Lustre: Skipped 2 previous similar messages [ 589.231390] Lustre: server umount lustre-MDT0000 complete [ 591.855657] LustreError: 21440:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 591.877580] LustreError: 21440:0:(ldlm_lib.c:1199:target_handle_connect()) Skipped 2 previous similar messages [ 593.482708] LustreError: 19285:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789186357 with bad export cookie 8926748839414528935 [ 593.484142] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 593.507623] LustreError: 19285:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 593.942382] Lustre: server umount lustre-MDT0001 complete [ 608.315950] Lustre: server umount lustre-OST0000 complete [ 629.311924] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 639.604617] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 639.999446] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 640.009369] Lustre: Skipped 2 previous similar messages [ 645.134312] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 653.431225] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 658.515501] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 661.326905] Lustre: Setting parameter general.debug_raw_pointers=Y in log params [ 668.131590] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 675.085969] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 684.740756] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 684.964084] Lustre: lustre-OST0001: new disk, initializing [ 684.970648] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 684.984663] Lustre: 26001:0:(osd_compat.c:1354:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 686.412608] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 686.422742] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 686.504454] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 691.350838] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 700.239983] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 703.589503] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 715.236485] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 715.241340] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 715.261748] Lustre: Skipped 2 previous similar messages [ 715.269635] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 715.273216] Lustre: Skipped 3 previous similar messages [ 719.959476] Lustre: server umount lustre-MDT0000 complete [ 722.402903] LustreError: 23684:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 722.420877] LustreError: 23684:0:(ldlm_lib.c:1199:target_handle_connect()) Skipped 5 previous similar messages [ 723.611969] LustreError: 23666:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789186488 with bad export cookie 8926748839414529782 [ 723.619317] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 723.627112] LustreError: 23666:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 723.915077] Lustre: server umount lustre-MDT0001 complete [ 738.317199] Lustre: server umount lustre-OST0000 complete [ 752.495435] Lustre: server umount lustre-OST0001 complete [ 766.919845] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 775.112954] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 775.510554] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 775.520333] Lustre: Skipped 3 previous similar messages [ 779.021470] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 786.705447] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 791.640817] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 794.869272] Lustre: 30169:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 801.564422] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 807.536409] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 814.663994] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 820.102732] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 825.054548] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 828.046313] Lustre: 32049:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 833.509423] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 833.521490] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 833.532690] Lustre: Skipped 3 previous similar messages [ 833.538190] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 833.543082] Lustre: Skipped 4 previous similar messages [ 838.936425] Lustre: server umount lustre-MDT0000 complete [ 841.698415] LustreError: 29003:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789186606 with bad export cookie 8926748839414531077 [ 841.706726] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 841.708240] LustreError: 29003:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 841.929317] Lustre: server umount lustre-MDT0001 complete [ 855.140670] Lustre: server umount lustre-OST0000 complete [ 868.627783] Lustre: server umount lustre-OST0001 complete [ 876.186106] Lustre: DEBUG MARKER: == conf-sanity test 76b: verify params log setup correctly ========================================================== 00:17:19 (1789186639) [ 899.487664] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 908.115131] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 908.404609] LustreError: 34852:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 908.423066] LustreError: 34852:0:(ldlm_lib.c:1199:target_handle_connect()) Skipped 8 previous similar messages [ 912.670631] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 919.650552] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 923.202859] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 925.497825] Lustre: 35999:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 930.669162] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 936.476480] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 943.568743] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 949.221334] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 956.353867] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 960.079880] Lustre: 37881:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 965.611518] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 965.624417] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 965.629519] Lustre: Skipped 6 previous similar messages [ 965.636115] Lustre: Skipped 7 previous similar messages [ 971.106272] Lustre: server umount lustre-MDT0000 complete [ 974.331777] LustreError: 34832:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789186738 with bad export cookie 8926748839414532183 [ 974.334263] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 974.338858] LustreError: 34832:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 974.753402] Lustre: server umount lustre-MDT0001 complete [ 988.635384] Lustre: server umount lustre-OST0000 complete [ 1001.050049] Lustre: server umount lustre-OST0001 complete [ 1008.234889] Lustre: DEBUG MARKER: == conf-sanity test 76c: verify changelog_mask is applied with lctl set_param -P ========================================================== 00:19:31 (1789186771) [ 1020.704287] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 1029.729136] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1034.122125] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 1041.103819] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1041.485058] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1041.492183] Lustre: Skipped 8 previous similar messages [ 1045.410567] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 1047.644214] Lustre: 41175:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 1052.749760] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1057.599285] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 1064.404949] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1069.431791] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 1075.798572] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1078.956636] Lustre: Setting parameter general.mdd.*.changelog_mask=-CLOSE in log params [ 1078.963647] Lustre: Skipped 1 previous similar message [ 1082.336394] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1087.703210] Lustre: server umount lustre-MDT0000 complete [ 1090.404211] LustreError: 40005:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789186854 with bad export cookie 8926748839414533289 [ 1090.414188] LustreError: 40005:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 1090.419594] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1095.597679] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 1095.605628] Lustre: Skipped 15 previous similar messages [ 1096.764968] Lustre: server umount lustre-MDT0001 complete [ 1102.189343] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1115.104799] LustreError: 3640:0:(client.c:1404:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff9752503d1f80 x1876097371590272/t0(0) o250->MGC192.168.201.158@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 1118.780233] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 1124.645951] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 1125.442968] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1128.953294] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 1130.983125] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 1130.986827] Lustre: Skipped 1 previous similar message [ 1134.043642] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1135.217853] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 1139.721412] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 1140.752631] Lustre: DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec [ 1146.340957] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1146.357968] Lustre: Skipped 8 previous similar messages [ 1146.362242] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1150.563267] Lustre: server umount lustre-MDT0000 complete [ 1153.643699] LustreError: 40004:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789186918 with bad export cookie 8926748839414534416 [ 1153.646253] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1153.650285] LustreError: 40004:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 1153.897272] Lustre: server umount lustre-MDT0001 complete [ 1167.469751] Lustre: server umount lustre-OST0000 complete [ 1180.384980] Lustre: server umount lustre-OST0001 complete [ 1186.566264] Lustre: DEBUG MARKER: == conf-sanity test 76d: verify llite.*.xattr_cache can be set by 'lctl set_param -P' correctly ========================================================== 00:22:30 (1789186950) [ 1196.647293] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 1204.048432] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1204.383604] LustreError: 47656:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1204.402916] LustreError: 47656:0:(ldlm_lib.c:1199:target_handle_connect()) Skipped 27 previous similar messages [ 1208.430344] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 1215.211077] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1218.676992] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 1220.614988] Lustre: 48805:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 1220.619781] Lustre: 48805:0:(mgs_llog.c:1450:mgs_modify_param()) Skipped 1 previous similar message [ 1224.908799] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1229.858489] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 1236.726504] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1241.877734] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 1247.563352] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1251.290108] Lustre: Setting parameter general.llite.*.xattr_cache=0 in log params [ 1265.769666] Lustre: server umount lustre-MDT0000 complete [ 1268.517381] LustreError: 49188:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789187032 with bad export cookie 8926748839414535214 [ 1268.534060] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1268.816089] Lustre: server umount lustre-MDT0001 complete [ 1282.072118] Lustre: server umount lustre-OST0000 complete [ 1295.517972] Lustre: server umount lustre-OST0001 complete [ 1303.755985] Lustre: DEBUG MARKER: == conf-sanity test 77: comma-separated MGS NIDs and failover node NIDs ========================================================== 00:24:27 (1789187067) [ 1306.171330] Lustre: DEBUG MARKER: SKIP: conf-sanity test_77 mixed loopback and real device not working [ 1307.447700] Lustre: DEBUG MARKER: == conf-sanity test 78: run resize2fs on MDT and OST filesystems ========================================================== 00:24:30 (1789187070) [ 1316.593731] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_hostid [ 1323.723743] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 1341.802225] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1341.966217] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1342.019876] Lustre: lustre-MDT0000: new disk, initializing [ 1342.075247] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1345.401121] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 1353.262546] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1358.206301] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1358.415754] Lustre: 54876:0:(osd_compat.c:1354:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1360.240532] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 1360.272049] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 1362.895962] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 1370.486501] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1372.386239] Lustre: DEBUG MARKER: create test files [ 1395.257648] Lustre: server umount lustre-OST0000 complete [ 1407.066852] Lustre: server umount lustre-MDT0000 complete [ 1416.107500] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing unload_modules_local [ 1418.205295] Key type lgssc unregistered [ 1418.398592] LNet: 56504:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1418.405421] LNetError: 56504:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1419.430910] LNet: Removed LNI 192.168.201.158@tcp [ 1420.142486] Key type .llcrypt unregistered [ 1420.144373] Key type ._llcrypt unregistered [ 1439.686416] Key type ._llcrypt registered [ 1439.688120] Key type .llcrypt registered [ 1439.754480] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 1440.503281] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1440.530772] alg: No test for adler32 (adler32-zlib) [ 1441.491813] Lustre: Lustre: Build Version: 2.17.58_40_g357d090 [ 1441.681918] LNet: Added LNI 192.168.201.158@tcp [8/256/0/180] [ 1443.295220] Key type lgssc registered [ 1444.145890] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1449.255856] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1449.271953] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1450.572823] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1453.686833] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 1458.595918] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1463.245586] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1463.514765] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1467.425835] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 1472.209611] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1474.739402] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:102 to 0x240000400:129) [ 1474.800060] Lustre: 59209:0:(osd_internal.h:1462:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 509 < left 544, rollback = 9 [ 1474.804502] Lustre: 59209:0:(osd_handler.c:2092:osd_trans_dump_creds()) create: 32/128/6, destroy: 0/0/0 [ 1474.810062] Lustre: 59209:0:(osd_handler.c:2099:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 1474.814388] Lustre: 59209:0:(osd_handler.c:2109:osd_trans_dump_creds()) write: 2/18/1, punch: 0/0/0, quota 1/3/0 [ 1474.819693] Lustre: 59209:0:(osd_handler.c:2116:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 1474.824936] Lustre: 59209:0:(osd_handler.c:2123:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 1482.471652] Lustre: DEBUG MARKER: check files after expanding the MDT and OST filesystems [ 1486.187643] Lustre: DEBUG MARKER: create more files after expanding the MDT and OST filesystems [ 1495.527538] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1495.528986] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1495.552346] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1496.778455] Lustre: server umount lustre-OST0000 complete [ 1499.578463] Lustre: server umount lustre-MDT0000 complete [ 1507.172763] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing unload_modules_local [ 1509.453468] Key type lgssc unregistered [ 1509.715377] LNet: 60813:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1509.733142] LNetError: 60813:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1509.756918] LNet: Removed LNI 192.168.201.158@tcp [ 1510.450465] Key type .llcrypt unregistered [ 1510.452491] Key type ._llcrypt unregistered [ 1532.470221] Key type ._llcrypt registered [ 1532.471720] Key type .llcrypt registered [ 1532.557668] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 1533.515607] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1533.564477] alg: No test for adler32 (adler32-zlib) [ 1534.585059] Lustre: Lustre: Build Version: 2.17.58_40_g357d090 [ 1534.744292] LNet: Added LNI 192.168.201.158@tcp [8/256/0/180] [ 1536.399211] Key type lgssc registered [ 1537.227788] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1542.985425] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1543.004414] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1544.286035] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1547.512991] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 1553.270355] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1557.995226] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1558.274359] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1563.317370] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 1568.280532] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1569.509505] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:140 to 0x240000400:161) [ 1569.566369] Lustre: 63621:0:(osd_internal.h:1462:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 509 < left 544, rollback = 9 [ 1569.570745] Lustre: 63621:0:(osd_handler.c:2092:osd_trans_dump_creds()) create: 32/128/6, destroy: 0/0/0 [ 1569.575588] Lustre: 63621:0:(osd_handler.c:2099:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 1569.579865] Lustre: 63621:0:(osd_handler.c:2109:osd_trans_dump_creds()) write: 2/18/1, punch: 0/0/0, quota 1/3/0 [ 1569.586952] Lustre: 63621:0:(osd_handler.c:2116:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 1569.591973] Lustre: 63621:0:(osd_handler.c:2123:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 1577.463360] Lustre: DEBUG MARKER: check files after shrinking the MDT and OST filesystems [ 1585.120707] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1585.125980] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1585.132020] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1588.275467] Lustre: server umount lustre-OST0000 complete [ 1590.991721] Lustre: server umount lustre-MDT0000 complete [ 1598.412770] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing unload_modules_local [ 1600.300660] Key type lgssc unregistered [ 1600.523628] LNet: 65179:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1600.532868] LNetError: 65179:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1600.559505] LNet: Removed LNI 192.168.201.158@tcp [ 1601.194282] Key type .llcrypt unregistered [ 1601.196338] Key type ._llcrypt unregistered [ 1613.522466] Key type ._llcrypt registered [ 1613.524451] Key type .llcrypt registered [ 1613.599837] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_hostid [ 1623.772338] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 1624.431632] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1624.439520] alg: No test for adler32 (adler32-zlib) [ 1625.475397] Lustre: Lustre: Build Version: 2.17.58_40_g357d090 [ 1625.676233] LNet: Added LNI 192.168.201.158@tcp [8/256/0/180] [ 1627.345543] Key type lgssc registered [ 1628.316355] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1654.434874] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1654.454210] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1655.702385] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1655.760500] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1655.839663] Lustre: lustre-MDT0000: new disk, initializing [ 1655.920906] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1655.934380] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1659.483636] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 1667.027691] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1667.124348] Lustre: 68304:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1667.161725] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 1667.163979] Lustre: Skipped 1 previous similar message [ 1667.226598] Lustre: lustre-MDT0001: new disk, initializing [ 1667.300367] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1667.329283] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 1667.340696] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1669.454101] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 1676.279988] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1680.290273] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 1685.638592] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1685.846285] Lustre: lustre-OST0000: new disk, initializing [ 1685.848684] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1685.853496] Lustre: 70273:0:(osd_compat.c:1354:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1685.916576] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1690.406225] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 1691.695349] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 1691.701678] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1691.799119] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1696.795383] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1699.717991] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1699.865851] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1702.958792] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1703.165724] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1707.492956] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1707.496576] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1707.503337] LustreError: Skipped 1 previous similar message [ 1707.512630] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1707.522256] Lustre: Skipped 1 previous similar message [ 1710.604069] Lustre: server umount lustre-OST0000 complete [ 1713.635556] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1713.639613] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1713.643966] Lustre: Skipped 1 previous similar message [ 1713.653158] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1717.735492] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1717.736148] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1719.426475] Lustre: server umount lustre-MDT0000 complete [ 1721.911927] LustreError: 68298:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789187486 with bad export cookie 10986537922866872181 [ 1721.913515] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1721.919819] LustreError: 68298:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 1722.135323] Lustre: server umount lustre-MDT0001 complete [ 1726.915684] Lustre: DEBUG MARKER: == conf-sanity test 79: format MDT/OST without mgs option (should return errors) ========================================================== 00:31:30 (1789187490) [ 1732.765985] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 1756.780621] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_hostid [ 1763.554876] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 1786.034085] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1786.217247] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1786.237490] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1786.288684] Lustre: lustre-MDT0000: new disk, initializing [ 1786.340430] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1786.363713] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1789.020805] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 1796.169712] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1796.259605] Lustre: 76282:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1796.298408] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 1796.304190] Lustre: Skipped 1 previous similar message [ 1796.356949] Lustre: lustre-MDT0001: new disk, initializing [ 1796.417043] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1796.467838] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 1796.479940] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1799.224275] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 1805.752786] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1809.438789] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 1813.550583] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1813.744082] Lustre: lustre-OST0000: new disk, initializing [ 1813.747973] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1813.752750] Lustre: 78250:0:(osd_compat.c:1354:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1813.823107] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1817.334518] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 1821.724038] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 1821.739899] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1821.818651] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1823.209981] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1825.839151] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1825.959663] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1828.965098] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1829.095398] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1831.907043] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1831.907089] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1831.909146] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1831.909152] Lustre: Skipped 1 previous similar message [ 1831.917295] Lustre: Skipped 1 previous similar message [ 1836.497253] Lustre: server umount lustre-OST0000 complete [ 1842.148133] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1842.153516] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1842.173159] Lustre: Skipped 1 previous similar message [ 1842.184513] Lustre: Skipped 2 previous similar messages [ 1845.564531] Lustre: server umount lustre-MDT0000 complete [ 1848.250238] LustreError: 76276:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789187612 with bad export cookie 10986537922866873063 [ 1848.254580] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1848.255261] LustreError: 76276:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 1848.465164] Lustre: server umount lustre-MDT0001 complete [ 1854.373137] Lustre: DEBUG MARKER: == conf-sanity test 80: mgc import reconnect race ======== 00:33:37 (1789187617) [ 1858.743835] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1859.005718] LustreError: 80658:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1859.018982] LustreError: 80658:0:(ldlm_lib.c:1199:target_handle_connect()) Skipped 3 previous similar messages [ 1859.055988] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1861.573268] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 1864.159933] LustreError: 80659:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1867.312939] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1870.430270] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 1875.129124] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1878.993525] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 1883.076428] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1886.606988] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 1890.856842] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1893.137120] Lustre: 83328:0:(genops.c:1773:obd_export_evict_by_uuid()) MGS: evicting f7c0dbd0-ae9a-473e-badf-27df35c663ef at adminstrative request [ 1897.956787] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1897.967266] Lustre: *** cfs_fail_loc=906, val=2147483648*** [ 1908.194454] Lustre: MGS: Client f7c0dbd0-ae9a-473e-badf-27df35c663ef (at 0@lo) reconnecting [ 1908.211121] Lustre: Evicted from MGS (at 0@lo) after server handle changed from 0x987806081bd68659 to 0x987806081bd688f9 [ 1908.219422] Lustre: MGC192.168.201.158@tcp: Connection restored to 0@lo (at 0@lo) [ 1927.275200] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1927.383650] Lustre: lustre-OST0001: new disk, initializing [ 1927.387361] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 1927.390684] Lustre: 83723:0:(osd_compat.c:1354:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1927.442832] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 1927.446373] Lustre: Skipped 2 previous similar messages [ 1930.977278] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 1936.976814] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 1936.984533] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 1937.088768] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 1937.451811] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1942.509961] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1942.513773] LustreError: lustre-OST0001-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1942.517161] Lustre: Skipped 1 previous similar message [ 1942.517335] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 1942.536571] LustreError: Skipped 1 previous similar message [ 1945.319530] Lustre: server umount lustre-OST0001 complete [ 1947.626617] LustreError: 82481:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1947.638486] LustreError: 82481:0:(ldlm_lib.c:1199:target_handle_connect()) Skipped 1 previous similar message [ 1949.153651] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1952.745772] LustreError: 82478:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1952.765925] LustreError: 82478:0:(ldlm_lib.c:1199:target_handle_connect()) Skipped 1 previous similar message [ 1953.898973] Lustre: server umount lustre-OST0000 complete [ 1962.727570] Lustre: server umount lustre-MDT0000 complete [ 1962.979142] LustreError: 80659:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1962.989184] LustreError: 80659:0:(ldlm_lib.c:1199:target_handle_connect()) Skipped 1 previous similar message [ 1964.800279] LustreError: 83722:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789187729 with bad export cookie 10986537922866874617 [ 1964.805193] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1964.805687] LustreError: 83722:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 1964.992480] Lustre: server umount lustre-MDT0001 complete [ 1970.002111] Lustre: DEBUG MARKER: == conf-sanity test 81: sparse OST indexing ============== 00:35:33 (1789187733) [ 1971.154972] Lustre: DEBUG MARKER: SKIP: conf-sanity test_81 needs >= 3 OSTs [ 1972.327711] Lustre: DEBUG MARKER: == conf-sanity test 82a: specify OSTs for file (succeed) or directory (succeed) ========================================================== 00:35:36 (1789187736) [ 1973.233876] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82a needs >= 3 OSTs [ 1974.350159] Lustre: DEBUG MARKER: == conf-sanity test 82b: specify OSTs for file with --pool and --ost-list options ========================================================== 00:35:38 (1789187738) [ 1975.326774] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82b needs >= 4 OSTs [ 1976.354242] Lustre: DEBUG MARKER: == conf-sanity test 82c: specify sparse OSTs for setstripe (should not crash) ========================================================== 00:35:40 (1789187740) [ 1977.248457] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82c needs >= 4 OSTs [ 1978.433338] Lustre: DEBUG MARKER: == conf-sanity test 83: ENOSPACE on OST doesn't cause message VFS: Busy inodes after unmount ... ========================================================== 00:35:42 (1789187742) [ 1979.463649] Lustre: DEBUG MARKER: mount the OST /dev/mapper/ost1_flakey as a ldiskfs filesystem [ 1983.018866] loop: module loaded [ 1983.024470] loop0: detected capacity change from 0 to 4294967296 [ 1983.049238] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 1984.010889] Lustre: DEBUG MARKER: run llverfs in partial mode on the OST ldiskfs /mnt/lustre-ost1 [ 1986.344292] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing run_llverfs /mnt/lustre-ost1 -vpl no [ 1989.049316] Lustre: DEBUG MARKER: unmount the OST /dev/mapper/ost1_flakey [ 2006.396719] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2006.432820] LustreError: 87840:0:(obd_config.c:845:class_setup()) setup lustre-OST0000-osd failed (-28) [ 2006.435518] LustreError: 87840:0:(obd_mount.c:259:lustre_start_simple()) lustre-OST0000-osd setup error -28 [ 2006.438250] LustreError: 87840:0:(tgt_mount.c:2581:server_fill_super()) Unable to start osd on /dev/mapper/ost1_flakey: -28 [ 2006.440984] LustreError: 87840:0:(super25.c:179:lustre_fill_super()) llite: Unable to mount : rc = -28 [ 2018.151224] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_hostid [ 2025.168804] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 2046.655654] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2046.798318] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2046.822234] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2046.880830] Lustre: lustre-MDT0000: new disk, initializing [ 2046.944564] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2046.959823] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2049.867726] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 2056.281822] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2056.338388] Lustre: 90699:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2056.495595] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2058.729427] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 2064.315096] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2067.136312] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2070.270666] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2070.379851] Lustre: 92669:0:(osd_compat.c:1354:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2072.959644] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 2078.269331] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2078.725596] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2078.779625] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2080.446177] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2080.592324] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2082.954168] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2083.071666] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2088.931296] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2088.933645] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2088.939855] Lustre: Skipped 4 previous similar messages [ 2088.940994] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2088.942748] LustreError: Skipped 2 previous similar messages [ 2088.943935] Lustre: Skipped 7 previous similar messages [ 2090.166404] Lustre: server umount lustre-OST0000 complete [ 2106.335240] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2106.418344] Lustre: server umount lustre-MDT0000 complete [ 2108.152079] LustreError: 90693:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789187872 with bad export cookie 10986537922866875233 [ 2108.154099] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2108.160337] LustreError: 90693:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 2108.322726] Lustre: server umount lustre-MDT0001 complete [ 2112.286146] Lustre: DEBUG MARKER: == conf-sanity test 84: check recovery_hard_time ========= 00:37:56 (1789187876) [ 2115.415578] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2115.612359] LustreError: 95078:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2117.548033] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 2121.972303] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2124.023951] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 2127.544415] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2130.117884] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2133.166689] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2135.730496] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 2139.316692] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2141.066587] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2142.199598] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 1 sec [ 2144.393619] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2147.601160] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 3 sec [ 2150.926577] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2151.012830] Lustre: lustre-OST0001: new disk, initializing [ 2151.013970] Lustre: Skipped 2 previous similar messages [ 2151.015620] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 2151.017718] Lustre: Skipped 3 previous similar messages [ 2151.019690] Lustre: 98471:0:(osd_compat.c:1354:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2153.952235] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 2159.305161] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2160.658252] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 2160.662888] Lustre: Skipped 2 previous similar messages [ 2160.665854] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 2160.722644] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 2161.153177] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid 50 [ 2161.253830] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2162.962108] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [ 2163.052499] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2174.530908] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 2186.285818] Lustre: Failing over lustre-MDT0000 [ 2186.605379] Lustre: server umount lustre-MDT0000 complete [ 2188.771524] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2188.773912] LustreError: Skipped 1 previous similar message [ 2188.775729] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2188.779949] Lustre: Skipped 3 previous similar messages [ 2188.782675] LustreError: 95078:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2188.788971] LustreError: 95078:0:(ldlm_lib.c:1199:target_handle_connect()) Skipped 1 previous similar message [ 2203.315400] LDISKFS-fs (dm-0): 4 truncates cleaned up [ 2203.320225] LDISKFS-fs (dm-0): recovery complete [ 2203.328028] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2203.416074] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2203.557516] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-60 [ 2203.561023] Lustre: Skipped 6 previous similar messages [ 2203.586412] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 2205.470474] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 2205.662619] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 2205.662639] Lustre: 100664:0:(ldlm_lib.c:2119:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 2208.739344] Lustre: 95078:0:(ldlm_lib.c:2119:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 2208.743825] Lustre: 95078:0:(ldlm_lib.c:2119:extend_recovery_timer()) Skipped 1 previous similar message [ 2208.752740] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 2208.780645] LustreError: 101295:0:(ldlm_lib.c:2732:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2209.095387] LustreError: 101295:0:(ldlm_lib.c:2732:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2209.419393] LustreError: 101295:0:(ldlm_lib.c:2732:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2209.428454] LustreError: 101295:0:(ldlm_lib.c:2732:replay_request_or_update()) Skipped 1 previous similar message [ 2209.743134] LustreError: 101295:0:(ldlm_lib.c:2732:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2209.747029] LustreError: 101295:0:(ldlm_lib.c:2732:replay_request_or_update()) Skipped 1 previous similar message [ 2209.751585] Lustre: 101295:0:(ldlm_lib.c:2119:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2209.756849] Lustre: 101295:0:(ldlm_lib.c:2119:extend_recovery_timer()) Skipped 7 previous similar messages [ 2210.705544] LustreError: 101295:0:(ldlm_lib.c:2732:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2210.709668] LustreError: 101295:0:(ldlm_lib.c:2732:replay_request_or_update()) Skipped 3 previous similar messages [ 2211.023165] LustreError: 101295:0:(ldlm_lib.c:2732:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2211.027245] LustreError: 101295:0:(ldlm_lib.c:2732:replay_request_or_update()) Skipped 3 previous similar messages [ 2211.969332] Lustre: 101295:0:(ldlm_lib.c:2119:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2211.974043] Lustre: 101295:0:(ldlm_lib.c:2119:extend_recovery_timer()) Skipped 6 previous similar messages [ 2212.920714] LustreError: 101295:0:(ldlm_lib.c:2732:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2212.926157] LustreError: 101295:0:(ldlm_lib.c:2732:replay_request_or_update()) Skipped 6 previous similar messages [ 2213.248152] LustreError: 101295:0:(ldlm_lib.c:2732:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2213.256514] LustreError: 101295:0:(ldlm_lib.c:2732:replay_request_or_update()) Skipped 6 previous similar messages [ 2216.079980] Lustre: 101295:0:(ldlm_lib.c:2119:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2216.086230] Lustre: 101295:0:(ldlm_lib.c:2119:extend_recovery_timer()) Skipped 12 previous similar messages [ 2217.033328] LustreError: 101295:0:(ldlm_lib.c:2732:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2217.039425] LustreError: 101295:0:(ldlm_lib.c:2732:replay_request_or_update()) Skipped 12 previous similar messages [ 2217.359138] LustreError: 101295:0:(ldlm_lib.c:2732:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2217.361915] LustreError: 101295:0:(ldlm_lib.c:2732:replay_request_or_update()) Skipped 12 previous similar messages [ 2224.255983] Lustre: 101295:0:(ldlm_lib.c:2119:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2224.259796] Lustre: 101295:0:(ldlm_lib.c:2119:extend_recovery_timer()) Skipped 25 previous similar messages [ 2225.201579] LustreError: 101295:0:(ldlm_lib.c:2732:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2225.205627] LustreError: 101295:0:(ldlm_lib.c:2732:replay_request_or_update()) Skipped 25 previous similar messages [ 2225.519167] LustreError: 101295:0:(ldlm_lib.c:2732:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2225.524549] LustreError: 101295:0:(ldlm_lib.c:2732:replay_request_or_update()) Skipped 25 previous similar messages [ 2240.273706] Lustre: 101295:0:(ldlm_lib.c:2119:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2240.285523] Lustre: 101295:0:(ldlm_lib.c:2119:extend_recovery_timer()) Skipped 50 previous similar messages [ 2241.225655] LustreError: 101295:0:(ldlm_lib.c:2732:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2241.232254] LustreError: 101295:0:(ldlm_lib.c:2732:replay_request_or_update()) Skipped 50 previous similar messages [ 2241.551089] LustreError: 101295:0:(ldlm_lib.c:2732:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2241.555091] LustreError: 101295:0:(ldlm_lib.c:2732:replay_request_or_update()) Skipped 50 previous similar messages [ 2265.015093] Lustre: 101295:0:(ldlm_lib.c:2428:target_recovery_overseer()) lustre-MDT0000 recovery is aborted by hard timeout [ 2265.021713] Lustre: 101295:0:(ldlm_lib.c:2438:target_recovery_overseer()) recovery is aborted, evict exports in recovery [ 2265.026114] Lustre: 101295:0:(genops.c:1600:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client 6899fe7a-a17f-4c46-9ca6-423561c1a275@192.168.201.58@tcp [ 2265.029799] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 2265.032652] Lustre: 101295:0:(ldlm_lib.c:1948:abort_req_replay_queue()) @@@ aborted: req@00000000c0b8339b x1876098946239744/t0(8589934776) o35->6899fe7a-a17f-4c46-9ca6-423561c1a275@192.168.201.58@tcp:365/0 lens 392/0 e 0 to 0 dl 1789188040 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:0 [ 2265.048594] Lustre: lustre-MDT0000-osd: cancel update llog [0x200000400:0x1:0x0] [ 2265.051690] Lustre: lustre-MDT0000: Denying connection for new client 6899fe7a-a17f-4c46-9ca6-423561c1a275 (at 192.168.201.58@tcp), waiting for 3 known clients (2 recovered, 0 in progress, and 1 evicted) to recover in 0:00 [ 2265.057704] Lustre: lustre-MDT0001-osp-MDT0000: cancel update llog [0x240000401:0x1:0x0] [ 2265.088730] Lustre: lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 2265.093628] Lustre: Skipped 2 previous similar messages [ 2265.096229] Lustre: lustre-MDT0000: Recovery over after 1:00, of 3 clients 2 recovered and 1 was evicted. [ 2265.118184] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:79 to 0x280000401:577) [ 2265.118930] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:47 to 0x2c0000401:545) [ 2274.784278] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2274.787947] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2274.792906] Lustre: Skipped 3 previous similar messages [ 2274.796116] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2274.798101] Lustre: Skipped 7 previous similar messages [ 2279.432536] Lustre: server umount lustre-OST0000 complete [ 2280.418473] LustreError: 96898:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2280.424095] LustreError: 96898:0:(ldlm_lib.c:1199:target_handle_connect()) Skipped 19 previous similar messages [ 2295.263121] Lustre: lustre-OST0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2295.333654] Lustre: server umount lustre-OST0001 complete [ 2303.262616] Lustre: server umount lustre-MDT0000 complete [ 2305.176444] LustreError: 96919:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789188069 with bad export cookie 10986537922866926431 [ 2305.180260] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2305.182234] LustreError: 96919:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 2305.352693] Lustre: server umount lustre-MDT0001 complete [ 2309.871637] Lustre: DEBUG MARKER: == conf-sanity test 85: osd_ost init: fail ea_fid_set ==== 00:41:13 (1789188073) [ 2313.769667] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2313.775435] Lustre: *** cfs_fail_loc=197, val=0*** [ 2329.311589] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 2334.432388] LustreError: 103270:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.201.158@tcp: failed processing log, type 4: rc = -110 [ 2339.570881] Lustre: *** cfs_fail_loc=197, val=0*** [ 2339.577345] Lustre: Skipped 65 previous similar messages [ 2363.089849] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 2366.662552] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2367.807153] Lustre: server umount lustre-OST0000 complete [ 2372.186290] Lustre: DEBUG MARKER: == conf-sanity test 86: Replacing mkfs.lustre -G option == 00:42:16 (1789188136) [ 2387.134652] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2387.353493] LustreError: 104887:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2387.361207] LustreError: 104887:0:(ldlm_lib.c:1199:target_handle_connect()) Skipped 4 previous similar messages [ 2389.252249] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 2393.723526] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2396.102711] LustreError: 104920:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x200000009:0x1:0x0]: rc = -5 [ 2396.107984] LustreError: 104920:0:(lod_sub_object.c:917:lod_sub_prep_llog()) lustre-MDT0000-mdtlov: can't get id from catalogs: rc = -5 [ 2396.111606] LustreError: 104920:0:(lod_dev.c:511:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 9, retries 0, failed: rc = -5 [ 2396.249357] Lustre: server umount lustre-MDT0000 complete [ 2410.828042] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_hostid [ 2415.616959] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 2434.604975] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2434.695408] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2434.716701] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2434.758417] Lustre: lustre-MDT0000: new disk, initializing [ 2434.804358] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2436.628327] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 2441.680165] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2441.746379] Lustre: 109085:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2441.879128] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2443.889781] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 2449.760952] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2452.605287] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2455.788715] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2455.918485] Lustre: 111051:0:(osd_compat.c:1354:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2458.633469] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 2463.747065] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2463.788690] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2465.920522] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2466.018870] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2467.721667] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2467.821409] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2468.833310] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2468.835885] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2468.837269] LustreError: Skipped 3 previous similar messages [ 2468.838087] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2468.841171] Lustre: Skipped 6 previous similar messages [ 2468.842638] Lustre: Skipped 9 previous similar messages [ 2470.826652] Lustre: server umount lustre-OST0000 complete [ 2487.263432] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2487.345155] Lustre: server umount lustre-MDT0000 complete [ 2488.855916] LustreError: 109878:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789188253 with bad export cookie 10986537922866937092 [ 2488.856378] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2488.863518] LustreError: 109878:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2489.019994] Lustre: server umount lustre-MDT0001 complete [ 2493.227118] Lustre: DEBUG MARKER: == conf-sanity test 87: check if MDT inode can hold EAs with N stripes properly ========================================================== 00:44:17 (1789188257) [ 2497.555251] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing unload_modules_local [ 2498.926054] Key type lgssc unregistered [ 2499.114665] LNet: 113533:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2499.117755] LNetError: 113533:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2499.127545] LNet: Removed LNI 192.168.201.158@tcp [ 2499.498300] Key type .llcrypt unregistered [ 2499.499417] Key type ._llcrypt unregistered [ 2507.399177] Key type ._llcrypt registered [ 2507.400698] Key type .llcrypt registered [ 2507.443518] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_hostid [ 2514.651389] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 2515.068786] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2515.091577] alg: No test for adler32 (adler32-zlib) [ 2515.980365] Lustre: Lustre: Build Version: 2.17.58_40_g357d090 [ 2516.079858] LNet: Added LNI 192.168.201.158@tcp [8/256/0/180] [ 2517.672232] Key type lgssc registered [ 2518.331296] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2537.032975] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2537.045096] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2538.145151] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2538.159603] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2538.199340] Lustre: lustre-MDT0000: new disk, initializing [ 2538.238552] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2538.246410] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2539.821684] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 2545.167733] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2545.286549] Lustre: lustre-OST0000: new disk, initializing [ 2545.289582] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 2545.291717] Lustre: Skipped 1 previous similar message [ 2545.294457] Lustre: 117677:0:(osd_compat.c:1354:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2545.330370] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2547.654812] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 2547.659239] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 2547.676473] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 2547.851376] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 2553.597146] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2553.668590] Lustre: lustre-OST0001: new disk, initializing [ 2553.671514] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 2553.675543] Lustre: 118541:0:(osd_compat.c:1354:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2553.704718] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 2554.956971] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost [ 2554.961255] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] [ 2554.972816] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 [ 2555.900880] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 2565.088680] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2565.089542] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2565.094711] Lustre: Skipped 1 previous similar message [ 2566.459053] Lustre: server umount lustre-MDT0000 complete [ 2569.115553] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null) [ 2571.024481] LustreError: 116864:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789188335 with bad export cookie 7537515193628062661 [ 2571.026877] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2571.030809] LustreError: 116864:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 2571.075556] Lustre: server umount lustre-OST0000 complete [ 2572.677052] Lustre: server umount lustre-OST0001 complete [ 2576.899771] Lustre: DEBUG MARKER: == conf-sanity test 88a: tunefs.lustre persists a --mountfsoptions-only change ========================================================== 00:45:40 (1789188340) [ 2586.848912] Lustre: DEBUG MARKER: == conf-sanity test 88b: check the default mount options can be overridden ========================================================== 00:45:50 (1789188350) [ 2590.681428] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 2599.575036] Lustre: DEBUG MARKER: == conf-sanity test 89: check tunefs --param and --erase-param{s} options ========================================================== 00:46:03 (1789188363) [ 2615.531172] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_hostid [ 2619.603528] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 2635.184203] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2635.300863] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2635.318092] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2635.363846] Lustre: lustre-MDT0000: new disk, initializing [ 2635.400612] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2635.409858] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2637.195754] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 2642.299463] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2642.348891] Lustre: 126279:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2642.384799] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 2642.387360] Lustre: Skipped 1 previous similar message [ 2642.422928] Lustre: lustre-MDT0001: new disk, initializing [ 2642.471377] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2642.494507] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 2642.504171] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2644.185595] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 2648.798912] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2651.167661] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2654.077728] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2654.187843] Lustre: lustre-OST0000: new disk, initializing [ 2654.189890] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 2654.198708] Lustre: 128242:0:(osd_compat.c:1354:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2654.237078] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2656.270612] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 2656.277800] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2656.339628] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2656.855768] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 2661.525671] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount (FULL|IDLE) failover.node=192.0.2.254@tcp0,osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2663.361245] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2663.446032] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2665.129865] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2665.228225] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2666.464743] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2666.467919] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2666.468462] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2666.472262] Lustre: Skipped 1 previous similar message [ 2666.478444] Lustre: Skipped 2 previous similar messages [ 2671.585895] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2671.588101] Lustre: Skipped 1 previous similar message [ 2676.706232] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2676.708876] Lustre: Skipped 1 previous similar message [ 2680.287568] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2680.348736] Lustre: server umount lustre-OST0000 complete [ 2683.363133] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2683.367789] LustreError: Skipped 1 previous similar message [ 2683.370456] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2683.377916] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2686.945078] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2692.063995] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2692.065851] Lustre: Skipped 3 previous similar messages [ 2696.159230] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2696.221379] Lustre: server umount lustre-MDT0000 complete [ 2697.507298] LustreError: 126271:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789188461 with bad export cookie 7537515193628063872 [ 2697.510398] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2697.511426] LustreError: 126271:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2697.631233] Lustre: server umount lustre-MDT0001 complete [ 2700.731596] Lustre: DEBUG MARKER: == conf-sanity test 90a: check max_mod_rpcs_in_flight is enforced ========================================================== 00:47:44 (1789188464) [ 2703.246194] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2703.445443] LustreError: 130654:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2703.452461] LustreError: 130654:0:(ldlm_lib.c:1199:target_handle_connect()) Skipped 3 previous similar messages [ 2703.471587] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2705.002662] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 2708.385323] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2710.298871] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 2713.241394] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2715.457517] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2718.166651] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2720.814979] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 2723.505918] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2734.878109] Lustre: *** cfs_fail_loc=159, val=0*** [ 2734.880106] Lustre: Skipped 1 previous similar message [ 2750.443280] Lustre: lustre-MDT0000: Client b4813e54-fb84-4284-a693-f867c8dab997 (at 192.168.201.58@tcp) reconnecting [ 2750.985183] Lustre: *** cfs_fail_loc=159, val=0*** [ 2750.987516] Lustre: Skipped 4 previous similar messages [ 2767.339852] Lustre: lustre-MDT0000: Client b4813e54-fb84-4284-a693-f867c8dab997 (at 192.168.201.58@tcp) reconnecting [ 2784.229029] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2784.235637] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2784.235881] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2784.237861] Lustre: Skipped 1 previous similar message [ 2788.446564] Lustre: server umount lustre-OST0000 complete [ 2790.367962] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2794.464968] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2794.470646] Lustre: Skipped 2 previous similar messages [ 2804.191123] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2804.261729] Lustre: server umount lustre-MDT0000 complete [ 2805.644952] LustreError: 130681:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789188570 with bad export cookie 7537515193628064754 [ 2805.650149] LustreError: 130681:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 2805.651611] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2805.768389] Lustre: server umount lustre-MDT0001 complete [ 2809.765138] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing unload_modules_local [ 2810.921597] Key type lgssc unregistered [ 2811.063387] LNet: 134450:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2811.066510] LNetError: 134450:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2811.079274] LNet: Removed LNI 192.168.201.158@tcp [ 2811.426336] Key type .llcrypt unregistered [ 2811.427418] Key type ._llcrypt unregistered [ 2821.283772] Key type ._llcrypt registered [ 2821.285204] Key type .llcrypt registered [ 2821.335464] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 2821.681481] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2821.688304] alg: No test for adler32 (adler32-zlib) [ 2822.551719] Lustre: Lustre: Build Version: 2.17.58_40_g357d090 [ 2822.660154] LNet: Added LNI 192.168.201.158@tcp [8/256/0/180] [ 2824.239450] Key type lgssc registered [ 2824.697894] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2827.729901] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2827.736260] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2828.905891] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2830.736924] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 2834.157099] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2834.336456] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2836.002919] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 2838.704591] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2840.727897] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2843.040594] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2843.151159] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2845.030202] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 2847.294074] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2854.437111] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:42 to 0x280000401:65) [ 2862.750442] Lustre: *** cfs_fail_loc=159, val=0*** [ 2878.954648] Lustre: lustre-MDT0000: Client 26fa5ea0-e274-4c94-9916-5102bb1c5b52 (at 192.168.201.58@tcp) reconnecting [ 2879.689233] Lustre: *** cfs_fail_loc=159, val=0*** [ 2895.848718] Lustre: lustre-MDT0001: Client 26fa5ea0-e274-4c94-9916-5102bb1c5b52 (at 192.168.201.58@tcp) reconnecting [ 2896.365878] Lustre: *** cfs_fail_loc=159, val=0*** [ 2896.367674] Lustre: Skipped 4 previous similar messages [ 2912.733197] Lustre: lustre-MDT0001: Client 26fa5ea0-e274-4c94-9916-5102bb1c5b52 (at 192.168.201.58@tcp) reconnecting [ 2913.861975] Lustre: 138906:0:(mdt_handler.c:65:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 2914.722790] Lustre: *** cfs_fail_loc=159, val=0*** [ 2914.725399] Lustre: Skipped 3 previous similar messages [ 2931.184382] Lustre: lustre-MDT0000: Client b881880d-4db9-48fd-9dbf-be263070f2ee (at 192.168.201.58@tcp) reconnecting [ 2931.759146] Lustre: *** cfs_fail_loc=159, val=0*** [ 2931.760967] Lustre: Skipped 13 previous similar messages [ 2948.062503] Lustre: lustre-MDT0000: Client b881880d-4db9-48fd-9dbf-be263070f2ee (at 192.168.201.58@tcp) reconnecting [ 2948.590013] Lustre: 139199:0:(mdt_handler.c:65:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 2951.649327] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2951.651337] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2951.655187] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2951.656997] LustreError: Skipped 1 previous similar message [ 2951.661242] Lustre: Skipped 1 previous similar message [ 2955.936253] Lustre: server umount lustre-OST0000 complete [ 2961.888314] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2961.889179] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2961.891865] Lustre: Skipped 2 previous similar messages [ 2963.545148] Lustre: server umount lustre-MDT0000 complete [ 2964.831120] LustreError: 136584:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789188729 with bad export cookie 13741099680102637799 [ 2964.834335] LustreError: 136584:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2964.834462] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2964.951760] Lustre: server umount lustre-MDT0001 complete [ 2968.809334] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing unload_modules_local [ 2969.883287] Key type lgssc unregistered [ 2970.008336] LNet: 140247:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2970.010727] LNetError: 140247:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2970.024318] LNet: Removed LNI 192.168.201.158@tcp [ 2970.323832] Key type .llcrypt unregistered [ 2970.324838] Key type ._llcrypt unregistered [ 2979.515228] Key type ._llcrypt registered [ 2979.516246] Key type .llcrypt registered [ 2979.555132] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 2979.838720] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2979.853170] alg: No test for adler32 (adler32-zlib) [ 2980.717038] Lustre: Lustre: Build Version: 2.17.58_40_g357d090 [ 2980.804226] LNet: Added LNI 192.168.201.158@tcp [8/256/0/180] [ 2982.383205] Key type lgssc registered [ 2982.726884] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2985.310321] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2985.315516] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2986.448612] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2987.774271] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 2990.451876] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2990.566659] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2991.842597] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 2994.342266] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2996.449401] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2998.929636] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2999.054781] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3000.104115] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:97) [ 3001.200974] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 3003.846116] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3011.370604] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:129) [ 3016.775090] Lustre: 144237:0:(mdt_handler.c:65:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3017.376548] Lustre: 144286:0:(mdt_handler.c:65:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3017.830476] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 in log params [ 3018.957088] Lustre: 144431:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre/mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 (mode = 0) failed: rc = -17 [ 3019.260371] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=7 in log params [ 3019.263561] Lustre: Skipped 1 previous similar message [ 3019.589381] Lustre: 144529:0:(mdt_handler.c:65:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3020.767708] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3020.770029] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3020.774188] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3021.792928] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3021.793057] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3021.793401] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3026.636076] Lustre: server umount lustre-OST0000 complete [ 3031.519762] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3031.522040] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3031.526088] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3031.527706] Lustre: Skipped 1 previous similar message [ 3034.201105] Lustre: server umount lustre-MDT0000 complete [ 3035.423203] LustreError: 143476:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789188799 with bad export cookie 7705103816217253423 [ 3035.426375] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3035.426924] LustreError: 143476:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3035.548123] Lustre: server umount lustre-MDT0001 complete [ 3039.361975] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing unload_modules_local [ 3040.360206] Key type lgssc unregistered [ 3040.489373] LNet: 145586:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3040.491830] LNetError: 145586:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3040.499292] LNet: Removed LNI 192.168.201.158@tcp [ 3040.774337] Key type .llcrypt unregistered [ 3040.775967] Key type ._llcrypt unregistered [ 3049.848722] Key type ._llcrypt registered [ 3049.849713] Key type .llcrypt registered [ 3049.896217] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 3050.289916] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3050.330102] alg: No test for adler32 (adler32-zlib) [ 3051.197752] Lustre: Lustre: Build Version: 2.17.58_40_g357d090 [ 3051.289938] LNet: Added LNI 192.168.201.158@tcp [8/256/0/180] [ 3052.871149] Key type lgssc registered [ 3053.263174] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3056.169963] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3056.176520] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3057.342105] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3058.745416] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 3061.602316] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3061.723285] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3063.026858] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 3065.482643] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3067.267805] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3069.516772] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3069.635914] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3071.510662] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 3071.717637] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:129) [ 3073.910758] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3081.959599] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:161) [ 3086.382769] Lustre: *** cfs_fail_loc=159, val=0*** [ 3086.384424] Lustre: Skipped 1 previous similar message [ 3102.698379] Lustre: lustre-MDT0000: Client 439a9a19-bc89-4579-bfce-efb7bf84288d (at 192.168.201.58@tcp) reconnecting [ 3118.051529] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3118.052236] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3118.052562] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3118.056498] Lustre: Skipped 1 previous similar message [ 3123.172497] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3123.175375] Lustre: Skipped 2 previous similar messages [ 3123.663589] Lustre: server umount lustre-OST0000 complete [ 3128.288416] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3128.288551] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3128.291109] LustreError: Skipped 1 previous similar message [ 3128.297275] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3128.300997] Lustre: Skipped 1 previous similar message [ 3131.103611] Lustre: server umount lustre-MDT0000 complete [ 3132.364449] LustreError: 146952:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789188896 with bad export cookie 2436215997866787035 [ 3132.367518] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3132.367934] LustreError: 146952:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3132.469454] Lustre: server umount lustre-MDT0001 complete [ 3136.041708] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing unload_modules_local [ 3137.021926] Key type lgssc unregistered [ 3137.138337] LNet: 150657:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3137.140686] LNetError: 150657:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3137.148304] LNet: Removed LNI 192.168.201.158@tcp [ 3137.445796] Key type .llcrypt unregistered [ 3137.447440] Key type ._llcrypt unregistered [ 3146.927120] Key type ._llcrypt registered [ 3146.928166] Key type .llcrypt registered [ 3146.966817] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 3147.418265] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3147.456682] alg: No test for adler32 (adler32-zlib) [ 3148.314121] Lustre: Lustre: Build Version: 2.17.58_40_g357d090 [ 3148.408928] LNet: Added LNI 192.168.201.158@tcp [8/256/0/180] [ 3149.999208] Key type lgssc registered [ 3150.374582] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3152.957175] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3152.966741] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3154.155153] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3155.591339] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 3158.566063] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3158.696640] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3160.011839] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 3162.395851] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3164.253379] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3166.516968] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3166.637800] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3168.638427] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 3168.678080] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:161) [ 3171.325925] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3178.918725] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:170 to 0x280000401:193) [ 3194.875858] Lustre: lustre-OST0000: evicting 38c8e0b1-86ca-4c69-9348-875c2dcf283e (at 192.168.201.58@tcp) by administrative request [ 3194.878958] Lustre: Skipped 1 previous similar message [ 3219.937237] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3219.938059] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3219.939086] LustreError: Skipped 1 previous similar message [ 3219.939640] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3219.941975] Lustre: Skipped 1 previous similar message [ 3225.057325] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3225.060099] Lustre: Skipped 2 previous similar messages [ 3230.176274] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3230.179462] Lustre: Skipped 1 previous similar message [ 3233.247146] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 3233.302116] Lustre: server umount lustre-OST0000 complete [ 3235.296555] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3235.297262] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3235.301401] Lustre: Skipped 1 previous similar message [ 3240.415870] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3240.417958] Lustre: Skipped 2 previous similar messages [ 3240.657200] Lustre: server umount lustre-MDT0000 complete [ 3241.857421] LustreError: 153896:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789189006 with bad export cookie 1622856893905175200 [ 3241.859872] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3241.862053] LustreError: 153896:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3241.974571] Lustre: server umount lustre-MDT0001 complete [ 3245.702917] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing unload_modules_local [ 3246.746059] Key type lgssc unregistered [ 3246.869337] LNet: 156133:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3246.871656] LNetError: 156133:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3246.881274] LNet: Removed LNI 192.168.201.158@tcp [ 3247.184582] Key type .llcrypt unregistered [ 3247.185591] Key type ._llcrypt unregistered [ 3271.911499] Key type ._llcrypt registered [ 3271.913008] Key type .llcrypt registered [ 3271.955865] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 3272.254407] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3272.280043] alg: No test for adler32 (adler32-zlib) [ 3273.132814] Lustre: Lustre: Build Version: 2.17.58_40_g357d090 [ 3273.225461] LNet: Added LNI 192.168.201.158@tcp [8/256/0/180] [ 3274.807697] Key type lgssc registered [ 3275.241517] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3278.182349] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3278.191165] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3279.343627] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3280.798858] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 3283.927466] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3284.077095] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3285.517114] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 3288.277702] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3290.267532] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3292.815095] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3292.937152] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3293.991488] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:193) [ 3294.937447] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 3297.445461] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3304.230075] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:195 to 0x280000401:225) [ 3314.661795] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3314.662131] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3314.663181] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3314.663767] LustreError: Skipped 1 previous similar message [ 3314.669058] Lustre: Skipped 1 previous similar message [ 3316.815959] Lustre: server umount lustre-OST0000 complete [ 3319.776539] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3319.776894] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3319.779050] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3319.781825] Lustre: Skipped 1 previous similar message [ 3319.783533] Lustre: Skipped 1 previous similar message [ 3324.181385] Lustre: server umount lustre-MDT0000 complete [ 3324.897118] LustreError: 158589:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3324.903685] LustreError: 158589:0:(ldlm_lib.c:1199:target_handle_connect()) Skipped 3 previous similar messages [ 3325.443678] LustreError: 161097:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789189089 with bad export cookie 624065196337062402 [ 3325.445695] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3325.448321] LustreError: 161097:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 3325.568333] Lustre: server umount lustre-MDT0001 complete [ 3329.420990] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing unload_modules_local [ 3330.575690] Key type lgssc unregistered [ 3330.715528] LNet: 162148:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3330.718992] LNetError: 162148:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3330.730502] LNet: Removed LNI 192.168.201.158@tcp [ 3331.057683] Key type .llcrypt unregistered [ 3331.059136] Key type ._llcrypt unregistered [ 3340.851039] Key type ._llcrypt registered [ 3340.852079] Key type .llcrypt registered [ 3340.887493] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 3341.212269] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3341.248522] alg: No test for adler32 (adler32-zlib) [ 3342.113467] Lustre: Lustre: Build Version: 2.17.58_40_g357d090 [ 3342.213862] LNet: Added LNI 192.168.201.158@tcp [8/256/0/180] [ 3343.807217] Key type lgssc registered [ 3344.204480] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3349.273242] Lustre: DEBUG MARKER: == conf-sanity test 100: check lshowmount lists MGS, MDT, OST and 0@lo ========================================================== 00:58:33 (1789189113) [ 3354.425609] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_hostid [ 3357.571171] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 3368.973942] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3368.979878] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3370.066532] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3370.075814] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3370.112890] Lustre: lustre-MDT0000: new disk, initializing [ 3370.135102] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3370.142176] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3371.497286] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 3375.733580] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3375.774979] Lustre: 166375:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 3375.798961] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 3375.800832] Lustre: Skipped 1 previous similar message [ 3375.837720] Lustre: lustre-MDT0001: new disk, initializing [ 3375.870587] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3375.882582] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 3375.888862] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 3377.223464] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 3381.023777] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3382.926580] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3385.219560] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3385.319195] Lustre: lustre-OST0000: new disk, initializing [ 3385.320963] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3385.323709] Lustre: 168341:0:(osd_compat.c:1354:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3385.352067] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3387.281756] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 3387.384272] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 3387.387560] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 3387.418614] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 3391.188071] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3397.600455] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3397.602265] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3397.603904] LustreError: Skipped 1 previous similar message [ 3397.609597] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3397.612108] Lustre: Skipped 1 previous similar message [ 3400.398579] Lustre: server umount lustre-OST0000 complete [ 3401.695841] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3401.697989] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3401.701331] Lustre: Skipped 1 previous similar message [ 3401.702990] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3402.720337] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3402.720561] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3407.700072] Lustre: server umount lustre-MDT0000 complete [ 3408.883161] LustreError: 167170:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789189173 with bad export cookie 17936937715230209064 [ 3408.886698] LustreError: 167170:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 3408.887617] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3409.014948] Lustre: server umount lustre-MDT0001 complete [ 3412.588150] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing unload_modules_local [ 3413.538398] Key type lgssc unregistered [ 3413.682624] LNet: 170243:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3413.687259] LNetError: 170243:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3413.696362] LNet: Removed LNI 192.168.201.158@tcp [ 3414.017808] Key type .llcrypt unregistered [ 3414.019045] Key type ._llcrypt unregistered [ 3423.066833] Key type ._llcrypt registered [ 3423.068575] Key type .llcrypt registered [ 3423.109741] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 3423.414483] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3423.424574] alg: No test for adler32 (adler32-zlib) [ 3424.284501] Lustre: Lustre: Build Version: 2.17.58_40_g357d090 [ 3424.368280] LNet: Added LNI 192.168.201.158@tcp [8/256/0/180] [ 3425.959140] Key type lgssc registered [ 3426.318832] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3428.815068] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3428.821495] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3429.953908] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3431.239483] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 3434.077069] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3434.207864] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3435.569345] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 3437.862982] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3439.617060] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3441.857076] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3441.962940] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3443.781306] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 3446.015177] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3456.293694] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:33) [ 3458.767099] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3458.775317] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3458.780568] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3458.783049] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3458.788447] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3459.103472] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3459.436769] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3459.440739] Lustre: Skipped 1 previous similar message [ 3459.448390] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3459.452995] Lustre: Skipped 1 previous similar message [ 3459.454517] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3459.456649] Lustre: Skipped 1 previous similar message [ 3459.458547] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3459.463184] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3459.465827] Lustre: Skipped 1 previous similar message [ 3459.759189] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3460.062266] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3460.363304] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3460.667615] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3460.671246] Lustre: Skipped 3 previous similar messages [ 3460.677531] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3460.681168] Lustre: Skipped 3 previous similar messages [ 3460.683220] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3460.685334] Lustre: Skipped 3 previous similar messages [ 3460.686773] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3460.690664] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3460.692449] Lustre: Skipped 3 previous similar messages [ 3460.979975] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3461.272647] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3461.557656] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3461.890257] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3462.196079] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3462.494224] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3462.788217] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3462.790024] Lustre: Skipped 6 previous similar messages [ 3462.795375] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3462.800638] Lustre: Skipped 6 previous similar messages [ 3462.802570] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3462.805458] Lustre: Skipped 6 previous similar messages [ 3462.807397] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3462.812895] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3462.816551] Lustre: Skipped 6 previous similar messages [ 3463.119874] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3463.411928] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3463.705285] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3463.996177] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3464.321489] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3464.626917] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3464.966885] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3465.285186] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3465.614628] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3465.922542] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3466.228785] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3466.540254] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3466.849155] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3466.851064] Lustre: Skipped 12 previous similar messages [ 3466.855884] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3466.859772] Lustre: Skipped 12 previous similar messages [ 3466.861213] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3466.863145] Lustre: Skipped 12 previous similar messages [ 3466.864411] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3466.867632] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3466.869350] Lustre: Skipped 12 previous similar messages [ 3467.161954] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3467.460558] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3467.754434] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3468.108521] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3468.438238] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3468.747659] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3469.047557] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3469.353395] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3469.659715] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3469.965169] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3470.261243] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3470.580330] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3470.887899] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3471.198524] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3471.503810] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3471.811671] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3472.124320] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3472.451879] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3472.762770] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3473.070031] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3473.366463] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3473.671345] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3473.963954] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3474.273475] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3474.567344] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3474.860885] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3474.863545] Lustre: Skipped 25 previous similar messages [ 3474.867903] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3474.872190] Lustre: Skipped 25 previous similar messages [ 3474.873651] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3474.876201] Lustre: Skipped 25 previous similar messages [ 3474.878319] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3474.882805] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3474.884702] Lustre: Skipped 25 previous similar messages [ 3475.173134] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3475.467966] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3475.733243] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3475.997145] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3476.267352] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3476.547423] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3476.828124] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3477.110516] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3477.400316] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3477.703280] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3477.986459] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3478.273953] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3478.557437] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3478.850093] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3479.135670] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3479.426616] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3479.725872] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3480.055500] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3480.355573] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3480.652202] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3480.933411] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3481.236355] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3481.535441] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3481.845751] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3482.133929] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3482.445038] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3482.726529] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3483.005467] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3483.272689] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3483.575417] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3483.875765] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3484.154159] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3484.422147] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3484.696431] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3484.989216] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3485.279712] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3485.585745] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3485.908874] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3486.189217] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3486.469294] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3486.755268] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3487.053836] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3487.342476] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3487.630042] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3487.936847] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3488.238245] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3488.544449] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3488.858410] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3489.154811] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3489.471329] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3489.749242] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3490.049352] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3490.346537] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3490.642773] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3490.913657] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3490.915246] Lustre: Skipped 54 previous similar messages [ 3490.920514] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3490.925313] Lustre: Skipped 54 previous similar messages [ 3490.926771] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3490.928617] Lustre: Skipped 54 previous similar messages [ 3490.930594] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3490.935837] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3490.938483] Lustre: Skipped 54 previous similar messages [ 3491.226026] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3491.531035] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3491.829063] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3492.120253] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3492.415281] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3492.728994] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3493.041710] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3493.346191] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3493.647205] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3493.922828] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3494.218376] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3494.515892] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3494.832216] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3495.143243] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3495.444098] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3495.746110] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3496.036686] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3496.338345] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3496.667215] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3496.996285] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3497.323523] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3497.637782] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3497.956544] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3498.270494] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3498.565248] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3498.869530] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3499.174957] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3499.457822] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3499.751175] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3500.041229] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3500.351881] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3500.638153] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3500.926833] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3501.216304] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3501.508058] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3501.794899] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3502.097473] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3502.397582] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3502.694509] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3502.974418] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3503.253929] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3503.537448] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3503.848685] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3504.148144] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3504.447696] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3504.746315] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3505.035767] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3505.315368] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3505.607202] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3505.902323] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3506.195754] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3506.464823] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3506.756403] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3507.035421] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3507.332418] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3507.625068] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3507.915089] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3508.199926] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3508.506769] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3508.811219] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3509.114270] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3509.421994] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3509.729643] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3510.027433] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3510.334980] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3510.624990] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3510.922025] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3511.203374] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3511.487987] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3511.782506] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3512.104520] LustreError: 171650:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 3512.107507] LustreError: 171650:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 3512.108091] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3512.402417] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3512.713193] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3512.999674] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3513.301243] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3513.589053] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3513.880413] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3514.164168] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3514.443080] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3514.714745] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3514.985841] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3515.245689] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3515.525281] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3515.798250] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3516.067730] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3516.324369] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3516.633832] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3516.924123] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3517.240301] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3517.533179] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3517.834392] LustreError: 171650:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 3517.837063] LustreError: 171650:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 3517.838033] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3518.107077] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3518.384099] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3518.661328] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3518.951498] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3519.246257] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3519.549622] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3519.853039] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3520.145717] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3520.422190] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3520.706644] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3520.987451] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3521.271657] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3521.548982] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3521.820793] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3522.090554] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3522.373246] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3522.660874] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3522.967701] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3522.969705] Lustre: Skipped 108 previous similar messages [ 3522.975636] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3522.979523] Lustre: Skipped 108 previous similar messages [ 3522.981278] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3522.983547] Lustre: Skipped 108 previous similar messages [ 3522.985208] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3522.988721] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3522.991476] Lustre: Skipped 108 previous similar messages [ 3523.309217] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3523.606215] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3523.901907] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3524.186643] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3524.465761] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3524.756709] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3525.030739] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3525.368735] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3525.658729] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3525.962934] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3526.267620] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3526.584852] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3526.905127] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3527.241791] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3527.554563] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3527.847033] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3528.123070] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3528.408486] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3528.679305] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3528.960354] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3529.266882] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3529.575361] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3529.864967] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3530.154238] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3530.421069] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3530.697173] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3530.973804] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3531.251705] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3531.523851] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3531.802301] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3532.083823] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3532.363273] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3532.645292] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3532.945744] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3533.210868] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3533.488618] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3533.773462] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3534.087260] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3534.384865] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3534.696907] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3535.001976] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3535.322150] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3535.631838] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3535.953309] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3536.276328] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3536.598354] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3536.892409] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3537.179796] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3537.474226] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3537.777586] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3538.073284] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3538.359459] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3538.651036] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3538.945686] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3539.232781] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3539.507360] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3539.781786] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3540.055730] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3540.327159] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3540.612577] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3540.904889] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3541.217173] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3541.518838] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3541.835686] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3542.166163] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3542.505098] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3542.820185] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3543.133492] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3543.453176] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3543.777186] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3544.090780] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3544.407105] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3544.723395] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3545.047807] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3545.329691] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3545.612128] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3545.898093] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3546.180087] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3546.467445] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3546.750114] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3547.030039] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3547.323027] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3547.613375] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3547.906889] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3548.198385] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3548.494109] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3548.778633] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3549.073183] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3549.368623] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3549.682168] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3550.015534] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3550.353555] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3550.670169] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3551.006561] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3551.311222] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3551.634582] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3551.986161] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3552.314251] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3552.684167] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3553.040194] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3553.442042] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3553.789706] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3554.125264] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3554.505615] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3554.832597] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3555.186982] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3555.576455] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3555.952838] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3556.320074] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3556.675203] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3557.012263] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3557.360409] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3557.769647] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3558.123575] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3558.432824] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3558.728237] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3559.056572] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3559.385822] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3559.708364] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3560.022496] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3560.358905] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3560.658447] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3560.962931] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3561.282101] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3561.610156] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3561.918452] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3562.208736] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3562.514290] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3562.850044] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3563.167141] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3563.467659] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3563.791942] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3564.106749] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3564.433781] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3564.735425] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3565.039301] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3565.347055] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3565.658947] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3565.982190] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3566.304458] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3566.635526] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3566.956308] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3567.274521] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3567.597031] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3567.937187] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3568.279363] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3568.629295] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3568.958696] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3569.307369] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3569.641134] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3569.960025] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3570.264731] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3570.584388] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3570.911057] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3571.234805] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3571.573726] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3571.916304] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3572.268104] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3572.598765] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3572.948890] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3573.291254] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3573.633556] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3573.971078] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3574.309688] LustreError: 171650:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 3574.314297] LustreError: 171650:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 3574.314721] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3574.624653] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3574.946243] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3575.255996] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3575.567466] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3575.861362] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3576.157185] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3576.461288] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3576.821427] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3577.161555] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3577.511935] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3577.876507] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3578.250696] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3578.575617] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3578.920607] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3579.275922] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3579.634215] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3579.961218] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3580.272262] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3580.568631] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3580.886066] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3581.174212] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3581.459283] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3581.747753] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3582.051771] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3582.346805] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3582.656034] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3582.957948] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3583.285777] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3583.603280] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3583.920841] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3584.238114] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3584.568615] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3584.875202] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3585.187966] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3585.493256] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3585.817789] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3586.138952] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3586.448278] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3586.774185] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3587.115322] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3587.117985] Lustre: Skipped 203 previous similar messages [ 3587.123572] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3587.129830] Lustre: Skipped 203 previous similar messages [ 3587.131857] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3587.134214] Lustre: Skipped 203 previous similar messages [ 3587.136098] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3587.139127] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3587.141043] Lustre: Skipped 203 previous similar messages [ 3587.430688] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3587.732288] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3588.038706] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3588.358618] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3588.649376] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3588.940353] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3589.243454] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3589.570453] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3589.902181] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3590.221085] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3590.544399] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3590.896716] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3591.224430] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3591.536183] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3591.852221] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3592.191841] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3592.489645] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3592.791533] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3593.094285] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3593.434852] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3593.731252] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3594.040257] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3594.352033] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3594.663269] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3594.970117] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3595.260043] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3595.547622] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3595.872343] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3596.157242] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3596.454914] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3596.741841] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3597.037799] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3597.321260] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3597.604537] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3597.897409] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3598.224534] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3598.538118] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3598.836302] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3599.166347] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3599.518615] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3599.822637] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3600.128921] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3600.451162] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3600.791582] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3601.110704] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3601.400585] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3601.698237] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3601.997789] LustreError: 171650:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 3602.000554] LustreError: 171650:0:(osp_precreate.c:655:osp_precreate_send()) Skipped 1 previous similar message [ 3602.001489] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3602.002837] LustreError: 171650:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 3602.009061] LustreError: 171650:0:(osp_precreate.c:1359:osp_precreate_thread()) Skipped 1 previous similar message [ 3602.320935] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3602.617582] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3602.923332] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3603.250499] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3603.550756] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3603.869929] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3604.201738] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3604.549408] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3604.864662] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3605.191965] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3605.490252] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3605.813862] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3606.114967] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3606.408793] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3606.709170] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3607.012336] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3607.306430] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3607.631220] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3607.949630] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3608.301556] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3608.609076] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3608.934934] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3609.224301] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3609.529305] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3609.820738] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3610.112473] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3610.412543] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3610.724036] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3611.015957] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3611.325904] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3611.632976] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3611.972321] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3612.279818] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3612.592608] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3612.915167] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3613.246755] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3613.544665] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3613.846696] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3614.150996] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3614.490019] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3614.810394] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3615.135788] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3615.445782] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3615.768347] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3616.071796] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3616.375282] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3616.678760] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3616.993103] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3617.300875] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3617.633221] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3617.965291] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3618.308873] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3618.612312] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3618.918672] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3619.266521] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3619.658919] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3619.987208] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3620.289897] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3620.603701] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3620.910368] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3621.195235] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3621.496118] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3621.804876] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3622.127942] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3622.433035] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3622.736981] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3623.043106] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3623.353961] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3623.646729] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3623.938834] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3624.241098] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3624.563463] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3624.864616] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3625.165067] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3625.461990] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3625.799253] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3626.126321] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3626.439288] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3626.759728] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3627.081551] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3627.397386] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3627.726178] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3628.028745] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3628.341192] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3628.657645] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3628.980049] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3629.305234] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3629.632637] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3629.929085] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3630.228192] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3630.526698] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3630.869798] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3631.194452] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3631.512373] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3631.826404] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3632.160810] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3632.481654] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3632.762324] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3633.069853] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3633.396194] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3633.720334] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3634.035453] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3634.324647] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3634.638946] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3634.965394] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3635.282055] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3635.585898] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3635.890623] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3636.188404] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3636.485470] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3636.782685] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3637.101565] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3637.420938] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3637.736674] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3638.038514] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3638.355421] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3638.661035] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3638.971598] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3639.282543] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3639.600555] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3639.895566] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3640.219825] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3640.530061] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3640.853097] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3641.183642] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3641.531239] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3641.890640] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3642.216654] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3642.537471] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3642.868980] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3643.221370] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3643.565736] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3643.879274] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3644.216404] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3644.561993] LustreError: 171650:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 3644.566959] LustreError: 171650:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 3644.567491] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3644.874812] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3645.167726] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3645.476298] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3645.798898] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3646.093215] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3646.412293] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3646.741946] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3647.060648] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3647.354144] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3647.648535] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3647.964282] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3648.309416] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3648.662269] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3648.974777] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3649.339756] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3649.676731] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3650.004612] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3650.336919] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3650.663174] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3651.010748] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3651.335699] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3651.661316] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3651.961273] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3652.296701] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3652.635182] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3652.988207] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3653.411184] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3653.792827] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3654.120511] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3654.427852] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3654.748424] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3655.056885] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3655.353719] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3655.688440] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3655.990326] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3656.285352] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3656.594064] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3656.887221] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3657.190722] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3657.487663] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3657.792498] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3658.084504] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3658.390577] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3658.707311] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3659.063317] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3659.403525] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3659.755442] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3660.093835] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3660.408995] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3660.735360] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3661.042530] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3661.368486] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3661.704231] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3662.021812] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3662.334655] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3662.653329] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3662.986144] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3663.318300] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3663.646745] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3663.985098] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3664.308741] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3664.611323] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3664.927706] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3665.241691] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3665.559649] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3665.867386] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3666.200666] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3666.533619] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3666.845192] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3667.146112] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3667.459036] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3667.786564] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3668.115767] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3668.441327] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3668.786647] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3669.128670] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3669.468632] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3669.786324] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3670.130913] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3670.463504] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3670.797412] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3671.118837] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3671.451134] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3671.780823] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3672.123241] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3672.445062] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3672.772220] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3673.094257] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3673.408324] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3673.738438] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3674.054258] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3674.378095] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3674.710874] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3675.036331] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3675.362131] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3675.694929] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3676.033467] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3676.341178] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3676.661137] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3676.980238] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3677.327232] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3677.642374] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3677.946965] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3678.264525] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3678.607622] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3678.929146] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3679.267590] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3679.628871] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3679.975278] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3680.309285] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3680.624065] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3680.924275] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3681.255454] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3681.581103] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3681.894984] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3682.202858] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3682.533508] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3682.827305] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3683.132652] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3683.429370] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3683.751430] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3684.084539] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3684.424360] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3684.772287] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3685.106306] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3685.436299] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3685.769805] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3686.115521] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3686.437072] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3686.744449] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3687.065768] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3687.412879] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3687.734226] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3688.029812] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3688.323221] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3688.649707] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3688.981972] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3689.297896] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3689.593831] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3689.906423] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3690.198630] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3690.468204] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3690.751870] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3691.040680] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3691.330817] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3691.606810] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3691.912476] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3692.210613] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3692.496177] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3692.784891] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3693.084534] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3693.388443] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3693.685142] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3693.987510] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3694.291283] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3694.617171] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3694.936836] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3695.274889] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3695.586984] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3695.901364] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3696.227956] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3696.533691] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3696.850546] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3697.190270] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3697.510391] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3697.848580] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3698.212090] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3698.591703] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3698.941263] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3699.277344] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3699.615463] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3699.956837] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3700.316155] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3700.687167] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3701.024610] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3701.346637] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3701.718566] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3702.086494] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3702.460202] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3702.825125] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3703.165367] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3703.500494] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3703.862958] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3704.196804] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3704.532886] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3704.893567] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3705.279465] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3705.610693] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3705.930816] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3706.274678] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3706.594174] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3706.959983] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3707.286797] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3707.608234] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3707.929750] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3708.272640] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3708.646937] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3709.003958] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3709.402180] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3709.742040] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3710.062660] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3710.415503] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3710.720179] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3711.063427] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3711.380284] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3711.699412] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3712.034180] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3712.363399] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3712.711366] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3713.061170] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3713.400364] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3713.718357] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3714.054087] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3714.371732] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3714.698702] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3715.028155] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3715.372493] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3715.374899] Lustre: Skipped 399 previous similar messages [ 3715.381424] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3715.385812] Lustre: Skipped 399 previous similar messages [ 3715.387721] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3715.390936] Lustre: Skipped 399 previous similar messages [ 3715.393137] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3715.397187] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3715.399421] Lustre: Skipped 399 previous similar messages [ 3715.755030] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3716.110852] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3716.416485] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3716.726472] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3717.076156] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3717.415899] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3717.770039] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3718.092862] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3718.408047] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3718.710362] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3719.037857] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3719.365319] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3719.685483] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3719.972318] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3720.277734] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3720.622879] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3720.939481] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3721.260506] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3721.568425] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3721.898792] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3722.238719] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3722.567849] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3722.923388] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3723.251578] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3723.607479] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3723.954145] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3724.305404] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3724.625446] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3724.953712] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3725.269595] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3725.550247] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3725.857261] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3726.168306] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3726.491552] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3726.813306] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3727.122744] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3727.444943] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3727.758512] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3728.074494] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3728.448246] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3728.792053] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3729.097427] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3729.434855] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3729.765183] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3730.103061] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3730.434302] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3730.754420] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3731.066389] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3731.380066] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3731.698433] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3732.016319] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3732.344287] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3732.669649] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3732.979252] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3733.285290] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3733.615904] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3733.940304] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3734.276808] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3734.576199] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3734.890230] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3735.224752] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3735.540321] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3735.856482] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3736.177879] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3736.523035] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3736.886407] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3737.225585] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3737.573849] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3737.907031] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3738.244928] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3738.560280] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3738.885698] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3739.204205] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3739.547154] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3739.860582] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3740.162089] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3740.453380] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3740.769230] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3741.064084] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3741.367670] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3741.660650] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3741.971945] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3742.250392] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3742.527628] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3742.810034] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3743.116704] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3743.386932] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3743.665562] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3743.951864] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3744.275615] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3744.569148] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3744.848952] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3745.138853] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3745.438941] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3745.724064] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3746.012444] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3746.313364] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3746.617949] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3746.911725] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3747.209165] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3747.509220] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3747.823647] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3748.183891] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3748.512920] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3748.841139] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3749.169817] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3749.494690] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3749.809354] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3750.135347] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3750.428110] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3750.717494] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3751.015228] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3751.322321] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3751.620321] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3751.925737] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3752.225337] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3752.523657] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3752.806199] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3753.120838] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3753.427757] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3753.740427] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3754.042438] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3754.358148] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3754.658863] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3754.961861] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3755.277862] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3755.599645] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3755.933374] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3756.275277] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3756.604916] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3756.910904] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3757.215039] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3757.529579] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3757.819614] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3758.127219] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3758.430673] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3758.741099] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3759.031892] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3759.335716] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3759.666941] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3760.010403] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3760.308226] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3760.603510] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3760.903614] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3761.211510] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3761.506532] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3761.822166] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3762.126852] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3762.455768] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3762.743662] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3763.028871] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3763.319341] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3763.634469] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3763.950062] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3764.258296] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3764.564586] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3764.891373] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3765.181346] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3765.475110] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3765.777750] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3766.086581] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3766.387000] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3766.710155] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3767.006668] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3767.325668] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3767.628743] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3767.930315] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3768.238414] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3768.558995] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3768.882573] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3769.180808] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3769.479080] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3769.792492] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3770.089752] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3770.399114] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3770.709457] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3771.038106] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3771.352264] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3771.668360] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3845.658790] LustreError: 173449:0:(ofd_dev.c:1780:ofd_create_hdl()) lustre-OST0000: unable to precreate: rc = -28 [ 3845.662726] LustreError: 171650:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -28 [ 3845.666400] LustreError: 171650:0:(osp_precreate.c:655:osp_precreate_send()) Skipped 1 previous similar message [ 3915.231776] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3915.235463] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3917.280914] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3920.706971] Lustre: server umount lustre-OST0000 complete [ 3922.401596] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3922.403700] Lustre: Skipped 2 previous similar messages [ 3927.521504] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3927.524321] Lustre: Skipped 1 previous similar message [ 3928.229124] Lustre: server umount lustre-MDT0000 complete [ 3929.627451] LustreError: 171611:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789189694 with bad export cookie 1257463845059435135 [ 3929.630302] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3929.631677] LustreError: 171611:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 3929.768938] Lustre: server umount lustre-MDT0001 complete [ 3933.520620] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing unload_modules_local [ 3934.600672] Key type lgssc unregistered [ 3934.736431] LNet: 226677:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3934.739769] LNetError: 226677:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3934.752435] LNet: Removed LNI 192.168.201.158@tcp [ 3935.065799] Key type .llcrypt unregistered [ 3935.067107] Key type ._llcrypt unregistered [ 3944.264376] Key type ._llcrypt registered [ 3944.265890] Key type .llcrypt registered [ 3944.300481] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 3944.593828] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3944.600711] alg: No test for adler32 (adler32-zlib) [ 3945.444338] Lustre: Lustre: Build Version: 2.17.58_40_g357d090 [ 3945.526242] LNet: Added LNI 192.168.201.158@tcp [8/256/0/180] [ 3947.103146] Key type lgssc registered [ 3947.434653] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3949.853206] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3949.858743] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3950.996720] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3952.329737] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 3955.162156] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3955.292592] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3956.613136] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 3959.133265] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3960.997690] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3963.491331] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3963.611673] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3965.616196] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 3968.108534] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3975.908527] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49665 to 0x280000401:49696) [ 3980.679874] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3981.273096] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3981.278763] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3981.284444] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3981.287286] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3981.287309] LustreError: 228083:0:(osp_precreate.c:1268:osp_precreate_thread()) cfs_fail_timeout id 2107 sleeping for 20000ms [ 3983.844659] Lustre: lustre-OST0000: Not available for connect from 192.168.201.58@tcp (stopping) [ 3985.375944] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3985.378137] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3985.382904] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3986.401768] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3986.403573] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3988.956752] Lustre: lustre-OST0000: Not available for connect from 192.168.201.58@tcp (stopping) [ 3988.960686] Lustre: Skipped 1 previous similar message [ 3994.079382] Lustre: lustre-OST0000: Not available for connect from 192.168.201.58@tcp (stopping) [ 3994.083684] Lustre: Skipped 2 previous similar messages [ 3996.127160] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 3996.180788] Lustre: server umount lustre-OST0000 complete [ 4001.367066] LustreError: 228083:0:(osp_precreate.c:1268:osp_precreate_thread()) cfs_fail_timeout id 2107 awake [ 4024.266197] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4024.413147] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4026.423413] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 4028.816442] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 4041.827655] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4041.832142] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4046.948132] LustreError: lustre-OST0000-osc-MDT0001: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4046.953262] Lustre: lustre-OST0000-osc-MDT0001: Connection restored to 0@lo (at 0@lo) [ 4050.947419] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 21 sec [ 4052.861808] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff904fc6167000.ost_server_uuid 50 [ 4053.476733] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff904fc6167000.ost_server_uuid in FULL state after 0 sec [ 4057.571245] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4057.571332] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4057.577518] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4057.582290] Lustre: Skipped 1 previous similar message [ 4060.763904] Lustre: server umount lustre-OST0000 complete [ 4062.688560] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4062.688924] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4062.696576] Lustre: Skipped 2 previous similar messages [ 4068.390162] Lustre: server umount lustre-MDT0000 complete [ 4069.727366] LustreError: 232272:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789189834 with bad export cookie 18063162705958602121 [ 4069.730137] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4069.731486] LustreError: 232272:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4069.844335] Lustre: server umount lustre-MDT0001 complete [ 4073.679497] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing unload_modules_local [ 4074.782455] Key type lgssc unregistered [ 4074.909344] LNet: 233311:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4074.913788] LNetError: 233311:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4074.922261] LNet: Removed LNI 192.168.201.158@tcp [ 4075.265673] Key type .llcrypt unregistered [ 4075.267411] Key type ._llcrypt unregistered [ 4086.925032] Key type ._llcrypt registered [ 4086.926373] Key type .llcrypt registered [ 4086.965287] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 4087.273302] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4087.280618] alg: No test for adler32 (adler32-zlib) [ 4088.132885] Lustre: Lustre: Build Version: 2.17.58_40_g357d090 [ 4088.225969] LNet: Added LNI 192.168.201.158@tcp [8/256/0/180] [ 4089.807185] Key type lgssc registered [ 4090.174142] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4093.427147] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4093.434795] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4094.583930] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4095.938659] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 4098.803625] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4098.916666] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4100.173217] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 4101.075585] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 4103.289531] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4103.409860] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4105.382389] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 4105.448188] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49728) [ 4108.538473] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4108.601824] Lustre: lustre-OST0001: new disk, initializing [ 4108.603777] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 4108.607415] Lustre: 237319:0:(osd_compat.c:1354:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 4108.640526] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 4108.815801] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 4108.820467] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 4108.862025] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 4110.667401] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 4116.248201] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 4118.899437] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 4124.639879] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4124.642729] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4124.647788] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4125.153144] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4125.153669] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4125.157816] Lustre: Skipped 2 previous similar messages [ 4125.161641] Lustre: Skipped 3 previous similar messages [ 4130.272910] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4130.275412] Lustre: Skipped 1 previous similar message [ 4130.403780] Lustre: server umount lustre-MDT0000 complete [ 4131.609075] LustreError: 234992:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789189896 with bad export cookie 7580403683774089950 [ 4131.611073] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4131.613865] LustreError: 234992:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 4131.719126] Lustre: server umount lustre-MDT0001 complete [ 4142.598436] Lustre: server umount lustre-OST0000 complete [ 4154.152852] Lustre: server umount lustre-OST0001 complete [ 4161.190201] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 4164.599877] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4164.737700] LustreError: 240427:0:(ldlm_lib.c:1199:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4164.745215] LustreError: 240427:0:(ldlm_lib.c:1199:target_handle_connect()) Skipped 2 previous similar messages [ 4164.754810] Lustre: mylustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4166.008513] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 4168.659377] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4170.069859] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 4170.996419] Lustre: 241569:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 4173.025621] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4173.131706] Lustre: mylustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4173.134341] Lustre: Skipped 1 previous similar message [ 4174.966531] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 4175.203917] LustreError: 241924:0:(ldlm_lib.c:1199:target_handle_connect()) mylustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4175.207188] Lustre: mylustre-OST0000: new connection from mylustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49730 to 0x280000401:49760) [ 4177.816529] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4178.986349] Lustre: mylustre-OST0001: new connection from mylustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:33) [ 4180.073184] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 4183.461537] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 4184.746168] Lustre: 243438:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 4189.154609] LustreError: mylustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4189.155147] Lustre: mylustre-MDT0000-lwp-OST0001: Connection to mylustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4189.157788] Lustre: mylustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4189.162811] Lustre: Skipped 3 previous similar messages [ 4189.165444] Lustre: Skipped 3 previous similar messages [ 4194.200569] Lustre: server umount mylustre-MDT0000 complete [ 4194.274042] LustreError: 240428:0:(ldlm_lib.c:1199:target_handle_connect()) mylustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4194.278734] LustreError: 240428:0:(ldlm_lib.c:1199:target_handle_connect()) Skipped 3 previous similar messages [ 4195.451068] LustreError: 240404:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789189959 with bad export cookie 7580403683774092701 [ 4195.453640] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4195.456613] LustreError: 240404:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4195.570589] Lustre: server umount mylustre-MDT0001 complete [ 4206.594586] Lustre: server umount mylustre-OST0000 complete [ 4218.139066] Lustre: server umount mylustre-OST0001 complete [ 4225.494194] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 4228.959469] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4229.107545] LustreError: 245746:0:(ldlm_lib.c:1199:target_handle_connect()) tfs-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4229.126890] Lustre: tfs-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4229.129117] Lustre: Skipped 1 previous similar message [ 4230.499837] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 4233.311114] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4234.767805] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 4235.735617] Lustre: 246888:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 4238.028055] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4239.201616] LustreError: 247429:0:(ldlm_lib.c:1199:target_handle_connect()) tfs-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4239.206138] Lustre: tfs-OST0000: new connection from tfs-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49730 to 0x280000401:49792) [ 4240.048485] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 4242.961444] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4244.074312] Lustre: tfs-OST0001: new connection from tfs-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) [ 4244.940424] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 4248.062284] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 4249.250443] Lustre: 248756:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 4254.176247] LustreError: tfs-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4254.180440] Lustre: tfs-MDT0000-osp-MDT0001: Connection to tfs-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4254.186293] Lustre: tfs-MDT0000: Not available for connect from 0@lo (stopping) [ 4257.376710] Lustre: server umount tfs-MDT0000 complete [ 4258.698161] LustreError: 248759:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789190023 with bad export cookie 7580403683774094584 [ 4258.702336] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4258.702682] LustreError: 248759:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4258.815948] Lustre: server umount tfs-MDT0001 complete [ 4270.348568] Lustre: server umount tfs-OST0000 complete [ 4282.084820] Lustre: server umount tfs-OST0001 complete [ 4289.427106] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 4292.621528] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4292.754259] LustreError: 251003:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4292.770729] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4292.773223] Lustre: Skipped 3 previous similar messages [ 4293.998558] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 4296.762285] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4298.300909] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 4299.273181] Lustre: 252144:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 4301.503695] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4302.631334] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49730 to 0x280000401:49824) [ 4303.715250] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 4306.857153] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4308.956995] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 4312.042340] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:97) [ 4312.098631] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 4313.332025] Lustre: 254012:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 4315.586387] Lustre: DEBUG MARKER: == conf-sanity test 104a: Make sure user defined options are reflected in mount ========================================================== 01:14:39 (1789190079) [ 4327.395663] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4327.400035] Lustre: Skipped 6 previous similar messages [ 4327.401681] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4327.403663] Lustre: Skipped 6 previous similar messages [ 4333.601258] Lustre: server umount lustre-MDT0000 complete [ 4335.031797] LustreError: 250979:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789190099 with bad export cookie 7580403683774096250 [ 4335.035760] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4335.036403] LustreError: 250979:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4337.633328] LustreError: 252518:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4337.633752] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4337.642575] LustreError: 252518:0:(ldlm_lib.c:1199:target_handle_connect()) Skipped 4 previous similar messages [ 4341.232444] Lustre: server umount lustre-MDT0001 complete [ 4348.801458] Lustre: server umount lustre-OST0000 complete [ 4356.324964] Lustre: server umount lustre-OST0001 complete [ 4358.487922] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_hostid [ 4361.598118] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 4373.344639] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4373.446287] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 4373.457235] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 4373.496209] Lustre: lustre-MDT0000: new disk, initializing [ 4373.517873] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 188-180 [ 4373.520309] Lustre: Skipped 3 previous similar messages [ 4373.526653] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 4374.997479] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 4379.304308] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4379.350909] Lustre: 257185:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 4379.376739] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 4379.379066] Lustre: Skipped 1 previous similar message [ 4379.414368] Lustre: lustre-MDT0001: new disk, initializing [ 4379.460237] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 4379.464142] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 4380.881082] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 4385.093455] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4385.196595] Lustre: lustre-OST0000: new disk, initializing [ 4385.198990] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 4385.201768] Lustre: 258769:0:(osd_compat.c:1354:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 4386.872054] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 4386.875574] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 4386.917295] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 4387.217914] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 4391.412755] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4391.487972] Lustre: lustre-OST0001: new disk, initializing [ 4391.490106] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 4391.493500] Lustre: 259642:0:(osd_compat.c:1354:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 4393.093115] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 4393.096798] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 4393.139809] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 4393.537659] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 4398.210672] Lustre: DEBUG MARKER: == conf-sanity test 104b: Mount uses last flock argument ========================================================== 01:16:02 (1789190162) [ 4401.695051] Lustre: DEBUG MARKER: == conf-sanity test 105: check file creation for ro and rw bind mnt pt ========================================================== 01:16:05 (1789190165) [ 4413.921924] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4413.925710] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4413.927038] Lustre: Skipped 2 previous similar messages [ 4413.931218] Lustre: Skipped 9 previous similar messages [ 4419.138724] Lustre: server umount lustre-OST0000 complete [ 4420.581546] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4424.162034] LustreError: 258754:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4424.167320] LustreError: 258754:0:(ldlm_lib.c:1199:target_handle_connect()) Skipped 2 previous similar messages [ 4426.847274] Lustre: server umount lustre-MDT0000 complete [ 4428.158867] LustreError: 257180:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789190192 with bad export cookie 7580403683774097804 [ 4428.159670] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4428.165466] LustreError: 257180:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 4434.352846] Lustre: server umount lustre-MDT0001 complete [ 4437.951243] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing unload_modules_local [ 4516.319098] Lustre: lustre-OST0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 4516.374401] Lustre: server umount lustre-OST0001 complete [ 4518.332412] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_hostid [ 4524.165925] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 4534.953258] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4535.032177] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 4535.041421] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 4535.076910] Lustre: lustre-MDT0000: new disk, initializing [ 4535.097113] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4535.099222] Lustre: Skipped 3 previous similar messages [ 4535.103988] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 4536.390335] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 4540.232591] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4540.272645] Lustre: 264465:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 4540.378204] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 4541.704805] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 4545.154424] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 4546.925962] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 4549.251429] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4549.358303] Lustre: 266432:0:(osd_compat.c:1354:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 4550.723918] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 4550.767811] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 4551.572486] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 4556.575898] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 4560.865319] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4560.869090] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4560.874694] Lustre: Skipped 4 previous similar messages [ 4560.877861] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4560.883079] Lustre: Skipped 8 previous similar messages [ 4566.344586] Lustre: server umount lustre-OST0000 complete [ 4571.105057] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4574.936572] Lustre: server umount lustre-MDT0000 complete [ 4576.748048] LustreError: 264498:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4576.757677] LustreError: 264498:0:(ldlm_lib.c:1199:target_handle_connect()) Skipped 3 previous similar messages [ 4577.311761] LustreError: 264455:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789190341 with bad export cookie 7580403683774099274 [ 4577.312396] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4577.320064] LustreError: 264455:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 4577.542891] Lustre: server umount lustre-MDT0001 complete [ 4585.154542] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing unload_modules_local [ 4586.733360] Key type lgssc unregistered [ 4586.918515] LNet: 268187:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4586.921438] LNetError: 268187:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4586.932511] LNet: Removed LNI 192.168.201.158@tcp [ 4587.341143] Key type .llcrypt unregistered [ 4587.342986] Key type ._llcrypt unregistered [ 4598.517274] Key type ._llcrypt registered [ 4598.518823] Key type .llcrypt registered [ 4598.562728] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 4598.933937] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4598.964073] alg: No test for adler32 (adler32-zlib) [ 4599.829674] Lustre: Lustre: Build Version: 2.17.58_40_g357d090 [ 4599.939961] LNet: Added LNI 192.168.201.158@tcp [8/256/0/180] [ 4601.519173] Key type lgssc registered [ 4601.977485] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4605.002051] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4605.010529] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4606.222150] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4607.786205] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 4611.296807] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4611.477791] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4613.133762] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 4615.839367] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 4617.733979] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 4620.320956] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4620.496318] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4622.788904] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 4625.920797] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 4626.347173] Lustre: Setting parameter lustre-OST0000.ost.unknown_param=50 in log lustre-OST0000 [ 4631.264918] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4631.268014] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4633.322344] Lustre: server umount lustre-OST0000 complete [ 4636.640788] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4636.649073] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4636.653919] Lustre: Skipped 2 previous similar messages [ 4641.147449] Lustre: server umount lustre-MDT0000 complete [ 4641.761021] LustreError: 269619:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4641.767777] LustreError: 269619:0:(ldlm_lib.c:1199:target_handle_connect()) Skipped 3 previous similar messages [ 4642.653413] LustreError: 269603:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789190407 with bad export cookie 5366537735256241930 [ 4642.656695] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4642.657438] LustreError: 269603:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4642.791800] Lustre: server umount lustre-MDT0001 complete [ 4646.784423] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing unload_modules_local [ 4647.940094] Key type lgssc unregistered [ 4648.079378] LNet: 273201:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4648.082048] LNetError: 273201:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4648.088330] LNet: Removed LNI 192.168.201.158@tcp [ 4648.405837] Key type .llcrypt unregistered [ 4648.407304] Key type ._llcrypt unregistered [ 4655.705024] Key type ._llcrypt registered [ 4655.706247] Key type .llcrypt registered [ 4655.753979] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 4656.030803] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4656.089811] alg: No test for adler32 (adler32-zlib) [ 4656.951755] Lustre: Lustre: Build Version: 2.17.58_40_g357d090 [ 4657.045172] LNet: Added LNI 192.168.201.158@tcp [8/256/0/180] [ 4658.632108] Key type lgssc registered [ 4659.102116] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4662.728950] Lustre: lustre-OST0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4662.735765] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4678.175512] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 4683.295298] LustreError: 274376:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.201.158@tcp: failed processing log, type 4: rc = -110 [ 4709.921041] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4712.518554] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 4715.584899] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 4716.487562] Lustre: server umount lustre-OST0000 complete [ 4723.902677] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing unload_modules_local [ 4725.155184] Key type lgssc unregistered [ 4725.311395] LNet: 276004:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4725.315043] LNetError: 276004:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4725.324634] LNet: Removed LNI 192.168.201.158@tcp [ 4725.673440] Key type .llcrypt unregistered [ 4725.675580] Key type ._llcrypt unregistered [ 4742.317951] Key type ._llcrypt registered [ 4742.319874] Key type .llcrypt registered [ 4742.360878] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 4742.668417] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4742.712050] alg: No test for adler32 (adler32-zlib) [ 4743.584262] Lustre: Lustre: Build Version: 2.17.58_40_g357d090 [ 4743.689674] LNet: Added LNI 192.168.201.158@tcp [8/256/0/180] [ 4745.279192] Key type lgssc registered [ 4745.688924] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4750.571991] loop0: detected capacity change from 0 to 204800000 [ 4750.648763] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 4750.653516] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 4750.789132] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 4751.159561] loop0: detected capacity change from 0 to 204800000 [ 4751.220703] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 4751.225555] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 4751.368022] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 4751.761020] loop0: detected capacity change from 0 to 204800000 [ 4751.877021] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 4751.881662] blk_update_request: operation not supported error, dev loop0, sector 8224 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 4751.931720] blk_update_request: operation not supported error, dev loop0, sector 58264 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 4752.396162] loop0: detected capacity change from 0 to 204800000 [ 4752.504374] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 4752.940737] loop0: detected capacity change from 0 to 204800000 [ 4752.953374] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 4754.375532] loop0: detected capacity change from 0 to 204800000 [ 4754.388719] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 4755.780900] loop0: detected capacity change from 0 to 204800000 [ 4755.790064] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 4757.199423] loop0: detected capacity change from 0 to 204800000 [ 4757.218264] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 4758.687315] loop0: detected capacity change from 0 to 204800000 [ 4758.716159] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4758.730820] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4758.766050] Lustre: 279385:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 4758.770410] Lustre: 279385:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index 'nodemap' with [0x200000003:0x3:0x0]: rc = 0 [ 4758.775065] Lustre: 279385:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000-MDT0000' with [0x200000005:0x1:0x0]: rc = 0 [ 4758.779639] Lustre: 279385:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000003:0xa:0x0]: rc = 0 [ 4758.785396] Lustre: 279385:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000-MDT0000' with [0x200000005:0x3:0x0]: rc = 0 [ 4758.789338] Lustre: 279385:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000003:0xb:0x0]: rc = 0 [ 4758.793460] Lustre: 279385:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000-MDT0000' with [0x200000005:0x2:0x0]: rc = 0 [ 4758.797886] Lustre: 279385:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000003:0xc:0x0]: rc = 0 [ 4758.803607] Lustre: 279385:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x20000' with [0x200000006:0x20000:0x0]: rc = 0 [ 4758.807788] Lustre: 279385:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2020000' with [0x200000006:0x2020000:0x0]: rc = 0 [ 4758.813368] Lustre: 279385:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1020000' with [0x200000006:0x1020000:0x0]: rc = 0 [ 4758.817856] Lustre: 279385:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000006:0x10000:0x0]: rc = 0 [ 4758.821805] Lustre: 279385:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000006:0x1010000:0x0]: rc = 0 [ 4758.827671] Lustre: 279385:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000006:0x2010000:0x0]: rc = 0 [ 4761.671788] Lustre: server umount MGS complete [ 4762.018850] loop0: detected capacity change from 0 to 204800000 [ 4762.051834] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4762.251176] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4762.269077] Lustre: lustre-MDT0000: Aborting client recovery [ 4762.616747] loop1: detected capacity change from 0 to 204800000 [ 4762.660245] LDISKFS-fs (loop1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4762.708954] Lustre: 279816:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 4762.713552] Lustre: 279816:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x10000-MDT0001' with [0x200000005:0x1:0x0]: rc = 0 [ 4762.717876] Lustre: 279816:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x10000' with [0x200000003:0x4:0x0]: rc = 0 [ 4762.722377] Lustre: 279816:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x2010000-MDT0001' with [0x200000005:0x3:0x0]: rc = 0 [ 4762.726509] Lustre: 279816:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x1010000-MDT0001' with [0x200000005:0x2:0x0]: rc = 0 [ 4762.730629] Lustre: 279816:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x1010000' with [0x200000003:0x5:0x0]: rc = 0 [ 4762.734894] Lustre: 279816:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x2010000' with [0x200000003:0x6:0x0]: rc = 0 [ 4762.743447] Lustre: Found index 1 for lustre-MDT0001, updating log [ 4762.810862] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4762.829720] Lustre: lustre-MDT0001: Aborting client recovery [ 4763.206328] loop2: detected capacity change from 0 to 204800000 [ 4763.248095] LDISKFS-fs (loop2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4763.286373] Lustre: 279897:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 4763.291759] Lustre: 279897:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 4763.296834] Lustre: 279897:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x1020000-OST0000' with [0x200000005:0x2:0x0]: rc = 0 [ 4763.300952] Lustre: 279897:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 4763.306342] Lustre: 279897:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x20000-OST0000' with [0x200000005:0x1:0x0]: rc = 0 [ 4763.310469] Lustre: 279897:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 4763.314637] Lustre: 279897:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x2020000-OST0000' with [0x200000005:0x3:0x0]: rc = 0 [ 4763.375939] Lustre: Found index 0 for lustre-OST0000, updating log [ 4763.386773] Lustre: 279916:0:(osd_compat.c:1354:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 4763.409403] Lustre: lustre-OST0000: Aborting recovery [ 4763.727908] loop3: detected capacity change from 0 to 204800000 [ 4763.771871] LDISKFS-fs (loop3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4763.806061] Lustre: 279983:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 4763.810833] Lustre: 279983:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 4763.815740] Lustre: 279983:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x1020000-OST0001' with [0x200000005:0x2:0x0]: rc = 0 [ 4763.821432] Lustre: 279983:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 4763.826332] Lustre: 279983:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x20000-OST0001' with [0x200000005:0x1:0x0]: rc = 0 [ 4763.830804] Lustre: 279983:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 4763.834449] Lustre: 279983:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x2020000-OST0001' with [0x200000005:0x3:0x0]: rc = 0 [ 4763.865064] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 4763.867388] Lustre: Skipped 1 previous similar message [ 4769.254644] LustreError: 279760:0:(lod_dev.c:511:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 7, retries 0, failed: rc = -108 [ 4772.320747] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 4772.321065] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 4772.332342] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000bd0 [ 4772.333666] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000bd0 [ 4773.348406] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:5 to 0x280000400:33) [ 4773.348418] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:5 to 0x2c0000400:33) [ 4775.377430] LustreError: 279726:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0000: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0000 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0000/identity_upcall, time 229us: rc = -2 [ 4788.703953] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4788.704147] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4788.704270] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4788.708571] Lustre: Skipped 3 previous similar messages [ 4792.788937] Lustre: server umount lustre-MDT0000 complete [ 4793.082432] LustreError: 279708:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789190557 with bad export cookie 13674954049537926467 [ 4793.083812] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4793.086043] LustreError: 279708:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4793.823526] LustreError: 279724:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4793.823659] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4793.823849] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 4793.823853] Lustre: Skipped 3 previous similar messages [ 4793.831358] LustreError: 279724:0:(ldlm_lib.c:1199:target_handle_connect()) Skipped 3 previous similar messages [ 4793.835290] Lustre: Skipped 1 previous similar message [ 4798.943865] LustreError: 279725:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4798.943876] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 4798.943883] Lustre: Skipped 1 previous similar message [ 4798.949551] LustreError: 279725:0:(ldlm_lib.c:1199:target_handle_connect()) Skipped 1 previous similar message [ 4799.334599] Lustre: server umount lustre-MDT0001 complete [ 4805.761666] Lustre: server umount lustre-OST0000 complete [ 4812.183660] Lustre: server umount lustre-OST0001 complete [ 4814.811813] Lustre: DEBUG MARKER: == conf-sanity test 108c: mkfs.lustre --mmp option enables MMP feature ========================================================== 01:22:58 (1789190578) [ 4822.043947] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 4851.617222] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4851.694377] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 4851.705798] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 4851.744142] Lustre: lustre-MDT0000: new disk, initializing [ 4851.768342] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4851.775568] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 4853.163613] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 4856.286215] Lustre: server umount lustre-MDT0000 complete [ 4862.219432] Lustre: DEBUG MARKER: == conf-sanity test 109a: test lctl clear_conf fsname ==== 01:23:46 (1789190626) [ 4871.983381] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_hostid [ 4875.364909] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 4887.745198] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4887.863073] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 4887.875934] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 4887.878423] Lustre: Skipped 1 previous similar message [ 4887.913650] Lustre: lustre-MDT0000: new disk, initializing [ 4887.938576] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4887.946828] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 4889.336708] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 4893.789244] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4893.840242] Lustre: 287083:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 4893.867453] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 4893.869586] Lustre: Skipped 1 previous similar message [ 4893.903227] Lustre: lustre-MDT0001: new disk, initializing [ 4893.959377] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 4893.963365] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 4895.458685] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 4899.429678] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 4901.270942] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 4903.711830] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4903.825137] Lustre: lustre-OST0000: new disk, initializing [ 4903.827290] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 4903.830484] Lustre: 289051:0:(osd_compat.c:1354:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 4903.833531] Lustre: 289051:0:(osd_compat.c:1354:osd_object_spec_find()) Skipped 1 previous similar message [ 4903.870477] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4903.873602] Lustre: Skipped 1 previous similar message [ 4905.154028] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 4905.158083] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 4905.196504] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 4906.174942] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 4910.227375] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 4912.868796] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 4923.439212] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 4929.566227] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 4977.120551] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4977.120654] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4977.122816] LustreError: Skipped 1 previous similar message [ 4977.123517] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4977.127640] Lustre: Skipped 1 previous similar message [ 4982.224466] Lustre: server umount lustre-OST0000 complete [ 4986.335939] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4986.339074] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4986.343337] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4986.345643] Lustre: Skipped 1 previous similar message [ 4989.660146] Lustre: server umount lustre-MDT0000 complete [ 4990.963367] LustreError: 289050:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789190755 with bad export cookie 13674954049537929414 [ 4990.966912] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4990.967352] LustreError: 289050:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4991.100912] Lustre: server umount lustre-MDT0001 complete [ 4993.908263] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4995.368878] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 4997.046302] Lustre: server umount MGS complete [ 5000.797235] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5000.974697] LustreError: 293152:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5000.981495] LustreError: 293165:0:(qmt_pool.c:1639:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 5001.004038] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5002.437909] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 5005.445356] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5006.919271] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 5009.346525] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 5011.223477] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 5013.560323] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5015.660221] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 5018.062220] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 5050.847844] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 5050.851037] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5050.854230] Lustre: Skipped 1 previous similar message [ 5050.855992] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5050.857508] Lustre: Skipped 2 previous similar messages [ 5055.502367] Lustre: server umount lustre-OST0000 complete [ 5056.992741] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5056.995704] LustreError: Skipped 1 previous similar message [ 5067.231951] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5067.234146] Lustre: Skipped 7 previous similar messages [ 5071.327125] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 5071.383036] Lustre: server umount lustre-MDT0000 complete [ 5072.353132] LustreError: 293153:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5072.359506] LustreError: 293153:0:(ldlm_lib.c:1199:target_handle_connect()) Skipped 1 previous similar message [ 5072.606291] LustreError: 293133:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789190837 with bad export cookie 13674954049537931248 [ 5072.608842] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5072.610939] LustreError: 293133:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 5072.728232] Lustre: server umount lustre-MDT0001 complete [ 5076.200728] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing unload_modules_local [ 5077.220233] Key type lgssc unregistered [ 5077.353281] LNet: 297114:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5077.355224] LNetError: 297114:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5077.361270] LNet: Removed LNI 192.168.201.158@tcp [ 5077.669526] Key type .llcrypt unregistered [ 5077.670710] Key type ._llcrypt unregistered [ 5090.041945] Key type ._llcrypt registered [ 5090.042816] Key type .llcrypt registered [ 5090.081093] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_hostid [ 5096.198504] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 5096.576219] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5096.616247] alg: No test for adler32 (adler32-zlib) [ 5097.492443] Lustre: Lustre: Build Version: 2.17.58_40_g357d090 [ 5097.588634] LNet: Added LNI 192.168.201.158@tcp [8/256/0/180] [ 5099.167246] Key type lgssc registered [ 5099.483411] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5110.782656] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5110.792769] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5111.876320] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 5111.886151] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 5111.923704] Lustre: lustre-MDT0000: new disk, initializing [ 5111.944119] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5111.950863] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 5113.249971] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 5117.265095] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5117.306175] Lustre: 301039:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 5117.327619] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 5117.329382] Lustre: Skipped 1 previous similar message [ 5117.362444] Lustre: lustre-MDT0001: new disk, initializing [ 5117.394783] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5117.407460] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 5117.411144] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 5118.733275] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 5122.343029] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 5124.017373] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 5126.278957] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5126.389344] Lustre: lustre-OST0000: new disk, initializing [ 5126.391312] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 5126.394228] Lustre: 303005:0:(osd_compat.c:1354:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 5126.426053] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5128.307589] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 5132.093851] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 5135.863312] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 5135.866624] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 5135.907146] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 5140.688639] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 5145.870344] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 5151.720178] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 5157.194421] Lustre: Modifying parameter lustre-client.llite.max_read_ahead_mb=64 in log lustre-client [ 5202.400631] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 5202.401580] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5202.402977] LustreError: Skipped 1 previous similar message [ 5202.403582] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5202.406329] Lustre: Skipped 1 previous similar message [ 5204.046669] Lustre: server umount lustre-OST0000 complete [ 5207.520507] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5207.521201] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5207.524037] Lustre: Skipped 1 previous similar message [ 5207.525720] Lustre: Skipped 1 previous similar message [ 5211.342621] Lustre: server umount lustre-MDT0000 complete [ 5212.562988] LustreError: 301032:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789190977 with bad export cookie 8078179274960763581 [ 5212.566432] LustreError: 301032:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 5212.566531] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5212.682185] Lustre: server umount lustre-MDT0001 complete [ 5215.420481] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5216.776816] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 5218.385147] Lustre: server umount MGS complete [ 5222.004432] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5222.172177] LustreError: 306927:0:(qmt_pool.c:1639:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 5222.192407] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5223.525666] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 5226.515294] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5226.635570] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5227.998251] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 5230.288546] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 5232.006533] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 5234.177334] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5236.131266] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 5238.417359] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 5267.426176] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5267.427679] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 5267.430760] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5267.435626] Lustre: Skipped 2 previous similar messages [ 5272.545294] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5272.546953] Lustre: Skipped 1 previous similar message [ 5273.421378] Lustre: server umount lustre-OST0000 complete [ 5277.664626] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5277.665410] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5277.668694] Lustre: Skipped 2 previous similar messages [ 5277.673607] Lustre: Skipped 1 previous similar message [ 5280.797219] Lustre: server umount lustre-MDT0000 complete [ 5281.975676] LustreError: 306896:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789191046 with bad export cookie 8078179274960765408 [ 5281.976150] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5281.978768] LustreError: 306896:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 5282.087162] Lustre: server umount lustre-MDT0001 complete [ 5285.317227] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing unload_modules_local [ 5286.302399] Key type lgssc unregistered [ 5286.416332] LNet: 310874:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5286.418474] LNetError: 310874:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5286.428269] LNet: Removed LNI 192.168.201.158@tcp [ 5286.711239] Key type .llcrypt unregistered [ 5286.712605] Key type ._llcrypt unregistered [ 5293.267985] Key type ._llcrypt registered [ 5293.269763] Key type .llcrypt registered [ 5293.311450] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_hostid [ 5299.029607] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 5299.332234] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5299.356535] alg: No test for adler32 (adler32-zlib) [ 5300.208520] Lustre: Lustre: Build Version: 2.17.58_40_g357d090 [ 5300.300625] LNet: Added LNI 192.168.201.158@tcp [8/256/0/180] [ 5301.879150] Key type lgssc registered [ 5302.214757] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5309.791099] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 5314.826561] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5314.831483] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5315.911635] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 5315.921029] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 5315.954543] Lustre: lustre-MDT0000: new disk, initializing [ 5315.973971] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5315.980436] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 5317.293494] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 5321.326187] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5321.420069] Lustre: lustre-OST0000: new disk, initializing [ 5321.422621] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 5321.425340] Lustre: Skipped 1 previous similar message [ 5321.428273] Lustre: 314889:0:(osd_compat.c:1354:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 5321.452994] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5322.944134] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 5322.946846] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 5322.956194] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 5323.280753] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 5487.072160] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5487.075735] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5492.162689] Lustre: server umount lustre-MDT0000 complete [ 5493.283290] LustreError: 314077:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789191257 with bad export cookie 1796190100438000890 [ 5493.285154] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5493.286095] LustreError: 314077:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 5493.335622] Lustre: server umount lustre-OST0000 complete [ 5500.856851] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_hostid [ 5503.802406] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 5515.270789] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5515.348818] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 5515.359430] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 5515.390920] Lustre: lustre-MDT0000: new disk, initializing [ 5515.409540] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5515.415597] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 5516.673421] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 5520.566971] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5520.602047] Lustre: 319119:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 5520.619491] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 5520.620981] Lustre: Skipped 1 previous similar message [ 5520.651081] Lustre: lustre-MDT0001: new disk, initializing [ 5520.677777] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5520.687830] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 5520.692502] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 5521.887499] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 5525.423141] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 5527.101463] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 5529.214556] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5529.305761] Lustre: lustre-OST0000: new disk, initializing [ 5529.307338] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 5529.309384] Lustre: 321085:0:(osd_compat.c:1354:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 5529.332210] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5530.870840] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 5530.873357] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 5530.907099] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 5531.134697] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 5534.624364] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 5535.879103] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 5535.944717] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 5537.219945] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 5537.286948] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 5539.922231] Lustre: server umount lustre-OST0000 complete [ 5541.344813] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5541.344933] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5541.345558] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5541.354415] Lustre: Skipped 1 previous similar message [ 5546.464186] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5546.467015] Lustre: Skipped 2 previous similar messages [ 5550.590853] Lustre: server umount lustre-MDT0000 complete [ 5551.924817] LustreError: 319913:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789191316 with bad export cookie 1796190100440941667 [ 5551.927906] LustreError: 319913:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 5551.928853] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5562.387965] Lustre: server umount lustre-MDT0001 complete [ 5563.781538] Lustre: DEBUG MARKER: SKIP: conf-sanity test_111 skipping SLOW test 111 [ 5564.347235] Lustre: DEBUG MARKER: == conf-sanity test 112a: mount OST with no_create option ========================================================== 01:35:28 (1789191328) [ 5566.615145] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5566.751904] LustreError: 323395:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5566.758838] LustreError: 323395:0:(ldlm_lib.c:1199:target_handle_connect()) Skipped 3 previous similar messages [ 5566.774669] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5568.055609] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 5570.791174] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5572.290403] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 5574.517040] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 5576.316145] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 5578.575846] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5580.548917] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 5582.854796] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 5585.097942] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5585.159195] Lustre: lustre-OST0001: new disk, initializing [ 5585.161293] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 5585.164436] Lustre: 326228:0:(osd_compat.c:1354:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 5585.193503] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 5585.196100] Lustre: Skipped 2 previous similar messages [ 5585.909898] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 5585.913476] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 5585.927101] LustreError: 326362:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 5586.976943] LustreError: 326362:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 5586.981469] LustreError: 326362:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 2 previous similar messages [ 5587.128065] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 5588.002320] LustreError: 326362:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 5588.005409] LustreError: 326362:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 1 previous similar message [ 5590.050151] LustreError: 326362:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 5590.055084] LustreError: 326362:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 3 previous similar messages [ 5590.800204] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 5592.909146] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 2 sec [ 5594.145852] LustreError: 326362:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 5594.148838] LustreError: 326362:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 7 previous similar messages [ 5594.608130] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff904fe0133000.ost_server_uuid 50 [ 5595.074935] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff904fe0133000.ost_server_uuid in FULL state after 0 sec [ 5596.782811] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff904fe0133000.ost_server_uuid 50 [ 5597.261751] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-ffff904fe0133000.ost_server_uuid in FULL state after 0 sec [ 5598.247744] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 5609.956103] Lustre: lustre-OST0001: Not available for connect from 192.168.201.58@tcp (stopping) [ 5612.517820] Lustre: lustre-OST0001-osc-MDT0001: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5612.523042] Lustre: Skipped 1 previous similar message [ 5615.068827] Lustre: lustre-OST0001: Not available for connect from 192.168.201.58@tcp (stopping) [ 5615.070701] Lustre: Skipped 2 previous similar messages [ 5623.263101] Lustre: lustre-OST0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 5623.296733] Lustre: server umount lustre-OST0001 complete [ 5626.847988] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 5626.850030] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5626.853462] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5626.855025] Lustre: Skipped 5 previous similar messages [ 5627.873757] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 5627.875281] LustreError: 326874:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5627.881654] LustreError: 326874:0:(ldlm_lib.c:1199:target_handle_connect()) Skipped 1 previous similar message [ 5630.869523] Lustre: server umount lustre-OST0000 complete [ 5632.479791] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5632.481793] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5632.484485] Lustre: Skipped 1 previous similar message [ 5643.232189] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5643.234695] Lustre: Skipped 7 previous similar messages [ 5646.303100] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 5646.371263] Lustre: server umount lustre-MDT0000 complete [ 5647.602686] LustreError: 323376:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789191412 with bad export cookie 1796190100440942535 [ 5647.603665] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5647.606420] LustreError: 323376:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 5647.740966] Lustre: server umount lustre-MDT0001 complete [ 5651.367518] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing unload_modules_local [ 5652.351964] Key type lgssc unregistered [ 5652.480292] LNet: 328927:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5652.482682] LNetError: 328927:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5652.489268] LNet: Removed LNI 192.168.201.158@tcp [ 5652.787770] Key type .llcrypt unregistered [ 5652.789247] Key type ._llcrypt unregistered [ 5661.938294] Key type ._llcrypt registered [ 5661.939239] Key type .llcrypt registered [ 5661.980331] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 5662.280014] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5662.299801] alg: No test for adler32 (adler32-zlib) [ 5663.157682] Lustre: Lustre: Build Version: 2.17.58_40_g357d090 [ 5663.254467] LNet: Added LNI 192.168.201.158@tcp [8/256/0/180] [ 5664.831219] Key type lgssc registered [ 5665.186543] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5667.692795] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5667.699228] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5668.834307] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5670.110528] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 5672.332801] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 5674.563809] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5674.703227] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5676.181919] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 5679.391393] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5679.525963] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5681.268209] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 5683.624173] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 5684.643397] LustreError: 331998:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5684.651706] LustreError: 331998:0:(ldlm_lib.c:1199:target_handle_connect()) Skipped 2 previous similar messages [ 5685.932690] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5686.011580] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 5688.015744] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 5690.378969] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 5694.441719] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:65) [ 5694.442311] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:33) [ 5698.383243] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing wait_import_state (FULL|IDLE) os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [ 5698.452311] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 5776.355962] LustreError: lustre-OST0001-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 5776.356743] Lustre: lustre-OST0001-osc-MDT0001: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5776.358976] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 5776.361665] Lustre: Skipped 1 previous similar message [ 5779.704962] Lustre: server umount lustre-OST0001 complete [ 5781.472409] LustreError: 333660:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5781.474421] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5781.475515] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 5781.476669] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5781.476674] Lustre: Skipped 1 previous similar message [ 5781.477057] LustreError: 333660:0:(ldlm_lib.c:1199:target_handle_connect()) Skipped 1 previous similar message [ 5781.481092] Lustre: Skipped 1 previous similar message [ 5786.593070] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5786.594111] LustreError: 333660:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5786.595852] Lustre: Skipped 2 previous similar messages [ 5786.600084] LustreError: 333660:0:(ldlm_lib.c:1199:target_handle_connect()) Skipped 1 previous similar message [ 5787.335580] Lustre: server umount lustre-OST0000 complete [ 5791.712750] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5791.713522] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5791.716105] Lustre: Skipped 1 previous similar message [ 5791.718785] Lustre: Skipped 1 previous similar message [ 5794.662650] Lustre: server umount lustre-MDT0000 complete [ 5795.967629] LustreError: 330301:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789191560 with bad export cookie 11859393415587344360 [ 5795.972607] LustreError: 330301:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 5795.972943] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5796.115707] Lustre: server umount lustre-MDT0001 complete [ 5799.471861] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing unload_modules_local [ 5800.471291] Key type lgssc unregistered [ 5800.594557] LNet: 335262:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5800.596966] LNetError: 335262:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5800.608243] LNet: Removed LNI 192.168.201.158@tcp [ 5800.888209] Key type .llcrypt unregistered [ 5800.889277] Key type ._llcrypt unregistered [ 5817.992641] Key type ._llcrypt registered [ 5817.993457] Key type .llcrypt registered [ 5818.026136] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 5818.426522] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5818.435162] alg: No test for adler32 (adler32-zlib) [ 5819.289709] Lustre: Lustre: Build Version: 2.17.58_40_g357d090 [ 5819.374120] LNet: Added LNI 192.168.201.158@tcp [8/256/0/180] [ 5820.951133] Key type lgssc registered [ 5821.302637] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5824.174550] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5824.180136] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5825.307518] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5826.540811] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 5829.197863] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5829.324343] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5830.735572] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 5831.711591] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 5833.881426] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5833.995955] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5835.043187] LustreError: 339009:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5835.047329] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:97) [ 5835.049479] LustreError: 339009:0:(ldlm_lib.c:1199:target_handle_connect()) Skipped 2 previous similar messages [ 5835.823869] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 5838.523160] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5838.606674] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 5839.658478] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:65) [ 5840.491414] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 5844.582914] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 5849.137750] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 5855.202261] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5855.204744] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5855.206291] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5855.206947] Lustre: Skipped 3 previous similar messages [ 5855.209595] Lustre: Skipped 2 previous similar messages [ 5858.598287] Lustre: server umount lustre-MDT0000 complete [ 5859.866545] LustreError: 337503:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789191624 with bad export cookie 5908184918043998088 [ 5859.870069] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5859.870308] LustreError: 337503:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 5859.989295] Lustre: server umount lustre-MDT0001 complete [ 5871.553127] Lustre: server umount lustre-OST0000 complete [ 5882.978986] Lustre: server umount lustre-OST0001 complete [ 5888.117945] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 5891.391119] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5891.512754] LustreError: 342777:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5891.527645] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5892.768447] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 5895.363312] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5896.750142] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 5897.709936] Lustre: 343917:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 5900.006222] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5900.143027] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5900.145141] Lustre: Skipped 1 previous similar message [ 5901.155963] LustreError: 344271:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5901.160019] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:129) [ 5902.175283] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 5904.797287] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5905.898990] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:97) [ 5906.737027] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 5909.794423] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 5910.904987] Lustre: 345785:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 5916.131225] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5916.131679] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5916.133533] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5916.140571] Lustre: Skipped 2 previous similar messages [ 5917.904735] Lustre: server umount lustre-MDT0000 complete [ 5919.042170] LustreError: 342759:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789191683 with bad export cookie 5908184918043999747 [ 5919.045395] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5919.046850] LustreError: 342759:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 5919.145729] Lustre: server umount lustre-MDT0001 complete [ 5930.428504] Lustre: server umount lustre-OST0000 complete [ 5940.762561] Lustre: server umount lustre-OST0001 complete [ 5941.858980] Lustre: DEBUG MARKER: SKIP: conf-sanity test_114 skipping SLOW test 114 [ 5942.314929] Lustre: DEBUG MARKER: SKIP: conf-sanity test_115 skipping excluded test 115 [ 5942.798741] Lustre: DEBUG MARKER: == conf-sanity test 116: big size MDT support ============ 01:41:47 (1789191707) [ 5950.252919] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 5953.350332] loop0: detected capacity change from 0 to 1099511627776 [ 5953.528881] SGI XFS with ACLs, security attributes, quota, no debug enabled [ 5953.531589] *** VALIDATE xfs *** [ 5953.536517] XFS (loop0): Mounting V5 Filesystem [ 5953.544983] XFS (loop0): Ending clean mount [ 5953.952343] loop1: detected capacity change from 0 to 18691697672192 [ 5973.755284] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_hostid [ 5976.702665] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 5987.190687] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5987.262901] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 5987.271641] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 5987.303042] Lustre: lustre-MDT0000: new disk, initializing [ 5987.321210] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5987.323128] Lustre: Skipped 1 previous similar message [ 5987.328523] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 5988.490657] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 5992.312286] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5992.355568] Lustre: 350900:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 5992.381042] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 5992.382931] Lustre: Skipped 1 previous similar message [ 5992.417336] Lustre: lustre-MDT0001: new disk, initializing [ 5992.461649] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 5992.465051] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 5993.751544] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 5997.430030] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 5999.233490] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 6001.509673] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6001.609788] Lustre: lustre-OST0000: new disk, initializing [ 6001.612758] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 6001.615666] Lustre: 352868:0:(osd_compat.c:1354:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 6003.450174] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 6003.453549] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 6003.488755] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 6003.578774] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 6007.421608] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 6008.915855] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 6008.998122] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 6010.481879] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 6010.562559] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 6013.923887] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 6013.924711] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6013.926195] LustreError: Skipped 1 previous similar message [ 6013.930308] Lustre: Skipped 1 previous similar message [ 6013.932271] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6013.936504] Lustre: Skipped 4 previous similar messages [ 6017.297171] Lustre: server umount lustre-OST0000 complete [ 6019.041137] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6019.041887] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6019.049503] Lustre: Skipped 1 previous similar message [ 6024.160141] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6024.163514] Lustre: Skipped 2 previous similar messages [ 6024.729420] Lustre: server umount lustre-MDT0000 complete [ 6025.998083] LustreError: 350890:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789191790 with bad export cookie 5908184918044001280 [ 6026.001089] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6026.002221] LustreError: 350890:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 6026.116847] Lustre: server umount lustre-MDT0001 complete [ 6028.899947] XFS (loop0): Unmounting Filesystem [ 6030.557854] Lustre: DEBUG MARKER: == conf-sanity test 117: lctl get_param return errors properly ========================================================== 01:43:14 (1789191794) [ 6032.837202] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6032.999284] LustreError: 355420:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6033.026512] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6033.030401] Lustre: Skipped 2 previous similar messages [ 6034.412871] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 6037.295021] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6038.865764] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 6041.290969] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 6043.131361] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 6045.411346] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6047.725647] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 6050.309326] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 6067.167781] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 6067.170023] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6067.174051] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6070.288142] Lustre: server umount lustre-OST0000 complete [ 6073.311905] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 6073.314517] LustreError: Skipped 1 previous similar message [ 6077.654740] Lustre: server umount lustre-MDT0000 complete [ 6078.928667] LustreError: 355403:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789191843 with bad export cookie 5908184918044002162 [ 6078.933219] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6078.934144] LustreError: 355403:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 6079.075604] Lustre: server umount lustre-MDT0001 complete [ 6082.968847] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing unload_modules_local [ 6084.166225] Key type lgssc unregistered [ 6084.316457] LNet: 359067:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6084.319197] LNetError: 359067:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6084.327489] LNet: Removed LNI 192.168.201.158@tcp [ 6084.726123] Key type .llcrypt unregistered [ 6084.727044] Key type ._llcrypt unregistered [ 6095.053994] Key type ._llcrypt registered [ 6095.055379] Key type .llcrypt registered [ 6095.103735] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 6095.552184] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6095.605087] alg: No test for adler32 (adler32-zlib) [ 6096.469203] Lustre: Lustre: Build Version: 2.17.58_40_g357d090 [ 6096.565383] LNet: Added LNI 192.168.201.158@tcp [8/256/0/180] [ 6098.151159] Key type lgssc registered [ 6098.558374] Lustre: Echo OBD driver; http://www.lustre.org/ [ 6101.250354] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 6101.256994] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6102.392764] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6103.818425] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 6106.548457] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6106.675993] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6107.986283] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 6110.330889] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 6112.091619] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 6114.368801] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6114.500814] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6116.417990] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 6118.831320] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 6133.218211] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6133.222211] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 6133.224666] Lustre: Skipped 1 previous similar message [ 6134.754849] Lustre: lustre-MDT0001: Not available for connect from 192.168.201.58@tcp (stopping) [ 6138.336994] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 6138.339730] Lustre: Skipped 1 previous similar message [ 6138.389884] Lustre: server umount lustre-MDT0001 complete [ 6139.868875] LustreError: 360600:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.201.58@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6139.873649] LustreError: 360600:0:(ldlm_lib.c:1199:target_handle_connect()) Skipped 2 previous similar messages [ 6141.753890] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6141.790447] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [ 6141.792262] Lustre: Found index 1 for lustre-MDT0001, updating log [ 6141.804179] Lustre: 360593:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 6141.914078] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6143.253258] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 6147.051274] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 6152.171426] LustreError: 364487:0:(obd_mount.c:234:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [ 6152.175696] LustreError: 364487:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [ 6152.180928] LustreError: 360598:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [ 6152.200128] LustreError: 364490:0:(obd_config.c:2102:class_config_llog_handler()) MGC192.168.201.158@tcp: cfg command failed: rc = -17 [ 6152.204680] Lustre: cmd=cf001 0:lustre-MDT0001-osp-MDT0000 1:osp 2:lustre-MDT0000-mdtlov_UUID [ 6152.204680] [ 6447.072767] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6447.074905] Lustre: lustre-MDT0001: Not available for connect from 192.168.201.58@tcp (stopping) [ 6447.079014] Lustre: Skipped 1 previous similar message [ 6451.282619] Lustre: server umount lustre-MDT0001 complete [ 6452.188581] LustreError: 360601:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.201.58@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6454.815294] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6454.847505] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [ 6454.849414] Lustre: Found index 1 for lustre-MDT0001, updating log [ 6454.863515] Lustre: 360596:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 6454.991832] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6456.407512] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 6460.393284] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 6464.486352] LustreError: 377111:0:(obd_mount.c:234:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [ 6464.488710] LustreError: 377111:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [ 6464.491349] LustreError: 360598:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [ 6464.493313] LustreError: 360598:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [ 6464.509056] LustreError: 377114:0:(obd_config.c:761:class_setup()) osp: device 8 already setup: rc = -17 [ 6464.511117] LustreError: 377114:0:(obd_config.c:866:class_detach()) OBD device 8 still set up [ 6464.512858] LustreError: 377114:0:(obd_config.c:2102:class_config_llog_handler()) MGC192.168.201.158@tcp: cfg command failed: rc = -17 [ 6464.515246] Lustre: cmd=cf003 0:lustre-MDT0001-osp-MDT0000 1:lustre-MDT0001_UUID 2:192.168.201.158@tcp [ 6464.515246] [ 6759.399732] Lustre: lustre-MDT0001: Not available for connect from 192.168.201.58@tcp (stopping) [ 6759.403325] Lustre: Skipped 2 previous similar messages [ 6762.465953] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [ 6762.466072] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6762.474710] Lustre: Skipped 2 previous similar messages [ 6764.499151] Lustre: server umount lustre-MDT0001 complete [ 6764.508628] LustreError: 362038:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.201.58@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6764.514915] LustreError: 362038:0:(ldlm_lib.c:1199:target_handle_connect()) Skipped 2 previous similar messages [ 6767.586235] LustreError: 371020:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6767.593869] LustreError: 371020:0:(ldlm_lib.c:1199:target_handle_connect()) Skipped 1 previous similar message [ 6767.938626] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6767.970722] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [ 6767.973388] Lustre: Found index 1 for lustre-MDT0001, updating log [ 6767.989159] Lustre: 360595:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 6768.098194] Lustre: lustre-MDT0001: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [ 6769.414846] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 6773.223416] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 6775.782531] LustreError: 389650:0:(obd_mount.c:234:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [ 6775.785810] LustreError: 389650:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [ 6775.789139] LustreError: 360598:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [ 6775.790940] LustreError: 360598:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [ 6775.808027] LustreError: 389653:0:(lod_lov.c:208:lod_add_device()) lustre-MDT0001-osp-MDT0000: cannot connect to next dev lustre-MDT0001_UUID (-114) [ 6775.813203] LustreError: 389653:0:(obd_config.c:2102:class_config_llog_handler()) MGC192.168.201.158@tcp: cfg command failed: rc = -114 [ 6775.816225] Lustre: cmd=cf014 0:lustre-MDT0000-mdtlov 1:lustre-MDT0001_UUID 2:1 3:1 [ 6775.816225] [ 7085.538168] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7085.541536] Lustre: Skipped 2 previous similar messages [ 7085.542161] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7085.542902] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7085.544657] Lustre: Skipped 4 previous similar messages [ 7089.303069] Lustre: server umount lustre-MDT0000 complete [ 7090.474140] LustreError: 363811:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789192854 with bad export cookie 15372381270231560037 [ 7090.478068] LustreError: 363811:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 7090.478398] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7090.655852] LustreError: 370417:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7090.656129] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7096.617447] Lustre: server umount lustre-MDT0001 complete [ 7097.874084] Lustre: server umount lustre-OST0000 complete [ 7100.604435] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_hostid [ 7103.680308] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 7115.142424] Lustre: DEBUG MARKER: == conf-sanity test 120: cross-target rename should not create bad symlinks ========================================================== 02:01:19 (1789192879) [ 7117.288700] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7117.381309] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 7117.392563] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 7117.441649] Lustre: lustre-MDT0000: new disk, initializing [ 7117.464749] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7117.470618] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 7118.798059] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 7122.883192] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7122.929209] Lustre: 404256:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 7122.954322] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 7122.956031] Lustre: Skipped 1 previous similar message [ 7122.991352] Lustre: lustre-MDT0001: new disk, initializing [ 7123.024754] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7123.036957] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 7123.040104] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 7124.337180] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 7128.006245] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 7129.803463] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 7132.000514] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7132.109987] Lustre: lustre-OST0000: new disk, initializing [ 7132.111568] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 7132.113850] Lustre: 406224:0:(osd_compat.c:1354:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 7132.146996] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7134.119432] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug -1 all [ 7136.191254] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 7136.194576] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 7136.237054] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 7137.844500] Lustre: DEBUG MARKER: oleg158-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 7141.345488] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7141.347227] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7141.348598] Lustre: Skipped 2 previous similar messages [ 7141.351150] Lustre: Skipped 4 previous similar messages [ 7146.524137] Lustre: server umount lustre-MDT0000 complete [ 7147.748113] LustreError: 404247:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789192912 with bad export cookie 15372381270231561976 [ 7147.750469] LustreError: 405062:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0000-osp-MDT0001: osp_attr_get update error [0x200000401:0x2:0x0]: rc = -5 [ 7147.751385] LustreError: MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7147.751586] LustreError: 404247:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 7147.863815] Lustre: server umount lustre-MDT0001 complete [ 7159.450355] Lustre: server umount lustre-OST0000 complete [ 7168.253505] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing set_hostid [ 7171.390800] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local [ 7182.253824] Lustre: DEBUG MARKER: == conf-sanity test complete, duration 6884 sec ========== 02:02:26 (1789192946) [ 7182.870176] Lustre: DEBUG MARKER: === conf-sanity: start cleanup 02:02:26 (1789192946) === [ 7183.889500] Lustre: DEBUG MARKER: === conf-sanity: finish cleanup 02:02:28 (1789192948) === [ 7198.542442] Lustre: DEBUG MARKER: oleg158-server.virtnet: executing unload_modules_local [ 7199.551464] Key type lgssc unregistered [ 7199.676393] LNet: 412573:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7199.679078] LNetError: 412573:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7199.688391] LNet: Removed LNI 192.168.201.158@tcp [ 7200.034815] Key type .llcrypt unregistered [ 7200.036793] Key type ._llcrypt unregistered