[ 0.000000] Linux version 4.18.0rh8.10-debug (green@maintenance) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-26) (GCC)) #2 SMP Mon Jul 14 01:24:22 EDT 2025 [ 0.000000] Command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffcdfff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffce000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x0000000146dfffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.8 present. [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 [ 0.000000] Hypervisor detected: KVM [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 415641824 cycles [ 0.000000] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns [ 0.000000] tsc: Detected 2399.998 MHz processor [ 0.000000] last_pfn = 0x146e00 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0xbffce max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000f54b0-0x000f54bf] [ 0.000000] RAMDISK: [mem 0xbcc54000-0xbffbffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F52D0 000014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 0x00000000BFFE247C 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 0x00000000BFFE2318 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 0x00000000BFFE0040 0022D8 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 0x00000000BFFE0000 000040 [ 0.000000] ACPI: APIC 0x00000000BFFE238C 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: HPET 0x00000000BFFE241C 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: WAET 0x00000000BFFE2454 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0xbffe2318-0xbffe238b] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe2317] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0xbffe238c-0xbffe241b] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0xbffe241c-0xbffe2453] [ 0.000000] ACPI: Reserving WAET table memory at [mem 0xbffe2454-0xbffe247b] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x0000000146dfffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x1465a3000-0x1465cdfff] [ 0.000000] Reserving 256MB of memory at 2752MB for crashkernel (System RAM: 4205MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009efff] [ 0.000000] node 0: [mem 0x0000000000100000-0x00000000bffcdfff] [ 0.000000] node 0: [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Zeroed struct page in unavailable ranges: 4756 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x0000000146dfffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] TSC deadline timer available [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] kvm-guest: KVM setup pv remote TLB flush [ 0.000000] kvm-guest: setup PV sched yield [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbffce000-0xbfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.000000] [mem 0xc0000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u524288 [ 0.000000] kvm-guest: PV spinlocks enabled [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1059606 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] audit: disabled (until reboot) [ 0.000000] software IO TLB: area num 4. [ 0.000000] Memory: 2829652K/4306352K available (18435K kernel code, 11221K rwdata, 7248K rodata, 2908K init, 18040K bss, 524580K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] ftrace: allocating 41240 entries in 162 pages [ 0.000000] ftrace: allocated 162 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU event tracing is enabled. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=4. [ 0.000000] rcu: RCU callback double-/use-after-free debug enabled. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 [ 0.000000] NR_IRQS: 524544, nr_irqs: 456, preallocated irqs: 16 [ 0.000000] random: get_random_bytes called from start_kernel+0x622/0x9a8 with crng_init=0 [ 0.001000] Console: colour *CGA 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns [ 0.001012] APIC: Switch to symmetric I/O mode setup [ 0.002426] x2apic enabled [ 0.003005] Switched APIC routing to physical x2apic. [ 0.004007] kvm-guest: setup PV IPIs [ 0.006000] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.006000] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 0.006013] Calibrating delay loop (skipped) preset value.. 4799.99 BogoMIPS (lpj=2399998) [ 0.007005] pid_max: default: 32768 minimum: 301 [ 0.008094] LSM: Security Framework initializing [ 0.009029] Yama: becoming mindful. [ 0.009785] SELinux: Initializing. [ 0.010037] *** VALIDATE selinux *** [ 0.018758] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, vmalloc) [ 0.022129] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc) [ 0.023136] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.024102] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.025082] *** VALIDATE tmpfs *** [ 0.026385] *** VALIDATE proc *** [ 0.027160] *** VALIDATE cgroup *** [ 0.028004] *** VALIDATE cgroup2 *** [ 0.029195] x86/cpu: User Mode Instruction Prevention (UMIP) activated [ 0.030099] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.031004] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 [ 0.032017] Spectre V2 : User space: Vulnerable [ 0.033004] Speculative Store Bypass: Vulnerable [ 0.035621] debug: unmapping init [mem 0xffffffff8d059000-0xffffffff8d060fff] [ 0.037155] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (family: 0x6, model: 0x3e, stepping: 0x4) [ 0.038694] Performance Events: IvyBridge events, full-width counters, Intel PMU driver. [ 0.039013] ... version: 2 [ 0.040008] ... bit width: 48 [ 0.041008] ... generic registers: 4 [ 0.042022] ... value mask: 0000ffffffffffff [ 0.043006] ... max period: 00007fffffffffff [ 0.044006] ... fixed-purpose events: 3 [ 0.044845] ... event mask: 000000070000000f [ 0.045238] rcu: Hierarchical SRCU implementation. [ 0.047139] smp: Bringing up secondary CPUs ... [ 0.048368] x86: Booting SMP configuration: [ 0.049017] .... node #0, CPUs: #1 #2 #3 [ 0.051675] smp: Brought up 1 node, 4 CPUs [ 0.053006] smpboot: Max logical packages: 1 [ 0.054009] smpboot: Total of 4 processors activated (19199.98 BogoMIPS) [ 0.150299] node 0 deferred pages initialised in 95ms [ 0.152576] devtmpfs: initialized [ 0.153223] x86/mm: Memory block size: 128MB [ 0.155739] gcov: version magic: 0x41383552 [ 0.157060] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.158052] futex hash table entries: 1024 (order: 4, 65536 bytes, vmalloc) [ 0.159235] pinctrl core: initialized pinctrl subsystem [ 0.160173] [ 0.160798] ************************************************************* [ 0.161007] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.162007] ** ** [ 0.163008] ** IOMMU DebugFS SUPPORT HAS BEEN ENABLED IN THIS KERNEL ** [ 0.164007] ** ** [ 0.165007] ** This means that this kernel is built to expose internal ** [ 0.166007] ** IOMMU data structures, which may compromise security on ** [ 0.167007] ** your system. ** [ 0.168007] ** ** [ 0.169008] ** If you see this message and you are not debugging the ** [ 0.170007] ** kernel, report this immediately to your vendor! ** [ 0.171007] ** ** [ 0.172009] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.173010] ************************************************************* [ 0.174677] NET: Registered protocol family 16 [ 0.175456] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations [ 0.176075] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.177061] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.178403] cpuidle: using governor menu [ 0.184099] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.187543] PCI: Using configuration type 1 for base access [ 0.190123] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.199117] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.200021] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.201129] cryptd: max_cpu_qlen set to 1000 [ 0.204807] ACPI: Added _OSI(Module Device) [ 0.206007] ACPI: Added _OSI(Processor Device) [ 0.207008] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.208007] ACPI: Added _OSI(Processor Aggregator Device) [ 0.211185] ACPI: 1 ACPI AML tables successfully acquired and loaded [ 0.217663] ACPI: Interpreter enabled [ 0.219050] ACPI: PM: (supports S0 S3 S4 S5) [ 0.220008] ACPI: Using IOAPIC for interrupt routing [ 0.222098] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.226400] ACPI: Enabled 2 GPEs in block 00 to 0F [ 0.237849] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.240024] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3] [ 0.243016] acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI] [ 0.246068] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.251494] acpiphp: Slot [2] registered [ 0.253096] acpiphp: Slot [5] registered [ 0.255101] acpiphp: Slot [6] registered [ 0.256089] acpiphp: Slot [7] registered [ 0.258107] acpiphp: Slot [8] registered [ 0.259099] acpiphp: Slot [9] registered [ 0.261123] acpiphp: Slot [10] registered [ 0.262084] acpiphp: Slot [3] registered [ 0.264066] acpiphp: Slot [4] registered [ 0.265080] acpiphp: Slot [11] registered [ 0.267085] acpiphp: Slot [12] registered [ 0.268068] acpiphp: Slot [13] registered [ 0.270106] acpiphp: Slot [14] registered [ 0.272066] acpiphp: Slot [15] registered [ 0.273065] acpiphp: Slot [16] registered [ 0.275069] acpiphp: Slot [17] registered [ 0.276077] acpiphp: Slot [18] registered [ 0.278073] acpiphp: Slot [19] registered [ 0.279064] acpiphp: Slot [20] registered [ 0.281085] acpiphp: Slot [21] registered [ 0.282077] acpiphp: Slot [22] registered [ 0.284071] acpiphp: Slot [23] registered [ 0.285065] acpiphp: Slot [24] registered [ 0.287049] acpiphp: Slot [25] registered [ 0.288079] acpiphp: Slot [26] registered [ 0.289050] acpiphp: Slot [27] registered [ 0.289992] acpiphp: Slot [28] registered [ 0.291060] acpiphp: Slot [29] registered [ 0.292034] acpiphp: Slot [30] registered [ 0.292983] acpiphp: Slot [31] registered [ 0.293049] PCI host bridge to bus 0000:00 [ 0.294010] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.296008] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.298009] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.299009] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 0.301009] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] [ 0.303010] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.304125] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.306781] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.308836] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 0.318893] pci 0000:00:01.1: reg 0x20: [io 0xc320-0xc32f] [ 0.323955] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.325009] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.327009] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.329007] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.330547] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 0.333966] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 0.337024] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 0.339846] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 [ 0.343011] pci 0000:00:02.0: reg 0x10: [io 0xc300-0xc31f] [ 0.354012] pci 0000:00:02.0: reg 0x20: [mem 0xe0000000000-0xe0000003fff 64bit pref] [ 0.359009] pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 0.364105] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 [ 0.372012] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] [ 0.379013] pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] [ 0.394017] pci 0000:00:05.0: reg 0x20: [mem 0xe0000004000-0xe0000007fff 64bit pref] [ 0.404149] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 [ 0.410012] pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] [ 0.415013] pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 0.427016] pci 0000:00:06.0: reg 0x20: [mem 0xe0000008000-0xe000000bfff 64bit pref] [ 0.438000] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 [ 0.442009] pci 0000:00:07.0: reg 0x10: [io 0xc100-0xc17f] [ 0.447013] pci 0000:00:07.0: reg 0x14: [mem 0xfebc2000-0xfebc2fff] [ 0.465021] pci 0000:00:07.0: reg 0x20: [mem 0xe000000c000-0xe000000ffff 64bit pref] [ 0.476191] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 [ 0.486032] pci 0000:00:08.0: reg 0x10: [io 0xc180-0xc1ff] [ 0.495032] pci 0000:00:08.0: reg 0x14: [mem 0xfebc3000-0xfebc3fff] [ 0.509017] pci 0000:00:08.0: reg 0x20: [mem 0xe0000010000-0xe0000013fff 64bit pref] [ 0.515990] pci 0000:00:09.0: [1af4:1001] type 00 class 0x010000 [ 0.520009] pci 0000:00:09.0: reg 0x10: [io 0xc200-0xc27f] [ 0.526012] pci 0000:00:09.0: reg 0x14: [mem 0xfebc4000-0xfebc4fff] [ 0.538016] pci 0000:00:09.0: reg 0x20: [mem 0xe0000014000-0xe0000017fff 64bit pref] [ 0.544244] pci 0000:00:0a.0: [1af4:1001] type 00 class 0x010000 [ 0.548011] pci 0000:00:0a.0: reg 0x10: [io 0xc280-0xc2ff] [ 0.551886] pci 0000:00:0a.0: reg 0x14: [mem 0xfebc5000-0xfebc5fff] [ 0.564018] pci 0000:00:0a.0: reg 0x20: [mem 0xe0000018000-0xe000001bfff 64bit pref] [ 0.572286] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 [ 0.575353] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 0.578240] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 [ 0.580213] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 0.582212] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 [ 0.588657] iommu: Default domain type: Passthrough [ 0.590460] SCSI subsystem initialized [ 0.592072] ACPI: bus type USB registered [ 0.593069] usbcore: registered new interface driver usbfs [ 0.595048] usbcore: registered new interface driver hub [ 0.596049] usbcore: registered new device driver usb [ 0.598139] pps_core: LinuxPPS API ver. 1 registered [ 0.599023] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 0.603029] PTP clock support registered [ 0.605104] EDAC MC: Ver: 3.0.0 [ 0.606411] PCI: Using ACPI for IRQ routing [ 0.607456] NetLabel: Initializing [ 0.608000] NetLabel: domain hash size = 128 [ 0.609012] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 0.610053] NetLabel: unlabeled traffic allowed by default [ 0.612104] vgaarb: loaded [ 0.613278] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 0.615010] hpet0: 3 comparators, 64-bit 100.000000 MHz counter [ 0.621041] clocksource: Switched to clocksource kvm-clock [ 0.718262] VFS: Disk quotas dquot_6.6.0 [ 0.719967] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 0.722758] *** VALIDATE ramfs *** [ 0.724132] *** VALIDATE hugetlbfs *** [ 0.725695] pnp: PnP ACPI init [ 0.730164] pnp: PnP ACPI: found 6 devices [ 0.751279] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 0.754058] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 0.755776] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 0.757517] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 0.759309] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 0.761184] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] [ 0.763304] NET: Registered protocol family 2 [ 0.765532] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, vmalloc) [ 0.769038] tcp_listen_portaddr_hash hash table entries: 4096 (order: 5, 163840 bytes, vmalloc) [ 0.771368] TCP established hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.775450] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc) [ 0.778827] TCP: Hash tables configured (established 65536 bind 65536) [ 0.780985] MPTCP token hash table entries: 8192 (order: 6, 393216 bytes, vmalloc) [ 0.783418] UDP hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.786073] UDP-Lite hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.788620] NET: Registered protocol family 1 [ 0.790986] RPC: Registered named UNIX socket transport module. [ 0.792618] RPC: Registered udp transport module. [ 0.793597] RPC: Registered tcp transport module. [ 0.794680] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 0.795910] NET: Registered protocol family 44 [ 0.797072] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 0.798669] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 0.800381] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 0.802127] PCI: CLS 0 bytes, default 64 [ 0.804146] Unpacking initramfs... [ 2.127332] debug: unmapping init [mem 0xffff8fe03cc54000-0xffff8fe03ffbffff] [ 2.131412] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 2.133420] software IO TLB: mapped [mem 0x00000000a8000000-0x00000000ac000000] (64MB) [ 2.135983] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 2.629441] Initialise system trusted keyrings [ 2.631040] Key type blacklist registered [ 2.633362] workingset: timestamp_bits=36 max_order=20 bucket_order=0 [ 2.648224] zbud: loaded [ 2.650459] *** VALIDATE nfs *** [ 2.651715] *** VALIDATE nfs4 *** [ 2.653360] pstore: using deflate compression [ 2.657836] Platform Keyring initialized [ 2.778368] NET: Registered protocol family 38 [ 2.781668] Key type asymmetric registered [ 2.783924] Asymmetric key parser 'x509' registered [ 2.785961] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 2.790492] io scheduler mq-deadline registered [ 2.792497] io scheduler kyber registered [ 2.794129] io scheduler bfq registered [ 2.796046] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 2.798499] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 2.800136] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 2.801747] ACPI: Power Button [PWRF] [ 2.804853] ACPI: \_SB_.LNKB: Enabled at IRQ 10 [ 2.809240] ACPI: \_SB_.LNKA: Enabled at IRQ 11 [ 2.820274] ACPI: \_SB_.LNKC: Enabled at IRQ 11 [ 2.830463] ACPI: \_SB_.LNKD: Enabled at IRQ 10 [ 2.853632] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 2.879651] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 2.905752] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 2.910567] Non-volatile memory driver v1.3 [ 2.912212] Linux agpgart interface v0.103 [ 2.938539] virtio_blk virtio1: [vda] 145176 512-byte logical blocks (74.3 MB/70.9 MiB) [ 2.941078] vda: detected capacity change from 0 to 74330112 [ 2.954533] virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) [ 2.958618] vdb: detected capacity change from 0 to 1073741824 [ 2.975975] virtio_blk virtio3: [vdc] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 2.980689] vdc: detected capacity change from 0 to 2621440000 [ 2.994918] virtio_blk virtio4: [vdd] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 2.998759] vdd: detected capacity change from 0 to 2621440000 [ 3.013101] virtio_blk virtio5: [vde] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 3.017452] vde: detected capacity change from 0 to 4294967296 [ 3.038325] virtio_blk virtio6: [vdf] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 3.042245] vdf: detected capacity change from 0 to 4294967296 [ 3.053113] libphy: Fixed MDIO Bus: probed [ 3.059983] usbcore: registered new interface driver usbserial_generic [ 3.061962] usbserial: USB Serial support registered for generic [ 3.064364] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 3.068600] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 3.070526] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 3.072156] mousedev: PS/2 mouse device common for all mice [ 3.075068] rtc_cmos 00:05: RTC can wake from S4 [ 3.081080] rtc_cmos 00:05: registered as rtc0 [ 3.082585] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 3.084220] intel_pstate: CPU model not supported [ 3.085079] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 3.093868] hid: raw HID events driver (C) Jiri Kosina [ 3.097147] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 [ 3.098717] usbcore: registered new interface driver usbhid [ 3.098720] usbhid: USB HID core driver [ 3.098836] drop_monitor: Initializing network drop monitor service [ 3.098948] Initializing XFRM netlink socket [ 3.099237] NET: Registered protocol family 10 [ 3.102263] Segment Routing with IPv6 [ 3.112264] NET: Registered protocol family 17 [ 3.113626] mpls_gso: MPLS GSO support [ 3.115523] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 [ 3.121650] RAS: Correctable Errors collector initialized. [ 3.123680] AVX version of gcm_enc/dec engaged. [ 3.125347] AES CTR mode by8 optimization enabled [ 3.211193] sched_clock: Marking stable (3211162086, 0)->(3966833609, -755671523) [ 3.214325] registered taskstats version 1 [ 3.217532] Loading compiled-in X.509 certificates [ 3.220124] zswap: loaded using pool lzo/zbud [ 3.248951] Key type big_key registered [ 3.265755] Key type encrypted registered [ 3.267169] ima: No TPM chip found, activating TPM-bypass! [ 3.268843] ima: Allocated hash algorithm: sha1 [ 3.270267] ima: No architecture policies found [ 3.271698] evm: Initialising EVM extended attributes: [ 3.273275] evm: security.selinux [ 3.274277] evm: security.ima [ 3.275236] evm: security.capability [ 3.276356] evm: HMAC attrs: 0x1 [ 3.278927] rtc_cmos 00:05: setting system clock to 2026-07-01 17:40:48 UTC (1782927648) [ 3.285691] debug: unmapping init [mem 0xffffffff8e003000-0xffffffff8e1fffff] [ 3.288551] debug: unmapping init [mem 0xffffffff8cd82000-0xffffffff8d058fff] [ 3.296042] Write protecting the kernel read-only data: 28672k [ 3.299851] debug: unmapping init [mem 0xffffffff8b403000-0xffffffff8b5fffff] [ 3.302733] debug: unmapping init [mem 0xffffffff8bd14000-0xffffffff8bdfffff] [ 3.339929] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 3.348494] systemd[1]: Detected virtualization kvm. [ 3.350723] systemd[1]: Detected architecture x86-64. [ 3.352424] systemd[1]: Running in initial RAM disk. Welcome to Rocky Linux 8.10 (Green Obsidian) dracut-049-233.git20240115.el8 (Initramfs)! [ 3.378849] systemd[1]: No hostname configured. [ 3.381088] systemd[1]: Set hostname to . [ 3.383188] random: systemd: uninitialized urandom read (16 bytes read) [ 3.385359] systemd[1]: Initializing machine ID from random generator. [ 3.435294] random: ln: uninitialized urandom read (6 bytes read) [ 3.555391] random: systemd: uninitialized urandom read (16 bytes read) [ 3.557828] systemd[1]: Reached target Slices. [ OK ] Reached target Slices. [ 3.564152] systemd[1]: Reached target Initrd Root Device. [ OK ] Reached target Initrd Root Device. [ 3.571586] systemd[1]: Reached target Timers. [ OK ] Reached target Timers. [ OK ] Reached target Local File Systems. [ OK ] Listening on Journal Socket. Starting Setup Virtual Console... [ OK ] Started Memstrack Anylazing Service. [ OK ] Listening on udev Kernel Socket. Starting Apply Kernel Variables... [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Paths. [ OK ] Listening on udev Control Socket. Starting Create list of required st…ce nodes for the current kernel... Starting Create Volatile Files and Directories... [ OK ] Listening on Journal Socket (/dev/log). Starting Journal Service... [ OK ] Reached target Sockets. [ OK ] Reached target Swap. [ OK ] Started Setup Virtual Console. [ OK ] Started Apply Kernel Variables. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Create Volatile Files and Directories. Starting Create Static Device Nodes in /dev... Starting dracut cmdline hook... [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started Journal Service. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ 4.352925] device-mapper: uevent: version 1.0.3 [ 4.355413] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting dracut pre-trigger hook... [ OK ] Started dracut pre-trigger hook. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. Starting dracut initqueue hook... [ OK ] Reached target System Initialization. [ OK ] Reached target Basic System. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. [ 5.649950] virtio_net virtio0 ens2: renamed from eth0 [ 5.766615] random: fast init done [ 6.097211] scsi host0: ata_piix [ 6.278170] scsi host1: ata_piix [ 6.279662] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc320 irq 14 [ 6.281927] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc328 irq 15 [ 10.796098] random: crng init done [ 10.797490] random: 7 urandom warning(s) missed due to ratelimiting [ 10.996922] dracut-initqueue[583]: RTNETLINK answers: File exists Starting nbd nbd0... [ OK ] Started nbd nbd0. [ OK ] Started dracut initqueue hook. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Mounting /sysroot... [ 12.288465] EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... Stopping Hardware RNG Entropy Gatherer Daemon... [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped target Timers. [ OK ] Stopped Hardware RNG Entropy Gatherer Daemon. [ OK ] Stopped target Basic System. [ OK ] Stopped target Paths. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Local Encrypted Volumes. [ OK ] Stopped Dispatch Password Requests to Console Directory Watch. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped dracut pre-trigger hook. Stopping udev Kernel Device Manager... [ OK ] Stopped target Swap. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped target Local File Systems. [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped target Slices. [ OK ] Stopped target Sockets. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Reached target Switch Root. Starting Switch Root... [ 14.003970] printk: systemd: 26 output lines suppressed due to ratelimiting [ 14.410977] SELinux: Disabled at runtime. [ 14.484950] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 14.509524] systemd[1]: Detected virtualization kvm. [ 14.516469] systemd[1]: Detected architecture x86-64. Welcome to Rocky Linux 8.10 (Green Obsidian)! [ 15.245427] systemd[1]: initrd-switch-root.service: Succeeded. [ 15.252854] systemd[1]: Stopped Switch Root. [ OK ] Stopped Switch Root. [ 15.260734] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. [ 15.266414] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 15.273318] systemd[1]: Stopped Journal Service. [ OK ] Stopped Journal Service. [ 15.281928] systemd[1]: Starting Journal Service... Starting Journal Service... [ 15.295019] systemd[1]: Mounting Kernel Debug File System... Mounting Kernel Debug File System... [ OK ] Listening on udev Kernel Socket. Mounting Huge Pages File System... [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd Root File System. [ OK ] Created slice User and Session Slice. [ OK ] Reached target Slices. [ OK ] Listening on initctl Compatibility Named Pipe. Starting Create list of required st…ce nodes for the current kernel... [ OK ] Listening on Process Core Dump Socket. [FAILED] Failed to set up automount Arbitrar…rmats File System Automount Point. See 'systemctl status proc-sys-fs-binfmt_misc.automount' for details. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. Mounting POSIX Message Queue File System... Activating swap /dev/disk/by-label/SWAP... [ OK ] Reached target rpc_pipefs.target. [ OK ] Created slice system-getty.slice. [ OK ] Created slice system-serial\x2dgetty.slice. [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Reached target Paths. [ OK ] Reached target Local Encrypted Volumes. [ 15.459283] Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS [ OK ] Created slice system-sshd\x2dkeygen.slice. Starting Remount Root and Kernel File Systems... [ OK ] Listening on udev Control Socket. Starting udev Coldplug all Devices... [ OK ] Stopped target Initrd File Systems. Starting Apply Kernel Variables... [ OK ] Started Journal Service. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Huge Pages File System. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Activated swap /dev/disk/by-label/SWAP. [FAILED] Failed to start Remount Root and Kernel File Systems. See 'systemctl status systemd-remount-fs.service' for details. [ OK ] Started Apply Kernel Variables. Starting Configure read-only root support... [ OK ] Reached target Swap. Starting Create Static Device Nodes in /dev... Starting Flush Journal to Persistent Storage... [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started Create Static Device Nodes in /dev. Starting udev Kernel Device Manager... [ OK ] Reached target Local File Systems (Pre). Mounting /home/green/git/lustre-release... Mounting /mnt... [ OK ] Started udev Coldplug all Devices. [ OK ] Mounted /mnt. [ 15.938277] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ OK ] Mounted /home/green/git/lustre-release. [ OK ] Started udev Kernel Device Manager. [ 16.346113] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 16.424570] input: PC Speaker as /devices/platform/pcspkr/input/input5 [ 16.610975] RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer [ 16.641949] EDAC sbridge: Ver: 1.1.2 [ 19.298601] Key type dns_resolver registered [ 19.786884] NFS: Registering the id_resolver key type [ 19.791393] Key type id_resolver registered [ 19.793147] Key type id_legacy registered [ OK ] Started Configure read-only root support. Starting Load/Save Random Seed... [ OK ] Reached target Local File Systems. Starting Create Volatile Files and Directories... Starting Mark the need to relabel after reboot... Starting Rebuild Dynamic Linker Cache... [ OK ] Started Load/Save Random Seed. [ OK ] Started Mark the need to relabel after reboot. [ OK ] Started Create Volatile Files and Directories. Starting Update UTMP about System Boot/Shutdown... Starting RPC Bind... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Started RPC Bind. [ OK ] Started Rebuild Dynamic Linker Cache. Starting Update is Completed... [ OK ] Started Update is Completed. [ OK ] Reached target System Initialization. [ OK ] Started dnf makecache --timer. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Reached target Timers. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. [ OK ] Started D-Bus System Message Bus. Starting Restore /run/initramfs on shutdown... [ OK ] Started Hardware RNG Entropy Gatherer Daemon. Starting Login Service... Starting Network Manager... [ OK ] Started irqbalance daemon. [ OK ] Reached target sshd-keygen.target. [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Login Service. [ OK ] Started Network Manager. Starting Network Manager Wait Online... [ OK ] Reached target Network. Starting OpenSSH server daemon... Starting Dynamic System Tuning Daemon... Starting GSSAPI Proxy Daemon... Starting Hostname Service... [ OK ] Started OpenSSH server daemon. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Started Permit User Sessions. [ OK ] Started Serial Getty on ttyS1. [ OK ] Started Serial Getty on ttyS0. [ OK ] Started Getty on tty1. [ OK ] Reached target Login Prompts. [ OK ] Started Command Scheduler. [ OK ] Started Hostname Service. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... Starting Notify NFS peers of a restart... Starting System Logging Service... [ OK ] Started Notify NFS peers of a restart. [ OK ] Started System Logging Service. Starting Authorization Manager... [ OK ] Started Dynamic System Tuning Daemon. [ OK ] Reached target Multi-User System. [ OK ] Reached target Graphical Interface. Starting Update UTMP about System Runlevel Changes... [ OK ] Started Update UTMP about System Runlevel Changes. [ OK ] Started Authorization Manager. Rocky Linux 8.10 (Green Obsidian) Kernel 4.18.0rh8.10-debug on an x86_64 oleg348-server login: [ 44.324124] libcfs: loading out-of-tree module taints kernel. [ 44.339951] Key type ._llcrypt registered [ 44.341173] Key type .llcrypt registered [ 44.375022] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_hostid [ 52.350730] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 52.937757] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 52.945535] alg: No test for adler32 (adler32-zlib) [ 53.972677] Lustre: Lustre: Build Version: 2.17.54_83_g6b808a3 [ 54.345747] LNet: Added LNI 192.168.203.148@tcp [8/256/0/180] [ 55.967149] Key type lgssc registered [ 56.617225] Lustre: Echo OBD driver; http://www.lustre.org/ [ 62.955156] ZFS: Loaded module v2.3.2-1, ZFS pool version 5000, ZFS filesystem version 5 [ 76.346962] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 80.540471] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 80.549279] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 81.629613] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 81.640761] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 81.672747] Lustre: lustre-MDT0000: new disk, initializing [ 81.690869] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 81.696238] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 82.906366] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 87.679486] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 87.712957] Lustre: 6479:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 87.724687] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 87.726368] Lustre: Skipped 1 previous similar message [ 87.759296] Lustre: lustre-MDT0001: new disk, initializing [ 87.777428] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 87.785839] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 87.789932] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 88.968557] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 91.093908] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 94.039370] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 94.126228] Lustre: lustre-OST0000: new disk, initializing [ 94.127901] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 94.130091] Lustre: 8417:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 94.146694] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 95.928386] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 95.982472] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 95.985421] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 96.011319] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 101.009918] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 101.056113] Lustre: lustre-OST0001: new disk, initializing [ 101.057940] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 101.059864] Lustre: 9490:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 101.077364] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 102.974891] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 104.746350] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 104.750527] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 104.762792] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 108.575581] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 115.090134] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 116.918466] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing check_logdir /tmp/testlogs/ [ 118.286082] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing yml_node [ 119.545917] Lustre: DEBUG MARKER: Client: 2.17.54.83 [ 120.304886] Lustre: DEBUG MARKER: MDS: 2.17.54.83 [ 121.058699] Lustre: DEBUG MARKER: OSS: 2.17.54.83 [ 121.553576] Lustre: DEBUG MARKER: -----============= acceptance-small: conf-sanity ============----- Wed Jul 1 13:42:45 EDT 2026 [ 126.804130] Lustre: DEBUG MARKER: excepting tests: 102 106 115 32newtarball [ 127.305866] Lustre: DEBUG MARKER: skipping tests SLOW=no: 45 69 106 111 114 [ 139.231506] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 139.235537] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 139.241167] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 140.767516] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 140.768128] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 145.048065] Lustre: server umount lustre-MDT0000 complete [ 146.210667] LustreError: 6472:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782927791 with bad export cookie 9557425922443897059 [ 146.211736] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 146.215978] LustreError: 6472:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 151.007408] LustreError: 6486:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 151.007616] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 151.007777] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 151.007780] Lustre: Skipped 3 previous similar messages [ 151.014484] LustreError: 6486:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 6 previous similar messages [ 151.022545] Lustre: Skipped 3 previous similar messages [ 152.357700] Lustre: server umount lustre-MDT0001 complete [ 153.665452] Lustre: server umount lustre-OST0000 complete [ 154.968750] Lustre: server umount lustre-OST0001 complete [ 157.079700] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_hostid [ 160.050649] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 171.599468] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 171.684484] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 171.695344] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 171.732621] Lustre: lustre-MDT0000: new disk, initializing [ 171.760516] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 171.767893] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 173.057852] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 177.206905] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 177.262017] Lustre: 15029:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 177.379940] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 178.878414] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 182.637457] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 184.405439] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 186.667802] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 186.766987] Lustre: lustre-OST0000: new disk, initializing [ 186.768206] Lustre: Skipped 1 previous similar message [ 186.769596] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 186.771606] Lustre: Skipped 2 previous similar messages [ 186.773498] Lustre: 16995:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 186.802773] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 186.805563] Lustre: Skipped 1 previous similar message [ 188.217729] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 188.220317] Lustre: Skipped 1 previous similar message [ 188.222486] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 188.259136] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 188.721218] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 192.330148] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 193.748988] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 193.829376] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 195.276581] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 195.349933] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 198.624501] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 198.625850] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 198.627921] LustreError: Skipped 1 previous similar message [ 198.636505] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 198.640511] Lustre: Skipped 2 previous similar messages [ 202.131594] Lustre: server umount lustre-OST0000 complete [ 203.744107] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 203.748386] Lustre: Skipped 1 previous similar message [ 203.750561] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 208.351831] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 209.493870] Lustre: server umount lustre-MDT0000 complete [ 210.702257] LustreError: 15021:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782927855 with bad export cookie 9557425922443898578 [ 210.705608] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 210.706111] LustreError: 15021:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 210.813699] Lustre: server umount lustre-MDT0001 complete [ 212.330917] Lustre: DEBUG MARKER: == conf-sanity test 76a: set permanent params with lctl across mounts ========================================================== 13:44:16 (1782927856) [ 214.505044] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 214.665397] LustreError: 19257:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 214.687691] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 216.004663] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 219.030893] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 220.579861] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 223.006234] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 224.711989] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 226.913855] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 229.030255] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 231.354744] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 243.759252] Lustre: Modifying parameter general.osc.*.max_dirty_mb=452 in log params [ 249.824562] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 249.827454] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 249.830988] Lustre: Skipped 1 previous similar message [ 249.833188] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 249.836317] Lustre: Skipped 2 previous similar messages [ 252.957395] Lustre: server umount lustre-MDT0000 complete [ 254.194089] LustreError: 19239:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782927899 with bad export cookie 9557425922443899460 [ 254.197593] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 254.198543] LustreError: 19239:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 254.312971] Lustre: server umount lustre-MDT0001 complete [ 265.815219] Lustre: server umount lustre-OST0000 complete [ 272.275167] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 275.952176] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 276.083061] LustreError: 23654:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 276.095275] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 276.097311] Lustre: Skipped 2 previous similar messages [ 277.370357] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 280.115082] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 281.555777] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 282.498724] Lustre: Setting parameter general.debug_raw_pointers=Y in log params [ 284.623765] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 286.637443] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 289.395589] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 289.457270] Lustre: lustre-OST0001: new disk, initializing [ 289.458909] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 289.461860] Lustre: 25963:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 290.813024] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 290.817625] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 290.846190] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 291.423522] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 295.675058] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 301.024586] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 301.028591] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 301.032248] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 301.033976] Lustre: Skipped 5 previous similar messages [ 301.035888] Lustre: Skipped 5 previous similar messages [ 305.687856] Lustre: server umount lustre-MDT0000 complete [ 306.145596] LustreError: 23654:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 306.153116] LustreError: 23654:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 306.876935] LustreError: 23636:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782927952 with bad export cookie 9557425922443900307 [ 306.880554] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 306.881526] LustreError: 23636:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 306.982310] Lustre: server umount lustre-MDT0001 complete [ 318.465256] Lustre: server umount lustre-OST0000 complete [ 328.917457] Lustre: server umount lustre-OST0001 complete [ 333.884346] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 337.155430] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 337.273327] LustreError: 28924:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 338.551596] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 341.156840] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 341.290709] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 341.295616] Lustre: Skipped 4 previous similar messages [ 342.633972] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 343.601202] Lustre: 30074:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 345.961927] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 347.106887] LustreError: 30427:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 348.049648] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 351.253528] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 353.538160] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 356.984966] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 358.328757] Lustre: 31950:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 361.953926] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 361.956510] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 361.957134] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 361.961242] Lustre: Skipped 1 previous similar message [ 366.041306] Lustre: server umount lustre-MDT0000 complete [ 367.072463] LustreError: 28919:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 367.077951] LustreError: 28919:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 5 previous similar messages [ 367.254062] LustreError: 31953:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782928012 with bad export cookie 9557425922443901539 [ 367.256913] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 367.258204] LustreError: 31953:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 367.363617] Lustre: server umount lustre-MDT0001 complete [ 378.369495] Lustre: server umount lustre-OST0000 complete [ 389.848456] Lustre: server umount lustre-OST0001 complete [ 392.632958] Lustre: DEBUG MARKER: == conf-sanity test 76b: verify params log setup correctly ========================================================== 13:47:17 (1782928037) [ 401.729484] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 405.087311] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 405.242892] LustreError: 34748:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 406.593981] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 409.493872] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 411.068392] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 412.010284] Lustre: 35896:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 414.129223] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 416.215577] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 419.010305] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 420.989392] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 424.090984] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 425.296243] Lustre: 37774:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 430.047766] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 430.049627] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 430.052588] Lustre: Skipped 1 previous similar message [ 430.054101] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 430.055491] Lustre: Skipped 3 previous similar messages [ 432.657961] Lustre: server umount lustre-MDT0000 complete [ 433.791142] LustreError: 34730:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782928079 with bad export cookie 9557425922443902631 [ 433.794687] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 433.795149] LustreError: 34730:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 433.897707] Lustre: server umount lustre-MDT0001 complete [ 444.867206] Lustre: server umount lustre-OST0000 complete [ 456.348858] Lustre: server umount lustre-OST0001 complete [ 458.997695] Lustre: DEBUG MARKER: == conf-sanity test 76c: verify changelog_mask is applied with lctl set_param -P ========================================================== 13:48:23 (1782928103) [ 463.602405] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 466.718312] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 468.011966] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 470.617286] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 470.763500] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 470.767404] Lustre: Skipped 7 previous similar messages [ 472.063577] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 472.997182] Lustre: 41057:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 475.193569] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 477.377657] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 477.413211] LustreError: 41409:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 477.419253] LustreError: 41409:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 480.293975] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 482.415654] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 485.518386] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 486.989785] Lustre: Setting parameter general.mdd.*.changelog_mask=-CLOSE in log params [ 486.993454] Lustre: Skipped 2 previous similar messages [ 490.210166] Lustre: server umount lustre-MDT0000 complete [ 491.487833] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 491.507472] LustreError: 39888:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782928136 with bad export cookie 9557425922443903723 [ 491.513303] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 491.513695] LustreError: 39888:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 497.718841] Lustre: server umount lustre-MDT0001 complete [ 500.610760] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 502.708016] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 505.540230] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 507.089542] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 509.422507] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 519.159393] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 9 sec [ 520.989884] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 521.062044] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 521.547044] Lustre: DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec [ 528.926446] Lustre: server umount lustre-MDT0000 complete [ 530.170201] LustreError: 39888:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782928175 with bad export cookie 9557425922443904815 [ 530.173695] LustreError: 39888:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 530.173918] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 530.292139] Lustre: server umount lustre-MDT0001 complete [ 541.765209] Lustre: server umount lustre-OST0000 complete [ 553.317270] Lustre: server umount lustre-OST0001 complete [ 556.127639] Lustre: DEBUG MARKER: == conf-sanity test 76d: verify llite.*.xattr_cache can be set by 'lctl set_param -P' correctly ========================================================== 13:50:00 (1782928200) [ 561.229609] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 564.605521] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 565.932472] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 568.498697] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 569.931463] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 570.845311] Lustre: 48679:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 570.850907] Lustre: 48679:0:(mgs_llog.c:1447:mgs_modify_param()) Skipped 1 previous similar message [ 572.800465] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 574.619599] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 577.178270] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 579.123925] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 582.133978] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 583.552359] Lustre: Setting parameter general.llite.*.xattr_cache=0 in log params [ 588.770069] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 588.772923] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 588.774463] Lustre: Skipped 14 previous similar messages [ 588.777518] Lustre: Skipped 16 previous similar messages [ 592.982517] Lustre: server umount lustre-MDT0000 complete [ 594.197202] LustreError: 47510:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782928239 with bad export cookie 9557425922443905634 [ 594.199491] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 594.200517] LustreError: 47510:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 594.304644] Lustre: server umount lustre-MDT0001 complete [ 605.181669] Lustre: server umount lustre-OST0000 complete [ 616.659385] Lustre: server umount lustre-OST0001 complete [ 619.445026] Lustre: DEBUG MARKER: == conf-sanity test 77: comma-separated MGS NIDs and failover node NIDs ========================================================== 13:51:03 (1782928263) [ 620.257864] Lustre: DEBUG MARKER: SKIP: conf-sanity test_77 mixed loopback and real device not working [ 620.819218] Lustre: DEBUG MARKER: == conf-sanity test 78: run resize2fs on MDT and OST filesystems ========================================================== 13:51:05 (1782928265) [ 624.174470] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_hostid [ 626.721065] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 633.714189] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 633.798951] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 633.836822] Lustre: lustre-MDT0000: new disk, initializing [ 633.861897] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 635.208681] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 638.864030] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 641.017252] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 641.125084] Lustre: 54741:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 642.494158] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 642.503294] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 643.072033] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 646.648855] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 647.349263] Lustre: DEBUG MARKER: create test files [ 657.888369] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 657.891673] LustreError: Skipped 1 previous similar message [ 663.239198] Lustre: server umount lustre-OST0000 complete [ 664.532396] Lustre: server umount lustre-MDT0000 complete [ 668.108876] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing unload_modules_local [ 669.180786] Key type lgssc unregistered [ 669.308521] LNet: 56351:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 669.312312] LNetError: 56351:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 669.324383] LNet: Removed LNI 192.168.203.148@tcp [ 669.673145] Key type .llcrypt unregistered [ 669.675267] Key type ._llcrypt unregistered [ 680.059651] Key type ._llcrypt registered [ 680.060901] Key type .llcrypt registered [ 680.097895] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 680.423943] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 680.487555] alg: No test for adler32 (adler32-zlib) [ 681.341212] Lustre: Lustre: Build Version: 2.17.54_83_g6b808a3 [ 681.442567] LNet: Added LNI 192.168.203.148@tcp [8/256/0/180] [ 683.023130] Key type lgssc registered [ 683.412524] Lustre: Echo OBD driver; http://www.lustre.org/ [ 686.023245] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 686.031922] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 687.176127] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 688.505460] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 690.891774] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 693.190797] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 693.306579] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 695.172659] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 697.444650] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:102 to 0x240000400:129) [ 697.466252] Lustre: 59059:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 510 < left 544, rollback = 9 [ 697.469029] Lustre: 59059:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 32/128/5, destroy: 0/0/0 [ 697.471287] Lustre: 59059:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 697.473436] Lustre: 59059:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/18/1, punch: 0/0/0, quota 1/3/0 [ 697.475863] Lustre: 59059:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 697.478053] Lustre: 59059:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 697.542912] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 700.570851] Lustre: DEBUG MARKER: check files after expanding the MDT and OST filesystems [ 702.168040] Lustre: DEBUG MARKER: create more files after expanding the MDT and OST filesystems [ 708.065198] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 708.065451] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 708.070570] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 710.231578] Lustre: server umount lustre-OST0000 complete [ 711.569231] Lustre: server umount lustre-MDT0000 complete [ 715.303222] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing unload_modules_local [ 716.422302] Key type lgssc unregistered [ 716.557385] LNet: 60666:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 716.560436] LNetError: 60666:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 716.572268] LNet: Removed LNI 192.168.203.148@tcp [ 716.867665] Key type .llcrypt unregistered [ 716.869844] Key type ._llcrypt unregistered [ 727.819818] Key type ._llcrypt registered [ 727.820885] Key type .llcrypt registered [ 727.858641] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 728.182850] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 728.227518] alg: No test for adler32 (adler32-zlib) [ 729.083806] Lustre: Lustre: Build Version: 2.17.54_83_g6b808a3 [ 729.181086] LNet: Added LNI 192.168.203.148@tcp [8/256/0/180] [ 730.767166] Key type lgssc registered [ 731.139358] Lustre: Echo OBD driver; http://www.lustre.org/ [ 733.666508] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 733.674866] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 734.811841] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 736.091646] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 738.458557] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 740.663350] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 740.773813] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 742.680082] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 744.870387] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:140 to 0x240000400:161) [ 744.895588] Lustre: 63474:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 509 < left 544, rollback = 9 [ 744.898199] Lustre: 63474:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 32/128/6, destroy: 0/0/0 [ 744.900142] Lustre: 63474:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 744.902373] Lustre: 63474:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/18/1, punch: 0/0/0, quota 1/3/0 [ 744.904438] Lustre: 63474:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 744.906486] Lustre: 63474:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 744.990368] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 747.998439] Lustre: DEBUG MARKER: check files after shrinking the MDT and OST filesystems [ 752.398073] Lustre: server umount lustre-OST0000 complete [ 762.896335] Lustre: server umount lustre-MDT0000 complete [ 766.410348] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing unload_modules_local [ 767.361516] Key type lgssc unregistered [ 767.492385] LNet: 65030:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 767.495048] LNetError: 65030:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 767.502336] LNet: Removed LNI 192.168.203.148@tcp [ 767.824384] Key type .llcrypt unregistered [ 767.825464] Key type ._llcrypt unregistered [ 773.587602] Key type ._llcrypt registered [ 773.588680] Key type .llcrypt registered [ 773.624053] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_hostid [ 779.683766] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 780.001382] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 780.012220] alg: No test for adler32 (adler32-zlib) [ 780.858725] Lustre: Lustre: Build Version: 2.17.54_83_g6b808a3 [ 780.937786] LNet: Added LNI 192.168.203.148@tcp [8/256/0/180] [ 782.519102] Key type lgssc registered [ 782.869656] Lustre: Echo OBD driver; http://www.lustre.org/ [ 793.968077] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 793.973817] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 795.054270] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 795.064426] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 795.099625] Lustre: lustre-MDT0000: new disk, initializing [ 795.121577] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 795.129610] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 796.468905] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 800.495408] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 800.534545] Lustre: 68166:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 800.557437] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 800.560048] Lustre: Skipped 1 previous similar message [ 800.598991] Lustre: lustre-MDT0001: new disk, initializing [ 800.629370] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 800.640132] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 800.644302] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 801.887254] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 805.502138] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 807.269053] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 809.509523] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 809.622455] Lustre: lustre-OST0000: new disk, initializing [ 809.624387] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 809.627683] Lustre: 70131:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 809.683165] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 809.728789] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 809.731627] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 809.740281] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000400 [ 811.574871] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 815.256571] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 816.753954] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 816.833716] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 818.259421] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 818.344310] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 820.192869] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 820.194254] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 820.197439] LustreError: Skipped 1 previous similar message [ 820.203224] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 820.206172] Lustre: Skipped 1 previous similar message [ 821.071745] Lustre: server umount lustre-OST0000 complete [ 825.312835] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 825.313493] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 825.316324] Lustre: Skipped 2 previous similar messages [ 825.319497] Lustre: Skipped 1 previous similar message [ 828.506858] Lustre: server umount lustre-MDT0000 complete [ 829.789270] LustreError: 68160:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782928475 with bad export cookie 15270509570085586466 [ 829.792245] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 829.794438] LustreError: 68160:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 829.916495] Lustre: server umount lustre-MDT0001 complete [ 832.654111] Lustre: DEBUG MARKER: == conf-sanity test 79: format MDT/OST without mgs option (should return errors) ========================================================== 13:54:37 (1782928477) [ 836.014773] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 848.609306] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_hostid [ 851.888538] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 863.888357] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 863.970142] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 863.983294] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 864.017663] Lustre: lustre-MDT0000: new disk, initializing [ 864.037749] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 864.044538] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 865.411320] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 869.515693] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 869.554715] Lustre: 76138:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 869.577257] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 869.579206] Lustre: Skipped 1 previous similar message [ 869.613869] Lustre: lustre-MDT0001: new disk, initializing [ 869.649391] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 869.666111] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 869.670326] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 871.024041] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 874.783705] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 876.457050] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 878.597128] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 878.694086] Lustre: lustre-OST0000: new disk, initializing [ 878.696167] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 878.699221] Lustre: 78109:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 878.725152] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 880.540580] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 883.187628] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 883.189978] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 883.218386] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 883.995472] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 885.273416] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 885.341220] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 886.609494] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 886.676387] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 888.289323] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 888.289518] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 888.294361] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 888.296839] LustreError: Skipped 1 previous similar message [ 889.356280] Lustre: server umount lustre-OST0000 complete [ 893.408694] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 893.409216] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 893.413134] Lustre: Skipped 2 previous similar messages [ 893.417887] Lustre: Skipped 2 previous similar messages [ 896.662025] Lustre: server umount lustre-MDT0000 complete [ 897.849133] LustreError: 76133:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782928543 with bad export cookie 15270509570085587334 [ 897.851656] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 897.852969] LustreError: 76133:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 897.976929] Lustre: server umount lustre-MDT0001 complete [ 900.489202] Lustre: DEBUG MARKER: == conf-sanity test 80: mgc import reconnect race ======== 13:55:44 (1782928544) [ 902.432407] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 902.582590] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 903.753072] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 906.311163] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 907.687048] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 909.919236] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 911.512563] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 913.668029] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 915.593292] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 917.763717] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 918.918382] Lustre: 83179:0:(genops.c:1795:obd_export_evict_by_uuid()) MGS: evicting 8a8a7a89-4657-4edc-b9b9-89fbf6811096 at adminstrative request [ 921.056925] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 921.062491] Lustre: *** cfs_fail_loc=906, val=2147483648*** [ 931.297979] Lustre: MGS: Client 8a8a7a89-4657-4edc-b9b9-89fbf6811096 (at 0@lo) reconnecting [ 931.300078] Lustre: Evicted from MGS (at 0@lo) after server handle changed from 0xd3ebbf8c20278cea to 0xd3ebbf8c20278f59 [ 931.304292] Lustre: MGC192.168.203.148@tcp: Connection restored to 0@lo (at 0@lo) [ 951.412794] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 951.479615] Lustre: lustre-OST0001: new disk, initializing [ 951.481340] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 951.483599] Lustre: 83574:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 951.517374] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 951.519761] Lustre: Skipped 2 previous similar messages [ 953.514384] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 957.013889] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 958.020316] Lustre: server umount lustre-OST0001 complete [ 959.983770] LustreError: 82332:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 959.985325] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 959.986776] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 959.991377] LustreError: 82332:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 959.995849] Lustre: Skipped 1 previous similar message [ 965.091608] LustreError: 83193:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 965.096185] LustreError: 83193:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 965.461597] Lustre: server umount lustre-OST0000 complete [ 968.159949] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 968.163918] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 968.169175] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 968.173969] Lustre: Skipped 5 previous similar messages [ 980.959085] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 981.017438] Lustre: server umount lustre-MDT0000 complete [ 982.225221] LustreError: 82351:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782928627 with bad export cookie 15270509570085588825 [ 982.228912] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 982.229347] LustreError: 82351:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 982.360775] Lustre: server umount lustre-MDT0001 complete [ 985.037995] Lustre: DEBUG MARKER: == conf-sanity test 81: sparse OST indexing ============== 13:57:09 (1782928629) [ 985.562700] Lustre: DEBUG MARKER: SKIP: conf-sanity test_81 needs >= 3 OSTs [ 986.083697] Lustre: DEBUG MARKER: == conf-sanity test 82a: specify OSTs for file (succeed) or directory (succeed) ========================================================== 13:57:10 (1782928630) [ 986.563941] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82a needs >= 3 OSTs [ 987.118916] Lustre: DEBUG MARKER: == conf-sanity test 82b: specify OSTs for file with --pool and --ost-list options ========================================================== 13:57:11 (1782928631) [ 987.608425] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82b needs >= 4 OSTs [ 988.139178] Lustre: DEBUG MARKER: == conf-sanity test 82c: specify sparse OSTs for setstripe (should not crash) ========================================================== 13:57:12 (1782928632) [ 988.624644] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82c needs >= 4 OSTs [ 989.198752] Lustre: DEBUG MARKER: == conf-sanity test 83: ENOSPACE on OST doesn't cause message VFS: Busy inodes after unmount ... ========================================================== 13:57:13 (1782928633) [ 989.730412] Lustre: DEBUG MARKER: mount the OST /dev/mapper/ost1_flakey as a ldiskfs filesystem [ 991.654127] loop: module loaded [ 991.657482] loop0: detected capacity change from 0 to 4294967296 [ 991.669662] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 992.143103] Lustre: DEBUG MARKER: run llverfs in partial mode on the OST ldiskfs /mnt/lustre-ost1 [ 993.183349] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing run_llverfs /mnt/lustre-ost1 -vpl no [ 994.566510] Lustre: DEBUG MARKER: unmount the OST /dev/mapper/ost1_flakey [ 1003.557343] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1003.570467] LustreError: 87687:0:(obd_config.c:845:class_setup()) setup lustre-OST0000-osd failed (-28) [ 1003.574679] LustreError: 87687:0:(obd_mount.c:250:lustre_start_simple()) lustre-OST0000-osd setup error -28 [ 1003.578760] LustreError: 87687:0:(tgt_mount.c:2579:server_fill_super()) Unable to start osd on /dev/mapper/ost1_flakey: -28 [ 1003.583032] LustreError: 87687:0:(super25.c:184:lustre_fill_super()) llite: Unable to mount : rc = -28 [ 1009.453833] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_hostid [ 1012.496353] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 1024.468663] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1024.558443] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1024.569897] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1024.608174] Lustre: lustre-MDT0000: new disk, initializing [ 1024.627404] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1024.632904] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1026.039028] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 1030.204644] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1030.243520] Lustre: 90546:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1030.338701] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1031.723305] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 1035.381396] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1037.105460] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1039.259209] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1039.366220] Lustre: 92512:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1041.243399] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 1044.799856] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1046.123530] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1049.591615] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1049.624843] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1050.261273] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 4 sec [ 1051.608329] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1051.684407] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1054.688687] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1054.689656] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1054.693776] LustreError: Skipped 1 previous similar message [ 1054.698568] Lustre: Skipped 1 previous similar message [ 1054.699313] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1054.704908] Lustre: Skipped 7 previous similar messages [ 1058.381834] Lustre: server umount lustre-OST0000 complete [ 1065.757734] Lustre: server umount lustre-MDT0000 complete [ 1067.014366] LustreError: 94080:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782928712 with bad export cookie 15270509570085589413 [ 1067.017811] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1067.019223] LustreError: 94080:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 1067.150261] Lustre: server umount lustre-MDT0001 complete [ 1069.886451] Lustre: DEBUG MARKER: == conf-sanity test 84: check recovery_hard_time ========= 13:58:34 (1782928714) [ 1072.130062] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1072.291610] LustreError: 94949:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1073.686563] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 1076.547562] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1077.965516] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 1080.370933] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1082.153161] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1084.404728] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1086.453805] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 1088.810975] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1090.231612] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1098.450657] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 8 sec [ 1099.761279] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1099.835611] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1102.050663] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1102.112543] Lustre: lustre-OST0001: new disk, initializing [ 1102.114454] Lustre: Skipped 2 previous similar messages [ 1102.116691] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 1102.119228] Lustre: Skipped 3 previous similar messages [ 1102.120990] Lustre: 98370:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1104.074552] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 1107.719327] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 1109.118598] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid 50 [ 1110.015937] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 1110.018580] Lustre: Skipped 2 previous similar messages [ 1110.020543] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 1110.050335] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 1110.204602] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid in FULL state after 1 sec [ 1111.562385] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [ 1111.648786] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1121.759882] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 1127.016757] Lustre: Failing over lustre-MDT0000 [ 1127.458537] Lustre: server umount lustre-MDT0000 complete [ 1127.904168] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1127.907551] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1127.911268] Lustre: Skipped 3 previous similar messages [ 1127.913523] LustreError: 95676:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1133.769791] LustreError: 94974:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.48@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1133.776399] LustreError: 94974:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 7 previous similar messages [ 1142.440215] LDISKFS-fs (dm-0): 4 truncates cleaned up [ 1142.442725] LDISKFS-fs (dm-0): recovery complete [ 1142.446410] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1142.487419] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1142.611888] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 1143.944861] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 1144.012265] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 1144.012567] Lustre: 94946:0:(ldlm_lib.c:2071:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 1147.872833] Lustre: 95676:0:(ldlm_lib.c:2071:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 1147.877706] Lustre: 95676:0:(ldlm_lib.c:2071:extend_recovery_timer()) Skipped 1 previous similar message [ 1147.882213] Lustre: lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) [ 1147.900604] LustreError: 101199:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1148.215071] LustreError: 101199:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1148.529115] LustreError: 101199:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1148.533947] LustreError: 101199:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 1 previous similar message [ 1148.847064] LustreError: 101199:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1148.849890] LustreError: 101199:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 1 previous similar message [ 1149.169693] Lustre: 101199:0:(ldlm_lib.c:2071:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 1149.173209] Lustre: 101199:0:(ldlm_lib.c:2071:extend_recovery_timer()) Skipped 8 previous similar messages [ 1149.801372] LustreError: 101199:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1149.807188] LustreError: 101199:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 3 previous similar messages [ 1150.127105] LustreError: 101199:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1150.129633] LustreError: 101199:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 3 previous similar messages [ 1151.383740] Lustre: 101199:0:(ldlm_lib.c:2071:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 1151.387606] Lustre: 101199:0:(ldlm_lib.c:2071:extend_recovery_timer()) Skipped 6 previous similar messages [ 1152.015714] LustreError: 101199:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1152.018792] LustreError: 101199:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 6 previous similar messages [ 1152.335121] LustreError: 101199:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1152.339009] LustreError: 101199:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 6 previous similar messages [ 1155.464957] Lustre: 101199:0:(ldlm_lib.c:2071:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 1155.468269] Lustre: 101199:0:(ldlm_lib.c:2071:extend_recovery_timer()) Skipped 12 previous similar messages [ 1156.097561] LustreError: 101199:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1156.101117] LustreError: 101199:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 12 previous similar messages [ 1156.415052] LustreError: 101199:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1156.417547] LustreError: 101199:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 12 previous similar messages [ 1163.601569] Lustre: 101199:0:(ldlm_lib.c:2071:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 1163.608202] Lustre: 101199:0:(ldlm_lib.c:2071:extend_recovery_timer()) Skipped 25 previous similar messages [ 1164.241223] LustreError: 101199:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1164.244654] LustreError: 101199:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 25 previous similar messages [ 1164.559084] LustreError: 101199:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1164.561553] LustreError: 101199:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 25 previous similar messages [ 1179.857325] Lustre: 101199:0:(ldlm_lib.c:2071:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 1179.860936] Lustre: 101199:0:(ldlm_lib.c:2071:extend_recovery_timer()) Skipped 51 previous similar messages [ 1180.490116] LustreError: 101199:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1180.494585] LustreError: 101199:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 51 previous similar messages [ 1180.807093] LustreError: 101199:0:(ldlm_lib.c:2684:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1180.811641] LustreError: 101199:0:(ldlm_lib.c:2684:replay_request_or_update()) Skipped 51 previous similar messages [ 1204.223163] Lustre: 101199:0:(ldlm_lib.c:2380:target_recovery_overseer()) lustre-MDT0000 recovery is aborted by hard timeout [ 1204.229983] Lustre: 101199:0:(ldlm_lib.c:2390:target_recovery_overseer()) recovery is aborted, evict exports in recovery [ 1204.235952] Lustre: 101199:0:(genops.c:1622:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client 5c1dc5c7-6573-4574-8672-0d20047e58e5@192.168.203.48@tcp [ 1204.244756] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 1204.249758] Lustre: 101199:0:(ldlm_lib.c:1900:abort_req_replay_queue()) @@@ aborted: req@000000009e9c0a58 x1869535949948928/t0(8589934777) o101->5c1dc5c7-6573-4574-8672-0d20047e58e5@192.168.203.48@tcp:135/0 lens 592/0 e 0 to 0 dl 1782928860 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:0 [ 1204.268622] Lustre: lustre-MDT0000-osd: cancel update llog [0x200000400:0x1:0x0] [ 1204.275298] Lustre: lustre-MDT0000: Denying connection for new client 5c1dc5c7-6573-4574-8672-0d20047e58e5 (at 192.168.203.48@tcp), waiting for 3 known clients (2 recovered, 0 in progress, and 1 evicted) to recover in 0:00 [ 1204.281235] Lustre: lustre-MDT0001-osp-MDT0000: cancel update llog [0x240000401:0x1:0x0] [ 1204.304900] Lustre: lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 1204.305025] Lustre: lustre-MDT0000: Recovery over after 1:00, of 3 clients 2 recovered and 1 was evicted. [ 1204.311457] Lustre: Skipped 2 previous similar messages [ 1204.343100] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:79 to 0x280000401:577) [ 1204.343140] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:47 to 0x2c0000401:545) [ 1214.435564] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1214.437713] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1214.439486] Lustre: Skipped 4 previous similar messages [ 1214.443169] Lustre: Skipped 5 previous similar messages [ 1217.596123] Lustre: server umount lustre-OST0000 complete [ 1219.553822] LustreError: 96770:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1219.558711] LustreError: 96770:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 11 previous similar messages [ 1233.375083] Lustre: lustre-OST0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 1233.427885] Lustre: server umount lustre-OST0001 complete [ 1240.861279] Lustre: server umount lustre-MDT0000 complete [ 1242.076210] LustreError: 94929:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782928887 with bad export cookie 15270509570085640597 [ 1242.079451] LustreError: 94929:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 1242.079986] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1242.197875] Lustre: server umount lustre-MDT0001 complete [ 1244.889833] Lustre: DEBUG MARKER: == conf-sanity test 85: osd_ost init: fail ea_fid_set ==== 14:01:29 (1782928889) [ 1247.354717] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1247.358345] Lustre: *** cfs_fail_loc=197, val=0*** [ 1262.815696] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 1267.935337] LustreError: 103183:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.203.148@tcp: failed processing log, type 4: rc = -110 [ 1273.065260] Lustre: *** cfs_fail_loc=197, val=0*** [ 1273.067520] Lustre: Skipped 65 previous similar messages [ 1293.535330] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1293.537264] Lustre: Skipped 7 previous similar messages [ 1295.520325] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 1297.932410] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1298.618931] Lustre: server umount lustre-OST0000 complete [ 1301.378667] Lustre: DEBUG MARKER: == conf-sanity test 86: Replacing mkfs.lustre -G option == 14:02:25 (1782928945) [ 1315.028360] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1315.206343] LustreError: 104802:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1315.212149] LustreError: 104802:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 4 previous similar messages [ 1316.636932] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 1320.320491] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1322.342587] LustreError: 104835:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x200000009:0x1:0x0]: rc = -5 [ 1322.346947] LustreError: 104835:0:(lod_sub_object.c:917:lod_sub_prep_llog()) lustre-MDT0000-mdtlov: can't get id from catalogs: rc = -5 [ 1322.350550] LustreError: 104835:0:(lod_dev.c:511:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 7, retries 0, failed: rc = -5 [ 1322.487575] Lustre: server umount lustre-MDT0000 complete [ 1333.303024] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_hostid [ 1336.410121] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 1348.547576] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1348.630737] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1348.640839] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1348.675443] Lustre: lustre-MDT0000: new disk, initializing [ 1348.699502] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1350.106943] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 1354.197905] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1354.239215] Lustre: 109001:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1354.348348] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1355.639172] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 1359.194986] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1360.936534] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1363.126795] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1363.229618] Lustre: 110966:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1365.116168] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 1368.702481] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1370.054801] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1372.186251] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1373.199804] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 3 sec [ 1374.471478] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1374.547364] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1377.250211] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1377.250989] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1377.254615] LustreError: Skipped 1 previous similar message [ 1377.255262] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1377.261669] Lustre: Skipped 5 previous similar messages [ 1377.264199] Lustre: Skipped 10 previous similar messages [ 1381.262181] Lustre: server umount lustre-OST0000 complete [ 1388.631674] Lustre: server umount lustre-MDT0000 complete [ 1389.828174] LustreError: 108994:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782929035 with bad export cookie 15270509570085651258 [ 1389.831536] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1389.832845] LustreError: 108994:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 1389.948463] Lustre: server umount lustre-MDT0001 complete [ 1392.801823] Lustre: DEBUG MARKER: == conf-sanity test 87: check if MDT inode can hold EAs with N stripes properly ========================================================== 14:03:57 (1782929037) [ 1395.690069] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing unload_modules_local [ 1396.705679] Key type lgssc unregistered [ 1396.835392] LNet: 113471:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1396.838047] LNetError: 113471:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1396.849644] LNet: Removed LNI 192.168.203.148@tcp [ 1397.159976] Key type .llcrypt unregistered [ 1397.161599] Key type ._llcrypt unregistered [ 1402.796475] Key type ._llcrypt registered [ 1402.797568] Key type .llcrypt registered [ 1402.836185] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_hostid [ 1408.937749] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 1409.317576] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1409.327493] alg: No test for adler32 (adler32-zlib) [ 1410.179437] Lustre: Lustre: Build Version: 2.17.54_83_g6b808a3 [ 1410.267376] LNet: Added LNI 192.168.203.148@tcp [8/256/0/180] [ 1411.847172] Key type lgssc registered [ 1412.200200] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1424.796695] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1424.802633] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1425.887724] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1425.898078] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1425.937727] Lustre: lustre-MDT0000: new disk, initializing [ 1425.958325] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1425.965377] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1427.256671] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 1431.498721] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1431.590356] Lustre: lustre-OST0000: new disk, initializing [ 1431.592187] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1431.594027] Lustre: Skipped 1 previous similar message [ 1431.596051] Lustre: 117619:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1431.617311] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1433.408406] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 1433.412494] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 1433.420996] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 1433.496348] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 1437.615019] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1437.685145] Lustre: lustre-OST0001: new disk, initializing [ 1437.688681] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 1437.692598] Lustre: 118482:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1437.721179] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 1439.608490] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 1442.317628] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost [ 1442.322666] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] [ 1442.331957] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 [ 1447.392562] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1447.393290] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1447.396530] Lustre: Skipped 1 previous similar message [ 1450.041428] Lustre: server umount lustre-MDT0000 complete [ 1452.253686] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null) [ 1453.828502] LustreError: 117618:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782929099 with bad export cookie 85007215327738044 [ 1453.831354] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1453.833758] LustreError: 117618:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 1453.880590] Lustre: server umount lustre-OST0000 complete [ 1455.297387] Lustre: server umount lustre-OST0001 complete [ 1458.380400] Lustre: DEBUG MARKER: == conf-sanity test 88: check the default mount options can be overridden ========================================================== 14:05:02 (1782929102) [ 1462.337456] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 1469.779795] Lustre: DEBUG MARKER: == conf-sanity test 89: check tunefs --param and --erase-param{s} options ========================================================== 14:05:14 (1782929114) [ 1481.650754] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_hostid [ 1484.662284] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 1496.173626] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1496.257948] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1496.267982] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1496.310752] Lustre: lustre-MDT0000: new disk, initializing [ 1496.331839] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1496.338149] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1497.668593] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 1501.780768] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1501.821582] Lustre: 125220:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1501.849282] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 1501.852130] Lustre: Skipped 1 previous similar message [ 1501.891949] Lustre: lustre-MDT0001: new disk, initializing [ 1501.921429] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1501.933509] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 1501.936746] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1503.254074] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 1506.822535] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1508.520129] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1510.734468] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1510.853299] Lustre: lustre-OST0000: new disk, initializing [ 1510.855153] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1510.857500] Lustre: 127187:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1510.883251] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1512.749078] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 1516.321597] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount (FULL|IDLE) failover.node=192.0.2.254@tcp0,osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1517.047370] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 1517.050912] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1517.079205] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1517.667038] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1517.741604] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1519.084325] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1519.159844] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1522.144937] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1522.145425] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1522.147186] LustreError: Skipped 1 previous similar message [ 1522.150873] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1522.154977] Lustre: Skipped 2 previous similar messages [ 1525.840115] Lustre: server umount lustre-OST0000 complete [ 1527.264269] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1527.264722] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1527.268813] Lustre: Skipped 2 previous similar messages [ 1527.272350] Lustre: Skipped 1 previous similar message [ 1532.384107] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1532.387026] Lustre: Skipped 1 previous similar message [ 1533.213870] Lustre: server umount lustre-MDT0000 complete [ 1534.418203] LustreError: 125211:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782929179 with bad export cookie 85007215327739248 [ 1534.421262] LustreError: 125211:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 1534.421435] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1534.536261] Lustre: server umount lustre-MDT0001 complete [ 1537.175926] Lustre: DEBUG MARKER: == conf-sanity test 90a: check max_mod_rpcs_in_flight is enforced ========================================================== 14:06:21 (1782929181) [ 1539.383124] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1539.576185] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1540.911893] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 1543.799433] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1545.358291] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 1547.899185] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1549.712898] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1551.923807] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1553.991595] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 1556.465028] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1569.053810] Lustre: *** cfs_fail_loc=159, val=0*** [ 1569.055674] Lustre: Skipped 1 previous similar message [ 1584.344794] Lustre: lustre-MDT0000: Client 6d836133-678a-430c-b001-122978512379 (at 192.168.203.48@tcp) reconnecting [ 1584.874585] Lustre: *** cfs_fail_loc=159, val=0*** [ 1584.876101] Lustre: Skipped 4 previous similar messages [ 1600.214756] Lustre: lustre-MDT0000: Client 6d836133-678a-430c-b001-122978512379 (at 192.168.203.48@tcp) reconnecting [ 1620.961655] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1620.961859] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1620.965580] LustreError: Skipped 1 previous similar message [ 1620.969271] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1620.971892] Lustre: Skipped 1 previous similar message [ 1622.222622] Lustre: server umount lustre-OST0000 complete [ 1626.081272] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1626.081360] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1626.092109] Lustre: Skipped 2 previous similar messages [ 1629.590132] Lustre: server umount lustre-MDT0000 complete [ 1630.764226] LustreError: 130329:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782929275 with bad export cookie 85007215327740130 [ 1630.767575] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1630.769169] LustreError: 130329:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 5 previous similar messages [ 1630.899568] Lustre: server umount lustre-MDT0001 complete [ 1634.271787] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing unload_modules_local [ 1635.187821] Key type lgssc unregistered [ 1635.304306] LNet: 133390:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1635.306447] LNetError: 133390:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1635.319303] LNet: Removed LNI 192.168.203.148@tcp [ 1635.589429] Key type .llcrypt unregistered [ 1635.590445] Key type ._llcrypt unregistered [ 1644.328691] Key type ._llcrypt registered [ 1644.329788] Key type .llcrypt registered [ 1644.366245] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 1644.688378] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1644.738729] alg: No test for adler32 (adler32-zlib) [ 1645.596280] Lustre: Lustre: Build Version: 2.17.54_83_g6b808a3 [ 1645.686905] LNet: Added LNI 192.168.203.148@tcp [8/256/0/180] [ 1647.263128] Key type lgssc registered [ 1647.609158] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1650.049974] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1650.058027] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1651.195979] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1652.443736] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 1655.160177] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1655.269621] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1656.536648] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 1658.833645] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1660.564762] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1662.800161] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1662.910817] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1664.774909] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 1667.063316] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1676.262936] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:42 to 0x280000401:65) [ 1682.007817] Lustre: *** cfs_fail_loc=159, val=0*** [ 1697.492666] Lustre: lustre-MDT0000: Client c3a36728-1984-49ae-853f-638af2bac92a (at 192.168.203.48@tcp) reconnecting [ 1698.168390] Lustre: *** cfs_fail_loc=159, val=0*** [ 1714.392801] Lustre: lustre-MDT0001: Client c3a36728-1984-49ae-853f-638af2bac92a (at 192.168.203.48@tcp) reconnecting [ 1714.923154] Lustre: *** cfs_fail_loc=159, val=0*** [ 1714.924985] Lustre: Skipped 4 previous similar messages [ 1730.264660] Lustre: lustre-MDT0001: Client c3a36728-1984-49ae-853f-638af2bac92a (at 192.168.203.48@tcp) reconnecting [ 1731.393974] Lustre: 137838:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 1732.148591] Lustre: *** cfs_fail_loc=159, val=0*** [ 1732.149980] Lustre: Skipped 2 previous similar messages [ 1748.697162] Lustre: lustre-MDT0000: Client 7845acba-1e6d-4383-b934-b0c93908f638 (at 192.168.203.48@tcp) reconnecting [ 1749.265818] Lustre: *** cfs_fail_loc=159, val=0*** [ 1749.267917] Lustre: Skipped 12 previous similar messages [ 1765.596460] Lustre: lustre-MDT0000: Client 7845acba-1e6d-4383-b934-b0c93908f638 (at 192.168.203.48@tcp) reconnecting [ 1766.110959] Lustre: 138124:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 1767.391929] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1767.394178] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1767.397736] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1768.417028] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1768.418703] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1768.418935] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1768.427235] Lustre: Skipped 1 previous similar message [ 1773.398099] Lustre: server umount lustre-OST0000 complete [ 1778.144020] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1778.148292] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1778.155538] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1780.948137] Lustre: server umount lustre-MDT0000 complete [ 1782.159287] LustreError: 134808:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782929427 with bad export cookie 8479856164199263379 [ 1782.161606] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1782.162788] LustreError: 134808:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 1782.291399] Lustre: server umount lustre-MDT0001 complete [ 1787.576475] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing unload_modules_local [ 1789.035185] Key type lgssc unregistered [ 1789.197695] LNet: 139175:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1789.201826] LNetError: 139175:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1790.249184] LNet: Removed LNI 192.168.203.148@tcp [ 1790.707722] Key type .llcrypt unregistered [ 1790.710602] Key type ._llcrypt unregistered [ 1803.003811] Key type ._llcrypt registered [ 1803.005337] Key type .llcrypt registered [ 1803.072593] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 1803.587654] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1803.665077] alg: No test for adler32 (adler32-zlib) [ 1804.606815] Lustre: Lustre: Build Version: 2.17.54_83_g6b808a3 [ 1804.741614] LNet: Added LNI 192.168.203.148@tcp [8/256/0/180] [ 1806.359230] Key type lgssc registered [ 1806.902400] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1811.140261] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1811.152542] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1812.416191] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1814.553417] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 1822.191916] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1822.504758] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1826.936814] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 1834.439767] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1838.576968] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1842.510552] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1842.748275] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1846.012397] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 1846.840397] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:97) [ 1849.597780] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1858.094499] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:129) [ 1862.971717] Lustre: 143186:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 1863.920587] Lustre: 143234:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 1864.534392] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 in log params [ 1866.326247] Lustre: 143380:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre/mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 (mode = 0) failed: rc = -17 [ 1866.734797] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=7 in log params [ 1866.740398] Lustre: Skipped 1 previous similar message [ 1867.178779] Lustre: 143478:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 1872.351968] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1872.356116] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1872.362287] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1873.376622] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1873.379504] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1873.381078] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1874.734988] Lustre: server umount lustre-OST0000 complete [ 1878.497633] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1878.500317] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1878.504879] Lustre: Skipped 1 previous similar message [ 1878.511162] Lustre: Skipped 2 previous similar messages [ 1882.787287] Lustre: server umount lustre-MDT0000 complete [ 1883.616423] LustreError: 140582:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1883.627927] LustreError: 140582:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 1884.393231] LustreError: 142424:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782929529 with bad export cookie 14884077767522012764 [ 1884.395049] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1884.399167] LustreError: 142424:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 1884.554797] Lustre: server umount lustre-MDT0001 complete [ 1889.305933] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing unload_modules_local [ 1890.702593] Key type lgssc unregistered [ 1890.862377] LNet: 144534:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1890.866741] LNetError: 144534:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1890.878612] LNet: Removed LNI 192.168.203.148@tcp [ 1891.307391] Key type .llcrypt unregistered [ 1891.310216] Key type ._llcrypt unregistered [ 1903.629128] Key type ._llcrypt registered [ 1903.630744] Key type .llcrypt registered [ 1903.691056] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 1904.194603] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1904.223870] alg: No test for adler32 (adler32-zlib) [ 1905.134902] Lustre: Lustre: Build Version: 2.17.54_83_g6b808a3 [ 1905.255871] LNet: Added LNI 192.168.203.148@tcp [8/256/0/180] [ 1906.871306] Key type lgssc registered [ 1907.445250] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1911.213186] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1911.221541] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1912.484069] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1914.347115] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 1918.328438] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1918.546624] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1920.390277] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 1923.646883] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1926.137635] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1928.938593] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1929.134928] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1931.613937] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 1934.888203] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1937.330160] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:161) [ 1944.488697] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:129) [ 1948.500970] Lustre: *** cfs_fail_loc=159, val=0*** [ 1964.776935] Lustre: lustre-MDT0000: Client 1d6c3cb1-1eea-4492-a52b-41e2461aa5eb (at 192.168.203.48@tcp) reconnecting [ 1980.387115] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1980.387687] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1980.388776] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1980.397360] Lustre: Skipped 1 previous similar message [ 1985.507358] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1985.511380] Lustre: Skipped 2 previous similar messages [ 1986.401557] Lustre: server umount lustre-OST0000 complete [ 1990.112368] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1990.120055] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1990.128410] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1994.697125] Lustre: server umount lustre-MDT0000 complete [ 1995.744085] LustreError: 148424:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1995.751982] LustreError: 148424:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 1996.722485] LustreError: 145906:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782929641 with bad export cookie 15328282978323639519 [ 1996.725765] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1996.727846] LustreError: 145906:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 1996.900591] Lustre: server umount lustre-MDT0001 complete [ 2002.836906] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing unload_modules_local [ 2004.579730] Key type lgssc unregistered [ 2004.759495] LNet: 149612:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2004.764515] LNetError: 149612:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2004.775349] LNet: Removed LNI 192.168.203.148@tcp [ 2005.194438] Key type .llcrypt unregistered [ 2005.196263] Key type ._llcrypt unregistered [ 2017.831054] Key type ._llcrypt registered [ 2017.832776] Key type .llcrypt registered [ 2017.908698] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 2018.347568] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2018.408862] alg: No test for adler32 (adler32-zlib) [ 2019.340752] Lustre: Lustre: Build Version: 2.17.54_83_g6b808a3 [ 2019.472181] LNet: Added LNI 192.168.203.148@tcp [8/256/0/180] [ 2021.080362] Key type lgssc registered [ 2021.643812] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2025.434388] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2025.447335] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2026.681938] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2028.735297] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 2032.932541] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2033.136449] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2035.127431] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 2038.428864] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2040.910529] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2044.123257] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2044.350820] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2047.210312] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 2050.633670] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2051.559191] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:170 to 0x280000401:193) [ 2058.733414] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:161) [ 2075.518138] Lustre: lustre-MDT0001: evicting dfa310d0-421e-4188-a36d-b51bd3ffd848 (at 192.168.203.48@tcp) by administrative request [ 2075.524158] Lustre: Skipped 1 previous similar message [ 2102.752175] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2102.756530] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2102.766496] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2104.802148] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2104.802340] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2104.807494] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2106.207769] Lustre: server umount lustre-OST0000 complete [ 2109.920696] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2109.921996] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2109.930954] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2109.939502] Lustre: Skipped 2 previous similar messages [ 2115.042167] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2120.160855] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2120.164815] Lustre: Skipped 2 previous similar messages [ 2122.207109] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2122.282840] Lustre: server umount lustre-MDT0000 complete [ 2124.232127] LustreError: 150987:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782929769 with bad export cookie 2657758336598447772 [ 2124.234180] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2124.242598] LustreError: 150987:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2124.364137] Lustre: server umount lustre-MDT0001 complete [ 2129.512205] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing unload_modules_local [ 2130.848227] Key type lgssc unregistered [ 2131.013800] LNet: 155090:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2131.018901] LNetError: 155090:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2131.028440] LNet: Removed LNI 192.168.203.148@tcp [ 2131.416077] Key type .llcrypt unregistered [ 2131.418038] Key type ._llcrypt unregistered [ 2163.482621] Key type ._llcrypt registered [ 2163.484292] Key type .llcrypt registered [ 2163.548461] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 2163.955624] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2163.984071] alg: No test for adler32 (adler32-zlib) [ 2164.878534] Lustre: Lustre: Build Version: 2.17.54_83_g6b808a3 [ 2165.004357] LNet: Added LNI 192.168.203.148@tcp [8/256/0/180] [ 2166.599167] Key type lgssc registered [ 2167.193980] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2170.511830] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2170.521133] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2171.705057] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2173.385445] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 2177.041083] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2177.231926] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2178.994737] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 2182.034514] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2184.108993] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2186.569565] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2186.713246] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2187.754303] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:193) [ 2188.949343] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 2191.565291] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2195.944439] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:195 to 0x280000401:225) [ 2201.061032] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2201.061097] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2201.066681] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2201.072975] Lustre: Skipped 1 previous similar message [ 2202.964463] Lustre: server umount lustre-OST0000 complete [ 2206.176756] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2206.177731] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2206.181573] Lustre: Skipped 2 previous similar messages [ 2206.185486] Lustre: Skipped 1 previous similar message [ 2206.490749] Lustre: server umount lustre-MDT0000 complete [ 2207.937533] LustreError: 157530:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782929853 with bad export cookie 13492441038865686523 [ 2207.941608] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2207.942944] LustreError: 157530:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2208.062575] Lustre: server umount lustre-MDT0001 complete [ 2211.884986] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing unload_modules_local [ 2212.979588] Key type lgssc unregistered [ 2213.121555] LNet: 161086:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2213.125062] LNetError: 161086:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2213.140772] LNet: Removed LNI 192.168.203.148@tcp [ 2213.493752] Key type .llcrypt unregistered [ 2213.495319] Key type ._llcrypt unregistered [ 2223.843689] Key type ._llcrypt registered [ 2223.845478] Key type .llcrypt registered [ 2223.894396] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 2224.299853] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2224.368571] alg: No test for adler32 (adler32-zlib) [ 2225.245491] Lustre: Lustre: Build Version: 2.17.54_83_g6b808a3 [ 2225.350746] LNet: Added LNI 192.168.203.148@tcp [8/256/0/180] [ 2226.951215] Key type lgssc registered [ 2227.370493] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2232.985123] Lustre: DEBUG MARKER: == conf-sanity test 100: check lshowmount lists MGS, MDT, OST and 0@lo ========================================================== 14:17:57 (1782929877) [ 2238.992113] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_hostid [ 2242.735690] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 2256.101099] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2256.108822] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2257.201822] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2257.213641] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2257.251579] Lustre: lustre-MDT0000: new disk, initializing [ 2257.285704] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2257.294286] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2258.844840] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 2263.427377] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2263.476767] Lustre: 165318:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2263.503826] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 2263.505956] Lustre: Skipped 1 previous similar message [ 2263.543592] Lustre: lustre-MDT0001: new disk, initializing [ 2263.578360] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2263.591646] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 2263.595502] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2265.027805] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 2269.013983] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2270.922657] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2273.587524] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2273.702446] Lustre: lustre-OST0000: new disk, initializing [ 2273.705652] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 2273.710046] Lustre: 167287:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2273.754652] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2275.577559] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 2275.581538] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2275.617328] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2276.035431] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 2280.175575] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2286.049255] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2286.051545] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2286.052149] LustreError: Skipped 1 previous similar message [ 2286.052787] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2286.057404] Lustre: Skipped 1 previous similar message [ 2289.750936] Lustre: server umount lustre-OST0000 complete [ 2294.240265] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2294.245175] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2294.253269] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2294.257240] Lustre: Skipped 1 previous similar message [ 2296.288155] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2296.288787] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2297.375122] Lustre: server umount lustre-MDT0000 complete [ 2298.768154] LustreError: 165312:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782929943 with bad export cookie 17081876978352498496 [ 2298.771227] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2298.773035] LustreError: 165312:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2298.896943] Lustre: server umount lustre-MDT0001 complete [ 2303.122975] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing unload_modules_local [ 2304.299940] Key type lgssc unregistered [ 2304.455251] LNet: 169192:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2304.457629] LNetError: 169192:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2304.471127] LNet: Removed LNI 192.168.203.148@tcp [ 2304.842118] Key type .llcrypt unregistered [ 2304.843799] Key type ._llcrypt unregistered [ 2314.847863] Key type ._llcrypt registered [ 2314.849589] Key type .llcrypt registered [ 2314.897987] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 2315.237377] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2315.268032] alg: No test for adler32 (adler32-zlib) [ 2316.130380] Lustre: Lustre: Build Version: 2.17.54_83_g6b808a3 [ 2316.232175] LNet: Added LNI 192.168.203.148@tcp [8/256/0/180] [ 2317.815188] Key type lgssc registered [ 2318.222390] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2320.901712] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2320.909096] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2322.048930] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2323.475359] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 2326.636843] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2326.776514] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2328.210463] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 2330.893329] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2332.863681] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2335.484729] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2335.638262] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2337.913894] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 2340.768697] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2346.918787] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:33) [ 2353.743564] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2353.754822] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2353.763975] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2353.772866] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2353.780646] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2354.164802] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2354.532627] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2354.536687] Lustre: Skipped 1 previous similar message [ 2354.543588] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2354.548809] Lustre: Skipped 1 previous similar message [ 2354.550787] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2354.553531] Lustre: Skipped 1 previous similar message [ 2354.555536] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2354.561314] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2354.564154] Lustre: Skipped 1 previous similar message [ 2354.894891] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2355.237541] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2355.587340] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2355.590030] Lustre: Skipped 2 previous similar messages [ 2355.596085] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2355.601295] Lustre: Skipped 2 previous similar messages [ 2355.603287] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2355.605884] Lustre: Skipped 2 previous similar messages [ 2355.607972] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2355.613506] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2355.616905] Lustre: Skipped 2 previous similar messages [ 2355.957926] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2356.295917] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2356.635082] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2356.953672] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2357.287036] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2357.625786] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2357.628640] Lustre: Skipped 5 previous similar messages [ 2357.636245] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2357.641691] Lustre: Skipped 5 previous similar messages [ 2357.645202] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2357.648623] Lustre: Skipped 5 previous similar messages [ 2357.651101] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2357.655165] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2357.658012] Lustre: Skipped 5 previous similar messages [ 2358.018292] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2358.414065] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2358.772065] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2359.133891] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2359.487581] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2359.868209] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2360.273121] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2360.663892] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2361.034409] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2361.386185] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2361.723225] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2361.726464] Lustre: Skipped 10 previous similar messages [ 2361.734652] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2361.739902] Lustre: Skipped 10 previous similar messages [ 2361.741966] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2361.744491] Lustre: Skipped 10 previous similar messages [ 2361.746851] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2361.753784] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2361.755624] Lustre: Skipped 10 previous similar messages [ 2362.098698] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2362.455256] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2362.803354] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2363.143713] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2363.498128] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2363.847165] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2364.214755] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2364.578134] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2364.948923] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2365.308603] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2365.698281] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2366.107862] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2366.461288] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2366.826947] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2367.148668] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2367.472483] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2367.783488] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2368.120026] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2368.452077] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2368.805101] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2369.137612] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2369.467582] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2369.817779] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2369.823401] Lustre: Skipped 22 previous similar messages [ 2369.830528] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2369.835218] Lustre: Skipped 22 previous similar messages [ 2369.837396] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2369.840511] Lustre: Skipped 22 previous similar messages [ 2369.842640] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2369.849565] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2369.852431] Lustre: Skipped 22 previous similar messages [ 2370.185066] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2370.542110] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2370.866197] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2371.223503] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2371.557323] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2371.937790] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2372.303733] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2372.642425] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2372.987073] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2373.352640] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2373.697548] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2374.037139] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2374.384416] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2374.778963] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2375.144631] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2375.484566] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2375.848457] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2376.239087] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2376.586257] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2376.966863] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2377.325340] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2377.686400] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2378.031040] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2378.364480] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2378.708567] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2379.055275] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2379.400866] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2379.766263] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2380.104391] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2380.424222] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2380.785852] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2381.122096] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2381.465267] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2381.793674] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2382.107971] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2382.412585] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2382.739350] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2383.068432] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2383.400906] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2383.706799] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2384.059423] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2384.397244] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2384.769626] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2385.148625] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2385.509758] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2385.881153] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2385.884019] Lustre: Skipped 45 previous similar messages [ 2385.890638] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2385.895987] Lustre: Skipped 45 previous similar messages [ 2385.904485] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2385.907704] Lustre: Skipped 45 previous similar messages [ 2385.909658] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2385.915306] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2385.919550] Lustre: Skipped 45 previous similar messages [ 2386.284856] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2386.649883] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2386.995552] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2387.330397] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2387.693483] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2388.032259] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2388.373101] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2388.738687] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2389.102074] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2389.444287] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2389.767388] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2390.101824] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2390.435023] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2390.777335] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2391.107300] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2391.457452] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2391.826322] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2392.160444] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2392.519116] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2392.866041] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2393.200249] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2393.543116] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2393.874958] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2394.221293] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2394.554531] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2394.889769] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2395.246265] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2395.608941] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2395.977886] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2396.331245] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2396.726170] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2397.103647] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2397.471844] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2397.852429] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2398.201925] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2398.522303] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2398.852811] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2399.190244] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2399.532017] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2399.865260] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2400.211313] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2400.560705] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2400.897598] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2401.270290] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2401.634157] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2401.986238] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2402.323979] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2402.649150] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2402.996299] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2403.344940] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2403.691100] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2404.023397] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2404.370271] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2404.712810] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2405.054358] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2405.430428] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2405.793291] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2406.138303] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2406.503695] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2406.844122] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2407.191691] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2407.548919] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2407.903755] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2408.238532] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2408.594022] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2408.949382] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2409.291481] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2409.634817] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2409.984511] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2410.338328] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2410.671411] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2410.997901] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2411.335057] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2411.666730] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2412.029712] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2412.360722] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2412.676506] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2412.976489] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2413.291195] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2413.623670] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2413.957409] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2414.278173] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2414.601747] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2414.934849] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2415.270496] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2415.607184] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2415.926339] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2416.264900] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2416.603903] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2416.932894] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2417.280335] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2417.606924] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2417.932290] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2417.934774] Lustre: Skipped 92 previous similar messages [ 2417.940540] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2417.944996] Lustre: Skipped 92 previous similar messages [ 2417.946939] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2417.949707] Lustre: Skipped 92 previous similar messages [ 2417.951680] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2417.957033] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2417.960306] Lustre: Skipped 92 previous similar messages [ 2418.268426] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2418.594359] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2418.924182] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2419.238177] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2419.576066] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2419.898389] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2420.223416] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2420.530667] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2420.852549] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2421.190792] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2421.542600] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2421.869644] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2422.213166] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2422.556019] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2422.888809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2423.236250] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2423.547309] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2423.869672] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2424.181134] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2424.488710] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2424.805601] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2425.105073] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2425.424350] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2425.751485] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2426.052464] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2426.381878] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2426.714859] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2427.029386] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2427.366429] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2427.679070] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2428.007464] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2428.328970] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2428.662740] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2428.998880] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2429.343832] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2429.700738] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2430.017290] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2430.320591] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2430.638570] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2430.949986] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2431.272557] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2431.587918] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2431.920446] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2432.275514] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2432.646909] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2432.977724] LustreError: 170602:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 2432.982134] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2432.982442] LustreError: 170602:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 2433.311919] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2433.640953] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2433.957685] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2434.283561] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2434.588183] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2434.897491] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2435.205581] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2435.526047] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2435.860095] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2436.191391] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2436.505221] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2436.839523] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2437.151319] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2437.483436] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2437.804525] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2438.163728] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2438.498169] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2438.817801] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2439.152994] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2439.496923] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2439.819146] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2440.165789] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2440.494529] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2440.848500] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2441.181635] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2441.516606] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2441.857556] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2442.218540] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2442.573015] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2442.927512] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2443.237603] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2443.581484] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2443.924263] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2444.248514] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2444.568955] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2444.912655] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2445.245429] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2445.596156] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2445.923028] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2446.277018] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2446.593391] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2446.908241] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2447.254305] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2447.611491] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2447.929551] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2448.252288] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2448.574813] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2448.919861] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2449.250645] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2449.584559] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2449.898625] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2450.227830] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2450.536613] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2450.892889] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2451.239053] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2451.571941] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2451.904775] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2452.232234] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2452.566044] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2452.927843] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2453.249923] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2453.559402] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2453.885551] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2454.235273] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2454.551118] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2454.868366] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2455.191697] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2455.526902] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2455.853686] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2456.201813] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2456.564841] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2456.923680] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2457.243226] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2457.557892] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2457.877337] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2458.209046] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2458.517473] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2458.826732] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2459.127838] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2459.436376] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2459.745942] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2460.064867] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2460.409850] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2460.751439] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2461.112651] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2461.456125] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2461.799520] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2462.132260] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2462.468349] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2462.807935] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2463.143482] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2463.489566] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2463.807884] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2464.139791] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2464.478571] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2464.789149] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2465.103388] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2465.408991] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2465.735570] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2466.062016] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2466.381767] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2466.706783] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2467.044636] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2467.376621] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2467.727136] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2468.081991] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2468.443684] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2468.777929] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2469.106927] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2469.445537] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2469.781807] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2470.105562] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2470.466497] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2470.812325] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2471.123908] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2471.456807] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2471.794932] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2472.126938] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2472.456329] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2472.806978] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2473.141264] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2473.498775] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2473.832329] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2474.168737] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2474.507144] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2474.841917] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2475.173422] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2475.492442] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2475.805557] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2476.130505] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2476.443125] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2476.775548] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2477.103315] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2477.413181] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2477.728866] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2478.049305] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2478.359700] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2478.681056] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2478.997994] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2479.340222] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2479.650147] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2479.956348] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2480.264845] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2480.598484] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2480.917707] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2481.241924] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2481.569596] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2481.916611] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2482.237455] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2482.239951] Lustre: Skipped 194 previous similar messages [ 2482.245986] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2482.250880] Lustre: Skipped 194 previous similar messages [ 2482.252831] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2482.255189] Lustre: Skipped 194 previous similar messages [ 2482.256649] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2482.260105] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2482.263149] Lustre: Skipped 194 previous similar messages [ 2482.609964] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2482.941677] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2483.294352] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2483.639647] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2483.974101] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2484.301173] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2484.628500] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2484.964822] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2485.283236] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2485.588253] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2485.900684] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2486.214389] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2486.544762] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2486.854966] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2487.174094] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2487.485867] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2487.816151] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2488.131734] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2488.445305] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2488.756510] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2489.090594] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2489.409671] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2489.725604] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2490.049113] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2490.394074] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2490.738738] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2491.057152] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2491.371917] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2491.708615] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2492.029500] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2492.372398] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2492.704060] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2493.060108] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2493.390336] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2493.710718] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2494.019235] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2494.358106] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2494.660025] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2494.970782] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2495.279376] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2495.612173] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2495.944347] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2496.272060] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2496.594317] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2496.925435] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2497.255480] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2497.608161] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2497.945509] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2498.277353] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2498.634082] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2498.963760] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2499.274959] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2499.569609] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2499.876511] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2500.205968] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2500.521262] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2500.836864] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2501.139018] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2501.462361] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2501.794343] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2502.122874] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2502.447537] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2502.784996] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2503.104968] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2503.417169] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2503.734240] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2504.072514] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2504.384864] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2504.697026] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2505.011293] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2505.321807] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2505.622281] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2505.934737] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2506.236535] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2506.568273] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2506.867370] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2507.169324] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2507.501510] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2507.841984] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2508.164496] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2508.486048] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2508.803234] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2509.156888] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2509.501791] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2509.826074] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2510.151935] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2510.477149] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2510.785665] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2511.106953] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2511.431680] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2511.794396] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2512.150438] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2512.481677] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2512.825479] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2513.192165] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2513.538918] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2513.877654] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2514.211920] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2514.556247] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2514.890760] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2515.219347] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2515.551581] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2515.881244] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2516.187483] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2516.488682] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2516.807948] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2517.138726] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2517.446255] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2517.739861] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2518.069806] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2518.433171] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2518.773926] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2519.103463] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2519.442524] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2519.786737] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2520.127214] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2520.466263] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2520.812310] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2521.148219] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2521.486963] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2521.823533] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2522.159575] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2522.488941] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2522.817655] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2523.136100] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2523.458851] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2523.778886] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2524.113334] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2524.439903] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2524.767522] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2525.096449] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2525.441300] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2525.782261] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2526.119820] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2526.456158] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2526.819735] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2527.176379] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2527.522768] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2527.869075] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2528.237249] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2528.595222] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2528.960550] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2529.294044] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2529.641956] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2529.973088] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2530.315092] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2530.647100] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2530.963545] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2531.303341] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2531.671211] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2531.995381] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2532.308635] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2532.640063] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2532.993329] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2533.302322] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2533.608726] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2533.899372] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2534.240507] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2534.545807] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2534.870445] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2535.199423] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2535.546439] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2535.851364] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2536.164378] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2536.492053] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2536.849270] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2537.191977] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2537.532975] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2537.919275] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2538.270237] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2538.642427] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2539.000467] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2539.359495] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2539.734324] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2540.090555] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2540.431673] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2540.780389] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2541.125299] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2541.458928] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2541.788264] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2542.100804] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2542.434675] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2542.739255] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2543.040298] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2543.375128] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2543.701291] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2544.027216] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2544.353830] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2544.696074] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2545.009782] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2545.339501] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2545.663962] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2545.991299] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2546.291934] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2546.614806] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2546.923138] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2547.244729] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2547.566747] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2547.880141] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2548.185066] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2548.506739] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2548.811228] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2549.116889] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2549.432405] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2549.746808] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2550.053750] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2550.347438] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2550.647499] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2550.953821] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2551.246466] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2551.558050] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2551.856134] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2552.161520] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2552.452018] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2552.749668] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2553.061113] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2553.388909] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2553.707642] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2554.020764] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2554.346477] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2554.695792] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2555.013127] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2555.336274] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2555.669299] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2556.007338] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2556.330619] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2556.643977] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2556.954339] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2557.282807] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2557.583119] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2557.902804] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2558.225830] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2558.573759] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2558.899116] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2559.221732] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2559.541114] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2559.869311] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2560.188401] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2560.523671] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2560.868442] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2561.216824] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2561.540684] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2561.865477] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2562.190128] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2562.529235] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2562.844094] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2563.159185] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2563.484126] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2563.823926] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2564.136576] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2564.477000] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2564.809874] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2565.151257] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2565.468520] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2565.798983] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2566.136739] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2566.474235] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2566.797069] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2567.108806] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2567.420585] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2567.751640] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2568.074521] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2568.375834] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2568.691930] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2569.031196] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2569.346300] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2569.655501] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2569.967033] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2570.287222] LustreError: 170602:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 2570.291652] LustreError: 170602:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 2570.292026] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2570.614736] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2570.950580] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2571.302868] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2571.669519] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2571.986559] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2572.309482] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2572.629481] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2572.952326] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2573.247779] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2573.545447] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2573.849336] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2574.165248] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2574.469989] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2574.779803] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2575.081446] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2575.389829] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2575.674468] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2575.977625] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2576.311681] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2576.655544] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2576.965774] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2577.294976] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2577.633604] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2577.976926] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2578.308570] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2578.625710] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2578.956977] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2579.285419] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2579.599364] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2579.913757] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2580.231923] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2580.567436] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2580.884841] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2581.202685] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2581.527866] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2581.863716] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2582.182275] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2582.502871] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2582.831867] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2583.168549] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2583.485989] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2583.816395] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2584.150099] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2584.485595] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2584.804963] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2585.115257] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2585.444556] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2585.776014] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2586.085501] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2586.401496] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2586.714763] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2587.032925] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2587.326274] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2587.631459] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2587.962347] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2588.300365] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2588.623236] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2588.945925] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2589.297532] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2589.622729] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2589.944661] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2590.285241] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2590.613911] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2590.952801] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2591.298701] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2591.642715] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2591.968864] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2592.301422] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2592.623907] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2592.941859] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2593.264019] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2593.605786] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2593.925237] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2594.246348] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2594.557716] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2594.876839] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2595.209172] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2595.529651] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2595.855926] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2596.179029] LustreError: 170602:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 2596.182979] LustreError: 170602:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 2596.183296] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2596.487097] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2596.794880] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2597.098305] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2597.409087] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2597.709988] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2598.002883] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2598.289425] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2598.596635] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2598.889606] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2599.195540] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2599.512334] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2599.825491] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2600.111958] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2600.408394] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2600.709940] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2601.006992] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2601.304958] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2601.598467] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2601.884529] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2602.176419] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2602.457221] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2602.753891] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2603.047899] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2603.348279] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2603.634339] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2603.928185] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2604.228064] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2604.545726] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2604.864625] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2605.164183] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2605.464385] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2605.793937] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2606.105995] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2606.422715] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2606.735475] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2607.058474] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2607.344840] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2607.646066] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2607.964051] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2608.278060] LustreError: 170602:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 2608.282697] LustreError: 170602:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 2608.282894] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2608.598755] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2608.916712] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2609.239885] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2609.574681] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2609.892424] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2610.209216] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2610.535570] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2610.539220] Lustre: Skipped 395 previous similar messages [ 2610.546768] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2610.552959] Lustre: Skipped 395 previous similar messages [ 2610.555647] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2610.558725] Lustre: Skipped 395 previous similar messages [ 2610.561248] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2610.567200] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2610.570148] Lustre: Skipped 395 previous similar messages [ 2610.921724] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2611.246715] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2611.569217] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2611.885173] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2612.228656] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2612.543738] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2612.871685] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2613.178348] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2613.508784] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2613.815631] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2614.121644] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2614.435812] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2614.769891] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2615.087926] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2615.413185] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2615.726851] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2616.051742] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2616.365747] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2616.678114] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2616.976086] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2617.298193] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2617.609559] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2617.944289] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2618.265850] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2618.602916] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2618.924486] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2619.223378] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2619.520683] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2619.839923] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2620.158321] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2620.459582] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2620.764492] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2621.073932] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2621.370727] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2621.688816] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2621.990894] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2622.304021] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2622.604115] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2622.901220] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2623.197870] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2623.505675] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2623.793165] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2624.085662] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2624.405210] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2624.728635] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2625.053179] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2625.353990] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2625.663431] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2625.992922] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2626.313107] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2626.635063] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2626.943560] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2627.266351] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2627.585751] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2627.910581] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2628.218308] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2628.540733] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2628.852212] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2629.169739] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2629.498845] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2629.839593] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2630.199993] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2630.579452] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2630.927741] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2631.282823] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2631.614590] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2631.925738] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2632.272937] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2632.587285] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2632.933140] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2633.258986] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2633.610590] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2633.928024] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2634.227591] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2634.542322] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2634.851703] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2635.163298] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2635.501880] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2635.815313] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2636.152128] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2636.469329] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2636.794911] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2637.130658] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2637.454237] LustreError: 170602:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 2637.457930] LustreError: 170602:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 2637.459243] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2637.777955] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2638.082791] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2638.404304] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2638.744816] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2639.070466] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2639.384658] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2639.737227] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2640.099977] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2640.432538] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2640.755543] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2641.069765] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2641.391366] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2641.695221] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2641.996194] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2642.289762] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2642.603717] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2642.920893] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2643.222707] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2643.537759] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2643.850596] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2644.152439] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2644.461038] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2644.762832] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2645.078756] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2645.367902] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2645.671076] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2645.972678] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2646.284230] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2646.572443] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2646.862935] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2647.183974] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2647.510977] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2647.822523] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2648.121595] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2648.428095] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2648.749042] LustreError: 170602:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 2648.752759] LustreError: 170602:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 2648.753741] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2649.049484] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2649.343219] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2649.626296] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2649.916749] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2650.220010] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2650.540703] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2650.853976] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2651.157684] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2651.443264] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2651.730103] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2652.029584] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2652.337496] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2652.637847] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2652.926291] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2653.223608] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2653.527246] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2653.817633] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2654.110781] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2654.402742] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2654.705761] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2654.992461] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2655.267115] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2655.574044] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2655.879567] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2656.171781] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2656.478450] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2656.787735] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2657.095494] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2657.394662] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2657.693915] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2658.003630] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2658.320695] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2658.611132] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2658.905378] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2659.206738] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2659.511511] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2659.812139] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2660.117790] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2660.415500] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2660.740726] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2661.073186] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2661.389847] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2661.705211] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2662.031234] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2662.362396] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2662.677466] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2662.977816] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2663.299570] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2663.592786] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2663.897524] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2664.192712] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2664.522592] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2664.832291] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2665.145338] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2665.458319] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2665.775253] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2666.083886] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2666.380928] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2666.686185] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2667.009128] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2667.310511] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2667.617282] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2667.931396] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2668.250058] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2668.570937] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2668.874883] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2669.185347] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2669.513532] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2669.838961] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2670.183475] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2670.524968] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2670.916353] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2671.253429] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2671.593709] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2671.953256] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2672.297406] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2672.655577] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2672.999706] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2673.333979] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2673.687080] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2674.024468] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2674.359651] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2674.709622] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2675.054708] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2675.417379] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2675.759954] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2676.111690] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2676.461231] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2676.828952] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2677.184720] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2677.554544] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2677.887187] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2678.230104] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2678.556929] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2678.941169] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2679.270304] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2679.609266] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2679.971581] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2680.336871] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2680.719738] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2681.116647] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2681.467744] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2681.830113] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2682.180631] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2772.894850] LustreError: 172402:0:(ofd_dev.c:1780:ofd_create_hdl()) lustre-OST0000: unable to precreate: rc = -28 [ 2772.897900] LustreError: 170602:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -28 [ 2838.498938] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2838.499120] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2838.502630] LustreError: Skipped 1 previous similar message [ 2838.504630] Lustre: Skipped 1 previous similar message [ 2841.014349] Lustre: server umount lustre-OST0000 complete [ 2843.617094] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2843.619155] Lustre: Skipped 1 previous similar message [ 2848.466604] Lustre: server umount lustre-MDT0000 complete [ 2848.736912] LustreError: 170583:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2848.741122] LustreError: 170583:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 2849.675051] LustreError: 224575:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782930494 with bad export cookie 10690424380650701144 [ 2849.678125] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2849.679297] LustreError: 224575:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2849.789433] Lustre: server umount lustre-MDT0001 complete [ 2853.295715] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing unload_modules_local [ 2854.328139] Key type lgssc unregistered [ 2854.454379] LNet: 225611:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2854.457649] LNetError: 225611:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2854.469330] LNet: Removed LNI 192.168.203.148@tcp [ 2854.799608] Key type .llcrypt unregistered [ 2854.800718] Key type ._llcrypt unregistered [ 2863.732708] Key type ._llcrypt registered [ 2863.733674] Key type .llcrypt registered [ 2863.768744] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 2864.094102] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2864.153532] alg: No test for adler32 (adler32-zlib) [ 2865.002427] Lustre: Lustre: Build Version: 2.17.54_83_g6b808a3 [ 2865.090384] LNet: Added LNI 192.168.203.148@tcp [8/256/0/180] [ 2866.663131] Key type lgssc registered [ 2867.002399] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2869.441504] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2869.446664] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2870.581359] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2871.879429] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 2874.677976] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2874.800994] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2876.136153] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 2878.473699] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2880.209194] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2882.361020] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2882.476797] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2884.315708] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 2886.525278] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2895.785350] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49665 to 0x280000401:49696) [ 2898.893527] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2899.456348] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2899.461577] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2899.464552] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2899.468056] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2899.468063] LustreError: 227022:0:(osp_precreate.c:1268:osp_precreate_thread()) cfs_fail_timeout id 2107 sleeping for 20000ms [ 2900.960635] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2900.961593] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2900.964895] Lustre: Skipped 1 previous similar message [ 2902.159319] Lustre: server umount lustre-OST0000 complete [ 2919.543116] LustreError: 227022:0:(osp_precreate.c:1268:osp_precreate_thread()) cfs_fail_timeout id 2107 awake [ 2930.083473] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2930.191949] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2931.943932] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 2934.113307] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2941.474336] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2941.478738] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2941.478738] LustreError: lustre-OST0000-osc-MDT0001: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2941.483776] Lustre: Skipped 1 previous similar message [ 2943.765843] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 9 sec [ 2945.494941] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff9c6085f1e800.ost_server_uuid 50 [ 2945.957113] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff9c6085f1e800.ost_server_uuid in FULL state after 0 sec [ 2951.650929] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2951.651049] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2951.656453] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2951.659509] Lustre: Skipped 2 previous similar messages [ 2952.972308] Lustre: server umount lustre-OST0000 complete [ 2956.768613] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2956.769103] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2956.769694] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2956.772085] Lustre: Skipped 2 previous similar messages [ 2960.342610] Lustre: server umount lustre-MDT0000 complete [ 2961.477920] LustreError: 226985:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782930606 with bad export cookie 5996021060299438069 [ 2961.481219] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2961.481292] LustreError: 226985:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2961.584035] Lustre: server umount lustre-MDT0001 complete [ 2964.790374] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing unload_modules_local [ 2965.786335] Key type lgssc unregistered [ 2965.898312] LNet: 232239:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2965.900620] LNetError: 232239:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2965.909273] LNet: Removed LNI 192.168.203.148@tcp [ 2966.196709] Key type .llcrypt unregistered [ 2966.197608] Key type ._llcrypt unregistered [ 2977.124064] Key type ._llcrypt registered [ 2977.125268] Key type .llcrypt registered [ 2977.160868] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 2977.460525] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2977.469514] alg: No test for adler32 (adler32-zlib) [ 2978.314494] Lustre: Lustre: Build Version: 2.17.54_83_g6b808a3 [ 2978.404990] LNet: Added LNI 192.168.203.148@tcp [8/256/0/180] [ 2979.983100] Key type lgssc registered [ 2980.314497] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2983.140195] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2983.147292] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2984.280160] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2985.547381] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 2988.355670] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2988.471329] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2989.817112] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 2990.734333] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 2992.785158] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2992.894309] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2993.957909] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49728) [ 2994.826325] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 2997.627271] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2997.689101] Lustre: lustre-OST0001: new disk, initializing [ 2997.691365] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 2997.694620] Lustre: 236246:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2997.729942] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 2998.664947] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 2998.669784] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 2998.727619] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 2999.599126] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 3004.843202] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 3009.493166] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 3019.232494] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3019.235269] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3019.241142] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3020.256705] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3020.258962] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3020.262411] Lustre: Skipped 1 previous similar message [ 3022.883832] Lustre: server umount lustre-MDT0000 complete [ 3024.048049] LustreError: 237128:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782930669 with bad export cookie 13852569216196067211 [ 3024.050164] LustreError: 234678:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0000-osp-MDT0001: osp_attr_get update error [0x200001b72:0x1:0x0]: rc = -5 [ 3024.050866] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3024.052698] LustreError: 237128:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 3024.163080] Lustre: server umount lustre-MDT0001 complete [ 3035.585681] Lustre: server umount lustre-OST0000 complete [ 3045.982332] Lustre: server umount lustre-OST0001 complete [ 3052.626411] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 3055.781647] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3055.937560] LustreError: 239358:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3055.946669] LustreError: 239358:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 3055.958923] Lustre: mylustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3057.276311] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 3059.832729] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3061.181184] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 3062.093584] Lustre: 240497:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 3064.217748] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3064.327527] Lustre: mylustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3064.330595] Lustre: Skipped 1 previous similar message [ 3066.069828] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 3066.404666] LustreError: 240851:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3066.408302] Lustre: mylustre-OST0000: new connection from mylustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49760) [ 3068.610101] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3070.355275] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 3070.760282] Lustre: mylustre-OST0000: new connection from mylustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:99 to 0x280000400:129) [ 3070.760874] Lustre: mylustre-OST0001: new connection from mylustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:3 to 0x2c0000400:33) [ 3073.220050] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 3074.252149] Lustre: 242366:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 3080.671887] LustreError: mylustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3080.674789] Lustre: mylustre-MDT0000-osp-MDT0001: Connection to mylustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3080.678983] Lustre: Skipped 1 previous similar message [ 3080.680986] Lustre: mylustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3080.683195] Lustre: Skipped 3 previous similar messages [ 3083.481956] Lustre: server umount mylustre-MDT0000 complete [ 3084.609056] LustreError: 239333:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782930729 with bad export cookie 13852569216196070032 [ 3084.612353] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3084.614767] LustreError: 239333:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3084.717168] Lustre: server umount mylustre-MDT0001 complete [ 3096.509891] Lustre: server umount mylustre-OST0000 complete [ 3106.839440] Lustre: server umount mylustre-OST0001 complete [ 3113.380410] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 3116.658208] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3116.789462] LustreError: 244672:0:(ldlm_lib.c:1179:target_handle_connect()) tfs-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3116.806418] Lustre: tfs-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3116.808840] Lustre: Skipped 1 previous similar message [ 3118.100832] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 3120.762253] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3122.095415] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 3122.970207] Lustre: 245815:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 3125.009097] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3127.000201] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 3127.203813] LustreError: 246166:0:(ldlm_lib.c:1179:target_handle_connect()) tfs-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3127.207314] Lustre: tfs-OST0000: new connection from tfs-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49792) [ 3129.646582] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3131.548046] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 3131.756678] Lustre: tfs-OST0000: new connection from tfs-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:131 to 0x280000400:161) [ 3131.757232] Lustre: tfs-OST0001: new connection from tfs-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:3 to 0x2c0000400:65) [ 3134.429079] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 3135.479146] Lustre: 247680:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 3141.600166] LustreError: tfs-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3141.602836] Lustre: tfs-MDT0000-osp-MDT0001: Connection to tfs-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3141.606175] Lustre: Skipped 3 previous similar messages [ 3141.607866] Lustre: tfs-MDT0000: Not available for connect from 0@lo (stopping) [ 3141.609552] Lustre: Skipped 4 previous similar messages [ 3143.383337] Lustre: server umount tfs-MDT0000 complete [ 3144.604313] LustreError: 247683:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782930789 with bad export cookie 13852569216196072209 [ 3144.607683] LustreError: 247683:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 3144.609123] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3144.719117] Lustre: server umount tfs-MDT0001 complete [ 3156.480971] Lustre: server umount tfs-OST0000 complete [ 3166.876538] Lustre: server umount tfs-OST0001 complete [ 3173.916597] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 3177.295524] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3177.435586] LustreError: 249926:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3177.451748] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3177.453632] Lustre: Skipped 3 previous similar messages [ 3178.741490] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 3181.600035] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3182.974510] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 3183.932738] Lustre: 251069:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 3186.125660] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3187.298905] LustreError: 251422:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3187.303026] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49824) [ 3188.183300] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 3191.085441] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3192.239326] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:3 to 0x2c0000400:97) [ 3192.239888] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:131 to 0x280000400:193) [ 3193.262326] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 3196.416576] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 3197.626218] Lustre: 252935:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 3199.598993] Lustre: DEBUG MARKER: == conf-sanity test 104a: Make sure user defined options are reflected in mount ========================================================== 14:34:04 (1782930844) [ 3212.770664] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3212.772296] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3212.774410] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3212.778085] Lustre: Skipped 5 previous similar messages [ 3212.781400] Lustre: Skipped 7 previous similar messages [ 3217.435039] Lustre: server umount lustre-MDT0000 complete [ 3217.888483] LustreError: 249927:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3217.892367] LustreError: 249927:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 3218.659167] LustreError: 249901:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782930863 with bad export cookie 13852569216196074106 [ 3218.662479] LustreError: 249901:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 3218.663493] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3223.009050] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3223.010189] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 3223.014628] Lustre: Skipped 2 previous similar messages [ 3224.821958] Lustre: server umount lustre-MDT0001 complete [ 3232.122901] Lustre: server umount lustre-OST0000 complete [ 3239.441040] Lustre: server umount lustre-OST0001 complete [ 3241.541318] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_hostid [ 3244.773441] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 3255.663928] LDISKFS-fs (dm-0): Mount option "noacl" will be removed by 3.5 [ 3255.663928] Contact linux-ldiskfs@vger.kernel.org if you think we should keep it. [ 3255.663928] [ 3255.669775] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: acl,user_xattr,errors=remount-ro,noacl,no_mbcache,nodelalloc [ 3255.739224] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3255.747517] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3255.781829] Lustre: lustre-MDT0000: new disk, initializing [ 3255.799694] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3255.801738] Lustre: Skipped 3 previous similar messages [ 3255.805987] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3257.055856] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 3261.255634] LDISKFS-fs (dm-1): Mount option "noacl" will be removed by 3.5 [ 3261.255634] Contact linux-ldiskfs@vger.kernel.org if you think we should keep it. [ 3261.255634] [ 3261.264589] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: acl,user_xattr,errors=remount-ro,noacl,no_mbcache,nodelalloc [ 3261.306996] Lustre: 256113:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 3261.331140] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 3261.332914] Lustre: Skipped 1 previous similar message [ 3261.370433] Lustre: lustre-MDT0001: new disk, initializing [ 3261.415211] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 3261.418720] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 3262.770186] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 3266.865262] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3266.966318] Lustre: lustre-OST0000: new disk, initializing [ 3266.976035] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3266.978754] Lustre: 257695:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3268.094920] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 3268.099463] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 3268.144197] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 3268.908459] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 3272.984300] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3273.049594] Lustre: lustre-OST0001: new disk, initializing [ 3273.051321] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 3273.053882] Lustre: 258563:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3274.952074] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 3274.955442] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 3274.988671] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 3274.995912] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 3279.262354] Lustre: DEBUG MARKER: == conf-sanity test 104b: Mount uses last flock argument ========================================================== 14:35:23 (1782930923) [ 3282.575637] Lustre: DEBUG MARKER: == conf-sanity test 105: check file creation for ro and rw bind mnt pt ========================================================== 14:35:27 (1782930927) [ 3295.715583] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3295.716670] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3295.720633] Lustre: Skipped 1 previous similar message [ 3295.722830] Lustre: Skipped 1 previous similar message [ 3299.899496] Lustre: server umount lustre-OST0000 complete [ 3300.837965] LustreError: 257884:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3300.843840] LustreError: 257884:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 3302.368071] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3307.367181] Lustre: server umount lustre-MDT0000 complete [ 3308.588019] LustreError: 256106:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782930953 with bad export cookie 13852569216196075884 [ 3308.591204] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3308.592127] LustreError: 256106:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3314.740749] Lustre: server umount lustre-MDT0001 complete [ 3318.501504] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing unload_modules_local [ 3328.342280] Lustre: server umount lustre-OST0001 complete [ 3330.462146] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_hostid [ 3336.960202] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 3348.947695] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3349.027345] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3349.039727] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3349.075252] Lustre: lustre-MDT0000: new disk, initializing [ 3349.098508] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3350.480690] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 3354.723356] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3354.766954] Lustre: 263088:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 3354.872024] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 3356.228065] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 3359.985752] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3361.846365] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3364.176885] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3364.291071] Lustre: 265055:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3365.622910] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 3365.625277] Lustre: Skipped 1 previous similar message [ 3365.628125] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 3365.655840] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 3366.121562] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 3369.577873] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3376.096450] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3376.097772] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3376.098722] LustreError: Skipped 1 previous similar message [ 3376.101678] Lustre: Skipped 4 previous similar messages [ 3376.102410] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3376.106223] Lustre: Skipped 8 previous similar messages [ 3377.866146] Lustre: server umount lustre-OST0000 complete [ 3385.110154] Lustre: server umount lustre-MDT0000 complete [ 3386.213987] LustreError: 263884:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782931031 with bad export cookie 13852569216196077347 [ 3386.217422] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3386.218351] LustreError: 263884:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3386.317138] Lustre: server umount lustre-MDT0001 complete [ 3389.573336] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing unload_modules_local [ 3390.506115] Key type lgssc unregistered [ 3390.623351] LNet: 266813:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3390.625462] LNetError: 266813:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3390.634356] LNet: Removed LNI 192.168.203.148@tcp [ 3390.923128] Key type .llcrypt unregistered [ 3390.924843] Key type ._llcrypt unregistered [ 3399.813441] Key type ._llcrypt registered [ 3399.814423] Key type .llcrypt registered [ 3399.845882] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 3400.258821] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3400.265164] alg: No test for adler32 (adler32-zlib) [ 3401.110414] Lustre: Lustre: Build Version: 2.17.54_83_g6b808a3 [ 3401.194722] LNet: Added LNI 192.168.203.148@tcp [8/256/0/180] [ 3402.767164] Key type lgssc registered [ 3403.105370] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3405.503116] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3405.509366] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3406.641322] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3407.830042] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 3410.391971] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3410.490643] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3411.666448] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 3413.940822] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3415.680315] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3417.880076] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3417.991361] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3419.878408] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 3422.230592] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3422.571827] Lustre: Setting parameter lustre-OST0000.ost.unknown_param=50 in log lustre-OST0000 [ 3425.248730] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3425.250073] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3425.255361] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3429.328388] Lustre: server umount lustre-OST0000 complete [ 3430.879742] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3430.881968] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3430.885639] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3436.000409] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3436.000665] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3436.702307] Lustre: server umount lustre-MDT0000 complete [ 3437.948375] LustreError: 268232:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782931083 with bad export cookie 9739201805805594736 [ 3437.951233] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3437.954956] LustreError: 268232:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 3438.063481] Lustre: server umount lustre-MDT0001 complete [ 3441.695104] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing unload_modules_local [ 3442.749499] Key type lgssc unregistered [ 3442.878368] LNet: 271833:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3442.881630] LNetError: 271833:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3442.890286] LNet: Removed LNI 192.168.203.148@tcp [ 3443.196439] Key type .llcrypt unregistered [ 3443.197608] Key type ._llcrypt unregistered [ 3449.929083] Key type ._llcrypt registered [ 3449.930183] Key type .llcrypt registered [ 3449.969829] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 3450.315931] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3450.370423] alg: No test for adler32 (adler32-zlib) [ 3451.243566] Lustre: Lustre: Build Version: 2.17.54_83_g6b808a3 [ 3451.352243] LNet: Added LNI 192.168.203.148@tcp [8/256/0/180] [ 3452.935118] Key type lgssc registered [ 3453.300304] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3456.514353] Lustre: lustre-OST0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3456.521434] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3471.967393] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 3477.087278] LustreError: 273002:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.203.148@tcp: failed processing log, type 4: rc = -110 [ 3503.711187] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3505.635755] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 3507.948522] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3508.680119] Lustre: server umount lustre-OST0000 complete [ 3514.059066] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing unload_modules_local [ 3515.001100] Key type lgssc unregistered [ 3515.132363] LNet: 274632:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3515.134836] LNetError: 274632:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3515.142342] LNet: Removed LNI 192.168.203.148@tcp [ 3515.456165] Key type .llcrypt unregistered [ 3515.457411] Key type ._llcrypt unregistered [ 3528.604111] Key type ._llcrypt registered [ 3528.605246] Key type .llcrypt registered [ 3528.638670] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 3528.952443] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3528.998932] alg: No test for adler32 (adler32-zlib) [ 3529.853520] Lustre: Lustre: Build Version: 2.17.54_83_g6b808a3 [ 3529.938706] LNet: Added LNI 192.168.203.148@tcp [8/256/0/180] [ 3531.519121] Key type lgssc registered [ 3531.874615] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3536.050229] loop0: detected capacity change from 0 to 204800000 [ 3536.101382] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 3536.104689] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 3536.225910] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 3536.576419] loop0: detected capacity change from 0 to 204800000 [ 3536.637433] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 3536.640648] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 3536.758267] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 3537.108803] loop0: detected capacity change from 0 to 204800000 [ 3537.166272] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 3537.169804] blk_update_request: operation not supported error, dev loop0, sector 8224 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 3537.208227] blk_update_request: operation not supported error, dev loop0, sector 58264 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 3537.568596] loop0: detected capacity change from 0 to 204800000 [ 3537.624434] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 3538.010254] loop0: detected capacity change from 0 to 204800000 [ 3538.019300] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 3539.343203] loop0: detected capacity change from 0 to 204800000 [ 3539.354245] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 3540.656350] loop0: detected capacity change from 0 to 204800000 [ 3540.671667] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 3541.943958] loop0: detected capacity change from 0 to 204800000 [ 3541.953147] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 3543.232539] loop0: detected capacity change from 0 to 204800000 [ 3543.260627] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3543.270855] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3543.314541] Lustre: 278023:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 3543.317811] Lustre: 278023:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index 'nodemap' with [0x200000003:0x3:0x0]: rc = 0 [ 3543.321330] Lustre: 278023:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000003:0xa:0x0]: rc = 0 [ 3543.326797] Lustre: 278023:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000003:0xb:0x0]: rc = 0 [ 3543.331838] Lustre: 278023:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000003:0xc:0x0]: rc = 0 [ 3543.334825] Lustre: 278023:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000-MDT0000' with [0x200000005:0x1:0x0]: rc = 0 [ 3543.337851] Lustre: 278023:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000-MDT0000' with [0x200000005:0x2:0x0]: rc = 0 [ 3543.340971] Lustre: 278023:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000-MDT0000' with [0x200000005:0x3:0x0]: rc = 0 [ 3543.344112] Lustre: 278023:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x20000' with [0x200000006:0x20000:0x0]: rc = 0 [ 3543.347913] Lustre: 278023:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1020000' with [0x200000006:0x1020000:0x0]: rc = 0 [ 3543.351442] Lustre: 278023:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2020000' with [0x200000006:0x2020000:0x0]: rc = 0 [ 3543.354531] Lustre: 278023:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000006:0x10000:0x0]: rc = 0 [ 3543.358054] Lustre: 278023:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000006:0x1010000:0x0]: rc = 0 [ 3543.362507] Lustre: 278023:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000006:0x2010000:0x0]: rc = 0 [ 3545.946774] Lustre: server umount MGS complete [ 3546.241449] loop0: detected capacity change from 0 to 204800000 [ 3546.272328] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3546.450768] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3546.467763] Lustre: lustre-MDT0000: Aborting client recovery [ 3546.783067] loop1: detected capacity change from 0 to 204800000 [ 3546.853845] LDISKFS-fs (loop1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3546.887307] Lustre: 278454:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 3546.890908] Lustre: 278454:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x10000-MDT0001' with [0x200000005:0x1:0x0]: rc = 0 [ 3546.894431] Lustre: 278454:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x2010000' with [0x200000003:0x6:0x0]: rc = 0 [ 3546.900144] Lustre: 278454:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x10000' with [0x200000003:0x4:0x0]: rc = 0 [ 3546.903169] Lustre: 278454:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x1010000-MDT0001' with [0x200000005:0x2:0x0]: rc = 0 [ 3546.906313] Lustre: 278454:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x1010000' with [0x200000003:0x5:0x0]: rc = 0 [ 3546.912713] Lustre: 278454:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x2010000-MDT0001' with [0x200000005:0x3:0x0]: rc = 0 [ 3546.923133] Lustre: Found index 1 for lustre-MDT0001, updating log [ 3546.998082] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3547.030289] Lustre: lustre-MDT0001: Aborting client recovery [ 3547.346526] loop2: detected capacity change from 0 to 204800000 [ 3547.381569] LDISKFS-fs (loop2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3547.414678] Lustre: 278537:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 3547.419266] Lustre: 278537:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 3547.422582] Lustre: 278537:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x1020000-OST0000' with [0x200000005:0x2:0x0]: rc = 0 [ 3547.426467] Lustre: 278537:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 3547.429845] Lustre: 278537:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x2020000-OST0000' with [0x200000005:0x3:0x0]: rc = 0 [ 3547.433472] Lustre: 278537:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 3547.437544] Lustre: 278537:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x20000-OST0000' with [0x200000005:0x1:0x0]: rc = 0 [ 3547.482877] Lustre: Found index 0 for lustre-OST0000, updating log [ 3547.494767] Lustre: 278554:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3547.515689] Lustre: lustre-OST0000: Aborting recovery [ 3547.818959] loop3: detected capacity change from 0 to 204800000 [ 3547.851730] LDISKFS-fs (loop3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3547.891298] Lustre: 278620:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 3547.896024] Lustre: 278620:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x2020000-OST0001' with [0x200000005:0x3:0x0]: rc = 0 [ 3547.902479] Lustre: 278620:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x1020000-OST0001' with [0x200000005:0x2:0x0]: rc = 0 [ 3547.908695] Lustre: 278620:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 3547.914066] Lustre: 278620:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 3547.919349] Lustre: 278620:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 3547.924166] Lustre: 278620:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x20000-OST0001' with [0x200000005:0x1:0x0]: rc = 0 [ 3553.261453] LustreError: 278398:0:(lod_dev.c:511:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 7, retries 0, failed: rc = -108 [ 3556.321101] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 3556.329318] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 3556.331524] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000bd0 [ 3556.338641] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000bd0 [ 3557.345479] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:5 to 0x280000400:33) [ 3557.345537] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:5 to 0x2c0000400:33) [ 3558.587228] LustreError: 278364:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0000: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0000 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0000/identity_upcall, time 224us: rc = -2 [ 3572.704331] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3572.704689] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3572.705192] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3572.707642] Lustre: Skipped 1 previous similar message [ 3575.969777] Lustre: server umount lustre-MDT0000 complete [ 3576.311832] LustreError: 278347:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782931221 with bad export cookie 14175805762324884628 [ 3576.314261] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3576.318070] LustreError: 278347:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 3577.823751] LustreError: 278562:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3577.824169] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3577.824408] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 3577.824415] Lustre: Skipped 3 previous similar messages [ 3577.831105] LustreError: 278562:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 3577.835081] Lustre: Skipped 3 previous similar messages [ 3581.855520] LustreError: 278393:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3581.855535] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 3581.859774] LustreError: 278393:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 3581.861596] Lustre: Skipped 2 previous similar messages [ 3582.580743] Lustre: server umount lustre-MDT0001 complete [ 3597.279148] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 3597.316850] Lustre: server umount lustre-OST0000 complete [ 3603.742218] Lustre: server umount lustre-OST0001 complete [ 3606.340459] Lustre: DEBUG MARKER: == conf-sanity test 109a: test lctl clear_conf fsname ==== 14:40:50 (1782931250) [ 3615.336768] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_hostid [ 3618.380145] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 3631.712881] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3631.815029] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3631.831816] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3631.877854] Lustre: lustre-MDT0000: new disk, initializing [ 3631.899523] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3631.901737] Lustre: Skipped 2 previous similar messages [ 3631.907193] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3633.273869] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 3637.504518] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3637.544335] Lustre: 282682:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 3637.573320] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 3637.575519] Lustre: Skipped 1 previous similar message [ 3637.615471] Lustre: lustre-MDT0001: new disk, initializing [ 3637.650306] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3637.663540] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 3637.667247] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 3638.984751] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 3642.589733] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3644.320955] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3646.608974] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3646.731527] Lustre: lustre-OST0000: new disk, initializing [ 3646.733135] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3646.735485] Lustre: 284652:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3646.737712] Lustre: 284652:0:(osd_compat.c:1352:osd_object_spec_find()) Skipped 1 previous similar message [ 3646.765035] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3648.603764] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 3651.577654] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 3651.582585] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 3651.619087] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 3652.218028] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3654.559708] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 3660.844513] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 3666.592815] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 3673.111787] Lustre: Modifying parameter lustre-client.llite.max_read_ahead_mb=64 in log lustre-client [ 3718.116471] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3718.117462] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3718.117654] LustreError: Skipped 1 previous similar message [ 3718.119424] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3718.121037] Lustre: Skipped 1 previous similar message [ 3719.268102] Lustre: server umount lustre-OST0000 complete [ 3723.232673] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3723.233330] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3723.236663] Lustre: Skipped 1 previous similar message [ 3723.238388] Lustre: Skipped 1 previous similar message [ 3726.755819] Lustre: server umount lustre-MDT0000 complete [ 3728.030444] LustreError: 286202:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782931373 with bad export cookie 14175805762324887337 [ 3728.034069] LustreError: 286202:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 5 previous similar messages [ 3728.034650] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3728.165078] Lustre: server umount lustre-MDT0001 complete [ 3731.007493] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3732.426805] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 3734.152222] Lustre: server umount MGS complete [ 3737.975096] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3738.128241] LustreError: 288611:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3738.134924] LustreError: 288624:0:(qmt_pool.c:1645:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 3738.159104] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3739.553815] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 3742.354821] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3743.797987] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 3746.157347] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3747.952532] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3750.162825] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3752.120306] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 3754.442660] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3785.186619] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3785.186629] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3785.190786] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3785.194709] Lustre: Skipped 1 previous similar message [ 3785.197668] Lustre: Skipped 2 previous similar messages [ 3790.732164] Lustre: server umount lustre-OST0000 complete [ 3793.887816] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3793.890422] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3805.664084] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3805.666821] Lustre: Skipped 8 previous similar messages [ 3806.175068] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 3806.233978] Lustre: server umount lustre-MDT0000 complete [ 3807.433150] LustreError: 288592:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782931452 with bad export cookie 14175805762324889178 [ 3807.435835] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3807.439065] LustreError: 288592:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 3807.552618] Lustre: server umount lustre-MDT0001 complete [ 3811.044843] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing unload_modules_local [ 3811.972909] Key type lgssc unregistered [ 3812.083379] LNet: 292575:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3812.086076] LNetError: 292575:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3812.092289] LNet: Removed LNI 192.168.203.148@tcp [ 3812.367707] Key type .llcrypt unregistered [ 3812.368765] Key type ._llcrypt unregistered [ 3823.692803] Key type ._llcrypt registered [ 3823.694045] Key type .llcrypt registered [ 3823.738614] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_hostid [ 3829.823395] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 3830.131860] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3830.173084] alg: No test for adler32 (adler32-zlib) [ 3831.027330] Lustre: Lustre: Build Version: 2.17.54_83_g6b808a3 [ 3831.112400] LNet: Added LNI 192.168.203.148@tcp [8/256/0/180] [ 3832.687206] Key type lgssc registered [ 3833.029547] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3843.523085] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3843.528920] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3844.616933] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3844.628190] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3844.665296] Lustre: lustre-MDT0000: new disk, initializing [ 3844.685844] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3844.690986] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3846.064446] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 3850.090555] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3850.133491] Lustre: 296504:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 3850.155874] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 3850.157721] Lustre: Skipped 1 previous similar message [ 3850.193234] Lustre: lustre-MDT0001: new disk, initializing [ 3850.224861] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3850.236421] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 3850.241060] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 3851.592889] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 3855.228093] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3856.888508] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3859.065807] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3859.170643] Lustre: lustre-OST0000: new disk, initializing [ 3859.172239] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3859.174964] Lustre: 298470:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3859.201353] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3860.977618] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 3861.558701] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 3861.563295] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 3861.600624] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 3864.525442] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3867.885415] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 3872.959545] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 3877.546152] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 3922.912617] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3922.914758] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3922.916208] LustreError: Skipped 1 previous similar message [ 3922.921268] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3922.927031] Lustre: Skipped 1 previous similar message [ 3928.034550] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3928.038631] Lustre: Skipped 1 previous similar message [ 3928.715993] Lustre: server umount lustre-OST0000 complete [ 3932.127810] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3932.130050] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3932.133255] Lustre: Skipped 1 previous similar message [ 3932.135253] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3933.153127] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3936.039486] Lustre: server umount lustre-MDT0000 complete [ 3937.341138] LustreError: 296496:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782931582 with bad export cookie 7261733823672423772 [ 3937.344579] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3937.346474] LustreError: 296496:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3937.472559] Lustre: server umount lustre-MDT0001 complete [ 3940.373815] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3941.712771] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 3943.250426] Lustre: server umount MGS complete [ 3946.687140] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3946.837863] LustreError: 302344:0:(qmt_pool.c:1645:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 3946.859545] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3948.128982] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 3950.736357] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3952.049745] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 3954.195324] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3955.828943] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3957.855678] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3957.953589] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3957.955988] Lustre: Skipped 1 previous similar message [ 3959.720724] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 3961.790721] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3998.177444] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3998.179490] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3998.182924] Lustre: Skipped 1 previous similar message [ 3998.184937] Lustre: Skipped 2 previous similar messages [ 3998.186533] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4003.292518] Lustre: server umount lustre-OST0000 complete [ 4007.391892] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4007.394603] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4007.399611] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4010.655637] Lustre: server umount lustre-MDT0000 complete [ 4011.882241] LustreError: 302312:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782931657 with bad export cookie 7261733823672425599 [ 4011.885656] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4011.886978] LustreError: 302312:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4011.995126] Lustre: server umount lustre-MDT0001 complete [ 4015.780296] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing unload_modules_local [ 4016.831096] Key type lgssc unregistered [ 4016.968359] LNet: 306293:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4016.971029] LNetError: 306293:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4016.978306] LNet: Removed LNI 192.168.203.148@tcp [ 4017.286896] Key type .llcrypt unregistered [ 4017.288755] Key type ._llcrypt unregistered [ 4023.862866] Key type ._llcrypt registered [ 4023.864015] Key type .llcrypt registered [ 4023.902136] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_hostid [ 4029.564068] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 4030.074365] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4030.107093] alg: No test for adler32 (adler32-zlib) [ 4030.976487] Lustre: Lustre: Build Version: 2.17.54_83_g6b808a3 [ 4031.081472] LNet: Added LNI 192.168.203.148@tcp [8/256/0/180] [ 4032.671237] Key type lgssc registered [ 4033.047020] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4040.490533] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 4045.288397] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4045.297469] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4046.386504] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 4046.397991] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 4046.433960] Lustre: lustre-MDT0000: new disk, initializing [ 4046.458642] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4046.464841] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 4047.886113] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 4052.496193] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4052.603609] Lustre: lustre-OST0000: new disk, initializing [ 4052.605281] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 4052.607763] Lustre: Skipped 1 previous similar message [ 4052.609666] Lustre: 310315:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 4052.635158] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4054.587455] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 4055.490909] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 4055.497409] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 4055.508814] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 4244.960073] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4244.963055] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4249.838740] Lustre: server umount lustre-MDT0000 complete [ 4251.145457] LustreError: 311196:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782931896 with bad export cookie 7597914128618196780 [ 4251.147444] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4251.151917] LustreError: 311196:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 4251.207987] Lustre: server umount lustre-OST0000 complete [ 4259.556232] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_hostid [ 4262.838385] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 4275.150397] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4275.235036] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 4275.247847] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 4275.287375] Lustre: lustre-MDT0000: new disk, initializing [ 4275.308726] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4275.314585] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 4276.680284] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 4280.847455] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4280.884698] Lustre: 314547:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 4280.907241] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 4280.908847] Lustre: Skipped 1 previous similar message [ 4280.941437] Lustre: lustre-MDT0001: new disk, initializing [ 4280.970579] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4280.982370] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 4280.986474] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 4282.296126] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 4286.016145] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4287.797250] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4290.011623] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4290.117431] Lustre: lustre-OST0000: new disk, initializing [ 4290.119881] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 4290.123753] Lustre: 316514:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 4290.153342] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4292.164506] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 4295.862714] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4297.210630] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 4297.215191] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 4297.234712] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 4297.256222] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 4297.316193] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 4298.637962] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 4298.712258] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 4302.306588] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4302.307079] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4302.309862] LustreError: Skipped 1 previous similar message [ 4302.314593] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4302.318787] Lustre: Skipped 1 previous similar message [ 4305.421853] Lustre: server umount lustre-OST0000 complete [ 4306.911743] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4306.914181] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4306.917286] Lustre: Skipped 1 previous similar message [ 4306.918809] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4312.544117] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4312.546611] Lustre: Skipped 3 previous similar messages [ 4312.723748] Lustre: server umount lustre-MDT0000 complete [ 4313.963316] LustreError: 316513:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782931959 with bad export cookie 7597914128621137557 [ 4313.966290] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4313.966718] LustreError: 316513:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4314.076549] Lustre: server umount lustre-MDT0001 complete [ 4315.215041] Lustre: DEBUG MARKER: SKIP: conf-sanity test_111 skipping SLOW test 111 [ 4315.795175] Lustre: DEBUG MARKER: == conf-sanity test 112a: mount OST with no_create option ========================================================== 14:52:40 (1782931960) [ 4317.945775] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4318.105382] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4319.327681] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 4322.087984] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4323.479639] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 4325.621294] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4327.207835] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4329.193062] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4330.989680] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 4333.222310] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4335.222764] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4335.274043] Lustre: lustre-OST0001: new disk, initializing [ 4335.275402] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 4335.277353] Lustre: 321659:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 4335.301404] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 4335.303936] Lustre: Skipped 2 previous similar messages [ 4337.078061] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 4344.317800] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 4344.321897] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 4344.336173] LustreError: 322228:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 4344.339550] LustreError: 322228:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 1 previous similar message [ 4345.378914] LustreError: 322228:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 4345.382740] LustreError: 322228:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 1 previous similar message [ 4345.936874] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 4346.006237] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 4346.403378] LustreError: 322232:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [ 4346.407048] LustreError: 322232:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 1 previous similar message [ 4347.776226] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff9c6085b90000.ost_server_uuid 50 [ 4348.279521] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff9c6085b90000.ost_server_uuid in FULL state after 0 sec [ 4348.450693] LustreError: 322232:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [ 4348.453820] LustreError: 322232:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 3 previous similar messages [ 4350.043338] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff9c6085b90000.ost_server_uuid 50 [ 4350.510768] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-ffff9c6085b90000.ost_server_uuid in FULL state after 0 sec [ 4351.528436] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 4364.771980] Lustre: lustre-OST0001-osc-MDT0001: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4364.773129] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 4364.778060] Lustre: Skipped 2 previous similar messages [ 4368.195682] Lustre: server umount lustre-OST0001 complete [ 4369.889879] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4369.889921] LustreError: 322742:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4369.900220] LustreError: 322742:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 4374.496342] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4374.500707] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4374.503481] Lustre: Skipped 3 previous similar messages [ 4375.011377] LustreError: 321224:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4375.019599] LustreError: 321224:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 4375.951460] Lustre: server umount lustre-OST0000 complete [ 4378.591912] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4378.596648] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4378.602287] Lustre: Skipped 1 previous similar message [ 4383.389358] Lustre: server umount lustre-MDT0000 complete [ 4384.685045] LustreError: 319559:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782932029 with bad export cookie 7597914128621138425 [ 4384.687513] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4384.688728] LustreError: 319559:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 4384.822146] Lustre: server umount lustre-MDT0001 complete [ 4388.612337] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing unload_modules_local [ 4389.691745] Key type lgssc unregistered [ 4389.822400] LNet: 324336:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4389.827267] LNetError: 324336:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4389.839324] LNet: Removed LNI 192.168.203.148@tcp [ 4390.160612] Key type .llcrypt unregistered [ 4390.161686] Key type ._llcrypt unregistered [ 4398.951843] Key type ._llcrypt registered [ 4398.952640] Key type .llcrypt registered [ 4398.989235] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 4399.303553] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4399.333317] alg: No test for adler32 (adler32-zlib) [ 4400.184422] Lustre: Lustre: Build Version: 2.17.54_83_g6b808a3 [ 4400.263746] LNet: Added LNI 192.168.203.148@tcp [8/256/0/180] [ 4401.839130] Key type lgssc registered [ 4402.157218] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4404.456100] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4404.463157] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4405.610857] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4406.947957] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 4409.262441] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4411.450653] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4411.570132] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4412.869239] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 4416.020677] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4416.141899] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4418.084666] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 4420.438314] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4421.285034] LustreError: 327410:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4421.290911] LustreError: 327410:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 4422.710605] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4422.782604] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 4424.756959] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 4427.160565] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 4430.315285] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:65) [ 4430.315460] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:33) [ 4434.038907] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing wait_import_state (FULL|IDLE) os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [ 4434.113937] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 4510.175868] LustreError: lustre-OST0001-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4510.178866] Lustre: lustre-OST0001-osc-MDT0001: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4510.185087] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 4512.226048] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 4512.228518] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4512.233078] LustreError: lustre-OST0001-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4515.574500] Lustre: server umount lustre-OST0001 complete [ 4517.344699] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4517.345617] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4517.347255] LustreError: 329072:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4517.350628] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4517.355028] LustreError: 329072:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 4517.358118] Lustre: Skipped 2 previous similar messages [ 4522.465724] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4522.465828] LustreError: 328181:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4522.467722] Lustre: Skipped 1 previous similar message [ 4522.475023] LustreError: 328181:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 4523.090105] Lustre: server umount lustre-OST0000 complete [ 4524.511776] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4524.516673] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4524.525163] Lustre: Skipped 1 previous similar message [ 4527.584399] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4527.586278] Lustre: Skipped 2 previous similar messages [ 4530.520556] Lustre: server umount lustre-MDT0000 complete [ 4531.647278] LustreError: 325714:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782932176 with bad export cookie 13382648921482191955 [ 4531.650902] LustreError: 325714:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 4531.651237] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4531.757448] Lustre: server umount lustre-MDT0001 complete [ 4535.290372] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing unload_modules_local [ 4536.276660] Key type lgssc unregistered [ 4536.402496] LNet: 330664:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4536.404471] LNetError: 330664:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4536.414342] LNet: Removed LNI 192.168.203.148@tcp [ 4536.676160] Key type .llcrypt unregistered [ 4536.677789] Key type ._llcrypt unregistered [ 4552.977286] Key type ._llcrypt registered [ 4552.978276] Key type .llcrypt registered [ 4553.015229] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 4553.353828] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4553.392277] alg: No test for adler32 (adler32-zlib) [ 4554.236733] Lustre: Lustre: Build Version: 2.17.54_83_g6b808a3 [ 4554.338106] LNet: Added LNI 192.168.203.148@tcp [8/256/0/180] [ 4555.919198] Key type lgssc registered [ 4556.258061] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4559.104995] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4559.110815] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4560.249623] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4561.578459] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 4564.387957] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4564.519781] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4565.910249] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 4566.844569] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 4568.891671] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4569.018302] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4570.018690] LustreError: 334418:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4570.022048] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:97) [ 4570.023576] LustreError: 334418:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 4570.776301] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 4573.366151] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4573.438472] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 4574.505091] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:65) [ 4575.131490] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 4578.962285] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 4581.413114] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 4584.931258] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4584.932031] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4584.932961] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4584.934401] Lustre: Skipped 3 previous similar messages [ 4590.053174] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4590.054988] Lustre: Skipped 4 previous similar messages [ 4590.740690] Lustre: server umount lustre-MDT0000 complete [ 4591.834070] LustreError: 332909:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782932237 with bad export cookie 8668037686777623184 [ 4591.837086] LustreError: 332909:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 4591.837290] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4591.937534] Lustre: server umount lustre-MDT0001 complete [ 4603.394989] Lustre: server umount lustre-OST0000 complete [ 4613.862852] Lustre: server umount lustre-OST0001 complete [ 4619.163839] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 4622.464037] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4622.593867] LustreError: 338179:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4622.613584] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4623.905100] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 4626.577700] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4627.891968] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 4628.777703] Lustre: 339319:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 4630.748123] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4630.858900] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4630.861990] Lustre: Skipped 1 previous similar message [ 4631.908602] LustreError: 339671:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4631.911219] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:129) [ 4632.665540] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 4635.272691] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4636.396810] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:97) [ 4637.109077] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 4639.999502] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 4641.071041] Lustre: 341185:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 4642.272066] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4642.273972] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4642.277398] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4646.883525] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4646.884208] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4646.885927] Lustre: Skipped 1 previous similar message [ 4646.888731] Lustre: Skipped 1 previous similar message [ 4648.087765] Lustre: server umount lustre-MDT0000 complete [ 4649.279017] LustreError: 338922:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782932294 with bad export cookie 8668037686777624801 [ 4649.282370] LustreError: 338922:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 4649.283102] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4649.390310] Lustre: server umount lustre-MDT0001 complete [ 4660.228744] Lustre: server umount lustre-OST0000 complete [ 4671.713440] Lustre: server umount lustre-OST0001 complete [ 4672.846537] Lustre: DEBUG MARKER: SKIP: conf-sanity test_114 skipping SLOW test 114 [ 4673.341434] Lustre: DEBUG MARKER: SKIP: conf-sanity test_115 skipping excluded test 115 [ 4673.858470] Lustre: DEBUG MARKER: == conf-sanity test 116: big size MDT support ============ 14:58:38 (1782932318) [ 4680.949590] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 4683.918541] loop0: detected capacity change from 0 to 1099511627776 [ 4684.059560] SGI XFS with ACLs, security attributes, quota, no debug enabled [ 4684.062026] *** VALIDATE xfs *** [ 4684.066087] XFS (loop0): Mounting V5 Filesystem [ 4684.073030] XFS (loop0): Ending clean mount [ 4684.462410] loop1: detected capacity change from 0 to 18691697672192 [ 4704.040206] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_hostid [ 4706.719695] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 4717.923348] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4718.008789] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 4718.017713] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 4718.057961] Lustre: lustre-MDT0000: new disk, initializing [ 4718.077149] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4718.079063] Lustre: Skipped 1 previous similar message [ 4718.083810] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 4719.435616] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 4723.554947] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4723.597427] Lustre: 346296:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 4723.623745] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 4723.626377] Lustre: Skipped 1 previous similar message [ 4723.663725] Lustre: lustre-MDT0001: new disk, initializing [ 4723.708520] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 4723.713708] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 4725.077961] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 4728.767069] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4730.602907] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4732.887260] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4732.992847] Lustre: lustre-OST0000: new disk, initializing [ 4732.995125] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 4732.999488] Lustre: 348265:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 4734.332262] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 4734.337257] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 4734.374895] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 4735.050199] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 4738.651732] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4740.005286] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 4740.075982] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 4741.383176] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 4741.453356] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 4744.674238] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4744.674329] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4744.675740] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4744.675745] Lustre: Skipped 2 previous similar messages [ 4744.677764] LustreError: Skipped 1 previous similar message [ 4744.683276] Lustre: Skipped 2 previous similar messages [ 4748.179917] Lustre: server umount lustre-OST0000 complete [ 4749.792303] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4754.400168] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4754.404544] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4754.406514] Lustre: Skipped 2 previous similar messages [ 4755.615754] Lustre: server umount lustre-MDT0000 complete [ 4756.848133] LustreError: 347091:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782932402 with bad export cookie 8668037686777626334 [ 4756.851319] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4756.851372] LustreError: 347091:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 4756.968508] Lustre: server umount lustre-MDT0001 complete [ 4759.662250] XFS (loop0): Unmounting Filesystem [ 4761.195380] Lustre: DEBUG MARKER: == conf-sanity test 117: lctl get_param return errors properly ========================================================== 15:00:05 (1782932405) [ 4763.380374] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4763.521905] LustreError: 350818:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4763.543351] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4763.545798] Lustre: Skipped 2 previous similar messages [ 4764.792782] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 4767.515442] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4768.927817] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 4771.244306] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4772.987960] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4775.175488] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4777.124074] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 4779.470029] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4794.848883] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4794.851110] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4794.853526] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4794.856591] Lustre: Skipped 2 previous similar messages [ 4794.858461] Lustre: Skipped 1 previous similar message [ 4794.958957] Lustre: server umount lustre-OST0000 complete [ 4798.237124] Lustre: server umount lustre-MDT0000 complete [ 4798.433470] LustreError: 350819:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4799.461498] LustreError: 353427:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782932444 with bad export cookie 8668037686777627216 [ 4799.465643] LustreError: 353427:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 4799.466572] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4799.576424] Lustre: server umount lustre-MDT0001 complete [ 4803.075266] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing unload_modules_local [ 4804.031870] Key type lgssc unregistered [ 4804.150329] LNet: 354463:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4804.152684] LNetError: 354463:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4804.161294] LNet: Removed LNI 192.168.203.148@tcp [ 4804.471099] Key type .llcrypt unregistered [ 4804.472709] Key type ._llcrypt unregistered [ 4814.359450] Key type ._llcrypt registered [ 4814.360480] Key type .llcrypt registered [ 4814.397542] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 4814.702614] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4814.745043] alg: No test for adler32 (adler32-zlib) [ 4815.587649] Lustre: Lustre: Build Version: 2.17.54_83_g6b808a3 [ 4815.685082] LNet: Added LNI 192.168.203.148@tcp [8/256/0/180] [ 4817.271139] Key type lgssc registered [ 4817.640573] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4820.056749] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4820.063973] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4821.209070] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4822.478916] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 4825.259183] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4825.385146] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4826.714944] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 4829.095099] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4830.892673] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4833.075781] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4833.189352] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4835.000698] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 4837.236578] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4851.167953] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [ 4851.171125] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4851.175363] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 4851.682583] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4851.689891] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 4852.944485] Lustre: lustre-MDT0001: Not available for connect from 192.168.203.48@tcp (stopping) [ 4856.467425] Lustre: server umount lustre-MDT0001 complete [ 4856.801266] LustreError: 356016:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4856.809112] LustreError: 356016:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 4858.057600] LustreError: 356013:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.203.48@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4860.022296] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4860.059063] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [ 4860.060803] Lustre: Found index 1 for lustre-MDT0001, updating log [ 4860.072494] Lustre: 356004:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 4860.189350] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4861.638543] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 4865.509499] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 4868.579821] LustreError: 359850:0:(obd_mount.c:225:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [ 4868.582146] LustreError: 359850:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [ 4868.585683] LustreError: 356009:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [ 4868.599150] LustreError: 359853:0:(obd_config.c:2103:class_config_llog_handler()) MGC192.168.203.148@tcp: cfg command failed: rc = -17 [ 4868.601552] Lustre: cmd=cf001 0:lustre-MDT0001-osp-MDT0000 1:osp 2:lustre-MDT0000-mdtlov_UUID [ 4868.601552] [ 5165.269850] Lustre: lustre-MDT0001: Not available for connect from 192.168.203.48@tcp (stopping) [ 5167.585336] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [ 5167.585642] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5170.377798] Lustre: lustre-MDT0001: Not available for connect from 192.168.203.48@tcp (stopping) [ 5170.380709] Lustre: Skipped 2 previous similar messages [ 5170.519143] Lustre: server umount lustre-MDT0001 complete [ 5172.704282] LustreError: 358312:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5172.713803] LustreError: 358312:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 5173.905330] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5173.938152] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [ 5173.942479] Lustre: Found index 1 for lustre-MDT0001, updating log [ 5173.958181] Lustre: 356006:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 5174.074768] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5175.390102] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 5179.365756] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 5182.438152] LustreError: 372519:0:(obd_mount.c:225:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [ 5182.441797] LustreError: 372519:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [ 5182.445673] LustreError: 356009:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [ 5182.447576] LustreError: 356009:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [ 5182.465223] LustreError: 372522:0:(obd_config.c:761:class_setup()) osp: device 8 already setup: rc = -17 [ 5182.467674] LustreError: 372522:0:(obd_config.c:866:class_detach()) OBD device 8 still set up [ 5182.469843] LustreError: 372522:0:(obd_config.c:2103:class_config_llog_handler()) MGC192.168.203.148@tcp: cfg command failed: rc = -17 [ 5182.472741] Lustre: cmd=cf003 0:lustre-MDT0001-osp-MDT0000 1:lustre-MDT0001_UUID 2:192.168.203.148@tcp [ 5182.472741] [ 5477.583826] Lustre: lustre-MDT0001: Not available for connect from 192.168.203.48@tcp (stopping) [ 5479.394061] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5479.398959] Lustre: Skipped 2 previous similar messages [ 5483.665343] Lustre: server umount lustre-MDT0001 complete [ 5484.512290] LustreError: 356756:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5484.517309] LustreError: 356756:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 5487.032335] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5487.068782] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [ 5487.070537] Lustre: Found index 1 for lustre-MDT0001, updating log [ 5487.083546] Lustre: 356006:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 5487.203563] Lustre: lustre-MDT0001: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [ 5488.564282] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 5492.709198] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 5495.269768] LustreError: 385196:0:(obd_mount.c:225:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [ 5495.272074] LustreError: 385196:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [ 5495.274678] LustreError: 356009:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [ 5495.276847] LustreError: 356009:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [ 5495.292793] LustreError: 385199:0:(lod_lov.c:212:lod_add_device()) lustre-MDT0001-osp-MDT0000: cannot connect to next dev lustre-MDT0001_UUID (-114) [ 5495.300548] LustreError: 385199:0:(obd_config.c:2103:class_config_llog_handler()) MGC192.168.203.148@tcp: cfg command failed: rc = -114 [ 5495.305408] Lustre: cmd=cf014 0:lustre-MDT0000-mdtlov 1:lustre-MDT0001_UUID 2:1 3:1 [ 5495.305408] [ 5804.512185] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5804.515119] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5804.519525] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5804.521482] Lustre: Skipped 3 previous similar messages [ 5808.918285] Lustre: server umount lustre-MDT0000 complete [ 5810.097262] LustreError: 355997:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782933455 with bad export cookie 17261955056246102783 [ 5810.100950] LustreError: 355997:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 5810.102041] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5810.143843] LustreError: 358505:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5816.297377] Lustre: server umount lustre-MDT0001 complete [ 5817.609246] Lustre: server umount lustre-OST0000 complete [ 5820.519723] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_hostid [ 5823.622919] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 5835.052987] Lustre: DEBUG MARKER: == conf-sanity test 120: cross-target rename should not create bad symlinks ========================================================== 15:17:59 (1782933479) [ 5837.177267] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5837.258901] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 5837.269996] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 5837.311454] Lustre: lustre-MDT0000: new disk, initializing [ 5837.333209] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5837.342036] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 5838.672267] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 5842.649357] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5842.703062] Lustre: 399709:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 5842.730559] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 5842.733992] Lustre: Skipped 1 previous similar message [ 5842.770407] Lustre: lustre-MDT0001: new disk, initializing [ 5842.802498] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5842.814305] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 5842.817888] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 5844.126243] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 5847.726353] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5849.442617] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 5851.627167] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5851.732189] Lustre: lustre-OST0000: new disk, initializing [ 5851.735408] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 5851.740440] Lustre: 401675:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 5851.771184] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5852.598213] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 5852.601726] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 5852.633731] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 5853.639207] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug -1 all [ 5857.249499] Lustre: DEBUG MARKER: oleg348-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5862.881072] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5862.882983] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5862.885855] Lustre: Skipped 5 previous similar messages [ 5862.887477] Lustre: Skipped 6 previous similar messages [ 5865.951973] Lustre: server umount lustre-MDT0000 complete [ 5867.154104] LustreError: 400505:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782933512 with bad export cookie 17261955056246104722 [ 5867.157370] LustreError: 400518:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0000-osp-MDT0001: osp_attr_get update error [0x200000401:0x2:0x0]: rc = -5 [ 5867.157694] LustreError: MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5867.159985] LustreError: 400505:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 5867.276164] Lustre: server umount lustre-MDT0001 complete [ 5878.743056] Lustre: server umount lustre-OST0000 complete [ 5888.009697] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing set_hostid [ 5891.050332] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local [ 5900.685764] Lustre: DEBUG MARKER: == conf-sanity test complete, duration 5779 sec ========== 15:19:05 (1782933545) [ 5901.223360] Lustre: DEBUG MARKER: === conf-sanity: start cleanup 15:19:05 (1782933545) === [ 5902.343277] Lustre: DEBUG MARKER: === conf-sanity: finish cleanup 15:19:06 (1782933546) === [ 5914.880451] Lustre: DEBUG MARKER: oleg348-server.virtnet: executing unload_modules_local [ 5915.926409] Key type lgssc unregistered [ 5916.055294] LNet: 408028:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5916.058290] LNetError: 408028:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5916.067346] LNet: Removed LNI 192.168.203.148@tcp [ 5916.394562] Key type .llcrypt unregistered [ 5916.396359] Key type ._llcrypt unregistered