[ 0.000000] Linux version 4.18.0rh8.10-debug (green@maintenance) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-26) (GCC)) #2 SMP Mon Jul 14 01:24:22 EDT 2025 [ 0.000000] Command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffcdfff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffce000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x0000000146dfffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.8 present. [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 [ 0.000000] Hypervisor detected: KVM [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 470112402 cycles [ 0.000000] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns [ 0.000000] tsc: Detected 2399.996 MHz processor [ 0.000000] last_pfn = 0x146e00 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0xbffce max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000f54b0-0x000f54bf] [ 0.000000] RAMDISK: [mem 0xbcc54000-0xbffbffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F52D0 000014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 0x00000000BFFE247C 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 0x00000000BFFE2318 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 0x00000000BFFE0040 0022D8 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 0x00000000BFFE0000 000040 [ 0.000000] ACPI: APIC 0x00000000BFFE238C 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: HPET 0x00000000BFFE241C 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: WAET 0x00000000BFFE2454 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0xbffe2318-0xbffe238b] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe2317] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0xbffe238c-0xbffe241b] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0xbffe241c-0xbffe2453] [ 0.000000] ACPI: Reserving WAET table memory at [mem 0xbffe2454-0xbffe247b] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x0000000146dfffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x1465a3000-0x1465cdfff] [ 0.000000] Reserving 256MB of memory at 2560MB for crashkernel (System RAM: 4205MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009efff] [ 0.000000] node 0: [mem 0x0000000000100000-0x00000000bffcdfff] [ 0.000000] node 0: [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Zeroed struct page in unavailable ranges: 4756 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x0000000146dfffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] TSC deadline timer available [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] kvm-guest: KVM setup pv remote TLB flush [ 0.000000] kvm-guest: setup PV sched yield [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbffce000-0xbfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.000000] [mem 0xc0000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u524288 [ 0.000000] kvm-guest: PV spinlocks enabled [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1059606 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] audit: disabled (until reboot) [ 0.000000] software IO TLB: area num 4. [ 0.000000] Memory: 2829652K/4306352K available (18435K kernel code, 11221K rwdata, 7248K rodata, 2908K init, 18040K bss, 524580K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] ftrace: allocating 41240 entries in 162 pages [ 0.000000] ftrace: allocated 162 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU event tracing is enabled. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=4. [ 0.000000] rcu: RCU callback double-/use-after-free debug enabled. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 [ 0.000000] NR_IRQS: 524544, nr_irqs: 456, preallocated irqs: 16 [ 0.000000] random: get_random_bytes called from start_kernel+0x622/0x9a8 with crng_init=0 [ 0.001000] Console: colour *CGA 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns [ 0.001010] APIC: Switch to symmetric I/O mode setup [ 0.002254] x2apic enabled [ 0.003004] Switched APIC routing to physical x2apic. [ 0.004006] kvm-guest: setup PV IPIs [ 0.006673] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.007000] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229833f6470, max_idle_ns: 440795327230 ns [ 0.007018] Calibrating delay loop (skipped) preset value.. 4799.99 BogoMIPS (lpj=2399996) [ 0.008006] pid_max: default: 32768 minimum: 301 [ 0.009098] LSM: Security Framework initializing [ 0.010027] Yama: becoming mindful. [ 0.011019] SELinux: Initializing. [ 0.012036] *** VALIDATE selinux *** [ 0.018620] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, vmalloc) [ 0.022111] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc) [ 0.023083] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.024061] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.025058] *** VALIDATE tmpfs *** [ 0.026321] *** VALIDATE proc *** [ 0.027143] *** VALIDATE cgroup *** [ 0.028004] *** VALIDATE cgroup2 *** [ 0.029073] x86/cpu: User Mode Instruction Prevention (UMIP) activated [ 0.030095] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.031003] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 [ 0.032016] Spectre V2 : User space: Vulnerable [ 0.033003] Speculative Store Bypass: Vulnerable [ 0.035673] debug: unmapping init [mem 0xffffffff87c59000-0xffffffff87c60fff] [ 0.037115] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (family: 0x6, model: 0x3e, stepping: 0x4) [ 0.038415] Performance Events: IvyBridge events, full-width counters, Intel PMU driver. [ 0.039010] ... version: 2 [ 0.039983] ... bit width: 48 [ 0.040006] ... generic registers: 4 [ 0.041005] ... value mask: 0000ffffffffffff [ 0.042006] ... max period: 00007fffffffffff [ 0.043005] ... fixed-purpose events: 3 [ 0.043920] ... event mask: 000000070000000f [ 0.044192] rcu: Hierarchical SRCU implementation. [ 0.046154] smp: Bringing up secondary CPUs ... [ 0.047416] x86: Booting SMP configuration: [ 0.048017] .... node #0, CPUs: #1 #2 #3 [ 0.050486] smp: Brought up 1 node, 4 CPUs [ 0.051879] smpboot: Max logical packages: 1 [ 0.052007] smpboot: Total of 4 processors activated (19199.96 BogoMIPS) [ 0.246022] node 0 deferred pages initialised in 193ms [ 0.248154] devtmpfs: initialized [ 0.249159] x86/mm: Memory block size: 128MB [ 0.251242] gcov: version magic: 0x41383552 [ 0.252560] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.255080] futex hash table entries: 1024 (order: 4, 65536 bytes, vmalloc) [ 0.257316] pinctrl core: initialized pinctrl subsystem [ 0.258094] [ 0.258413] ************************************************************* [ 0.260021] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.261005] ** ** [ 0.262005] ** IOMMU DebugFS SUPPORT HAS BEEN ENABLED IN THIS KERNEL ** [ 0.264006] ** ** [ 0.265005] ** This means that this kernel is built to expose internal ** [ 0.267006] ** IOMMU data structures, which may compromise security on ** [ 0.268005] ** your system. ** [ 0.269005] ** ** [ 0.271005] ** If you see this message and you are not debugging the ** [ 0.272007] ** kernel, report this immediately to your vendor! ** [ 0.274008] ** ** [ 0.276007] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.278008] ************************************************************* [ 0.280737] NET: Registered protocol family 16 [ 0.283461] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations [ 0.285030] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.287027] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.289078] cpuidle: using governor menu [ 0.290367] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.291327] PCI: Using configuration type 1 for base access [ 0.293094] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.299102] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.301030] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.303073] cryptd: max_cpu_qlen set to 1000 [ 0.304204] ACPI: Added _OSI(Module Device) [ 0.305018] ACPI: Added _OSI(Processor Device) [ 0.306000] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.307013] ACPI: Added _OSI(Processor Aggregator Device) [ 0.311300] ACPI: 1 ACPI AML tables successfully acquired and loaded [ 0.315370] ACPI: Interpreter enabled [ 0.316038] ACPI: PM: (supports S0 S3 S4 S5) [ 0.316945] ACPI: Using IOAPIC for interrupt routing [ 0.318053] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.320334] ACPI: Enabled 2 GPEs in block 00 to 0F [ 0.327854] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.329019] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3] [ 0.330008] acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI] [ 0.332046] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.336080] acpiphp: Slot [2] registered [ 0.337035] acpiphp: Slot [5] registered [ 0.337940] acpiphp: Slot [6] registered [ 0.339053] acpiphp: Slot [7] registered [ 0.339986] acpiphp: Slot [8] registered [ 0.340049] acpiphp: Slot [9] registered [ 0.340865] acpiphp: Slot [10] registered [ 0.342073] acpiphp: Slot [3] registered [ 0.342934] acpiphp: Slot [4] registered [ 0.344044] acpiphp: Slot [11] registered [ 0.344916] acpiphp: Slot [12] registered [ 0.345053] acpiphp: Slot [13] registered [ 0.346014] acpiphp: Slot [14] registered [ 0.346887] acpiphp: Slot [15] registered [ 0.348043] acpiphp: Slot [16] registered [ 0.348928] acpiphp: Slot [17] registered [ 0.350053] acpiphp: Slot [18] registered [ 0.350988] acpiphp: Slot [19] registered [ 0.352044] acpiphp: Slot [20] registered [ 0.352905] acpiphp: Slot [21] registered [ 0.353043] acpiphp: Slot [22] registered [ 0.355092] acpiphp: Slot [23] registered [ 0.356071] acpiphp: Slot [24] registered [ 0.358090] acpiphp: Slot [25] registered [ 0.360072] acpiphp: Slot [26] registered [ 0.362075] acpiphp: Slot [27] registered [ 0.363060] acpiphp: Slot [28] registered [ 0.364055] acpiphp: Slot [29] registered [ 0.365020] acpiphp: Slot [30] registered [ 0.365990] acpiphp: Slot [31] registered [ 0.367061] PCI host bridge to bus 0000:00 [ 0.368011] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.370012] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.371008] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.373008] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 0.375009] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] [ 0.376010] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.377132] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.379774] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.381834] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 0.388011] pci 0000:00:01.1: reg 0x20: [io 0xc320-0xc32f] [ 0.391078] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.393013] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.395007] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.396008] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.398514] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 0.400659] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 0.402030] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 0.404968] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 [ 0.407840] pci 0000:00:02.0: reg 0x10: [io 0xc300-0xc31f] [ 0.417012] pci 0000:00:02.0: reg 0x20: [mem 0xe0000000000-0xe0000003fff 64bit pref] [ 0.420014] pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 0.424427] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 [ 0.430018] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] [ 0.434013] pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] [ 0.447021] pci 0000:00:05.0: reg 0x20: [mem 0xe0000004000-0xe0000007fff 64bit pref] [ 0.458455] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 [ 0.467018] pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] [ 0.472012] pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 0.486014] pci 0000:00:06.0: reg 0x20: [mem 0xe0000008000-0xe000000bfff 64bit pref] [ 0.492889] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 [ 0.498012] pci 0000:00:07.0: reg 0x10: [io 0xc100-0xc17f] [ 0.502012] pci 0000:00:07.0: reg 0x14: [mem 0xfebc2000-0xfebc2fff] [ 0.512012] pci 0000:00:07.0: reg 0x20: [mem 0xe000000c000-0xe000000ffff 64bit pref] [ 0.522870] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 [ 0.528012] pci 0000:00:08.0: reg 0x10: [io 0xc180-0xc1ff] [ 0.534012] pci 0000:00:08.0: reg 0x14: [mem 0xfebc3000-0xfebc3fff] [ 0.546017] pci 0000:00:08.0: reg 0x20: [mem 0xe0000010000-0xe0000013fff 64bit pref] [ 0.555655] pci 0000:00:09.0: [1af4:1001] type 00 class 0x010000 [ 0.562014] pci 0000:00:09.0: reg 0x10: [io 0xc200-0xc27f] [ 0.568019] pci 0000:00:09.0: reg 0x14: [mem 0xfebc4000-0xfebc4fff] [ 0.578010] pci 0000:00:09.0: reg 0x20: [mem 0xe0000014000-0xe0000017fff 64bit pref] [ 0.585814] pci 0000:00:0a.0: [1af4:1001] type 00 class 0x010000 [ 0.590007] pci 0000:00:0a.0: reg 0x10: [io 0xc280-0xc2ff] [ 0.593007] pci 0000:00:0a.0: reg 0x14: [mem 0xfebc5000-0xfebc5fff] [ 0.603008] pci 0000:00:0a.0: reg 0x20: [mem 0xe0000018000-0xe000001bfff 64bit pref] [ 0.610055] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 [ 0.612224] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 0.613185] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 [ 0.614222] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 0.616109] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 [ 0.619164] iommu: Default domain type: Passthrough [ 0.620481] SCSI subsystem initialized [ 0.621083] ACPI: bus type USB registered [ 0.621991] usbcore: registered new interface driver usbfs [ 0.623035] usbcore: registered new interface driver hub [ 0.625037] usbcore: registered new device driver usb [ 0.626132] pps_core: LinuxPPS API ver. 1 registered [ 0.627007] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 0.630054] PTP clock support registered [ 0.632064] EDAC MC: Ver: 3.0.0 [ 0.633098] PCI: Using ACPI for IRQ routing [ 0.634617] NetLabel: Initializing [ 0.635006] NetLabel: domain hash size = 128 [ 0.635961] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 0.637050] NetLabel: unlabeled traffic allowed by default [ 0.639084] vgaarb: loaded [ 0.640230] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 0.641006] hpet0: 3 comparators, 64-bit 100.000000 MHz counter [ 0.645273] clocksource: Switched to clocksource kvm-clock [ 0.724035] VFS: Disk quotas dquot_6.6.0 [ 0.724942] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 0.726451] *** VALIDATE ramfs *** [ 0.727212] *** VALIDATE hugetlbfs *** [ 0.728142] pnp: PnP ACPI init [ 0.729718] pnp: PnP ACPI: found 6 devices [ 0.743132] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 0.745154] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 0.746450] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 0.747681] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 0.749104] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 0.750405] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] [ 0.752078] NET: Registered protocol family 2 [ 0.753617] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, vmalloc) [ 0.757251] tcp_listen_portaddr_hash hash table entries: 4096 (order: 5, 163840 bytes, vmalloc) [ 0.759662] TCP established hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.763792] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc) [ 0.766414] TCP: Hash tables configured (established 65536 bind 65536) [ 0.768564] MPTCP token hash table entries: 8192 (order: 6, 393216 bytes, vmalloc) [ 0.770618] UDP hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.772471] UDP-Lite hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.774450] NET: Registered protocol family 1 [ 0.776169] RPC: Registered named UNIX socket transport module. [ 0.777498] RPC: Registered udp transport module. [ 0.778502] RPC: Registered tcp transport module. [ 0.779504] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 0.781021] NET: Registered protocol family 44 [ 0.782258] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 0.783589] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 0.784949] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 0.786609] PCI: CLS 0 bytes, default 64 [ 0.788528] Unpacking initramfs... [ 2.234638] debug: unmapping init [mem 0xffff9232fcc54000-0xffff9232fffbffff] [ 2.240905] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 2.242735] software IO TLB: mapped [mem 0x00000000b8c54000-0x00000000bcc54000] (64MB) [ 2.246780] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229833f6470, max_idle_ns: 440795327230 ns [ 2.707392] Initialise system trusted keyrings [ 2.708828] Key type blacklist registered [ 2.710423] workingset: timestamp_bits=36 max_order=20 bucket_order=0 [ 2.718641] zbud: loaded [ 2.721407] *** VALIDATE nfs *** [ 2.722452] *** VALIDATE nfs4 *** [ 2.723873] pstore: using deflate compression [ 2.726893] Platform Keyring initialized [ 2.816615] NET: Registered protocol family 38 [ 2.817945] Key type asymmetric registered [ 2.818927] Asymmetric key parser 'x509' registered [ 2.820265] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 2.822373] io scheduler mq-deadline registered [ 2.824597] io scheduler kyber registered [ 2.825749] io scheduler bfq registered [ 2.827082] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 2.829139] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 2.831131] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 2.833493] ACPI: Power Button [PWRF] [ 2.838183] ACPI: \_SB_.LNKB: Enabled at IRQ 10 [ 2.844385] ACPI: \_SB_.LNKA: Enabled at IRQ 11 [ 2.854646] ACPI: \_SB_.LNKC: Enabled at IRQ 11 [ 2.861057] ACPI: \_SB_.LNKD: Enabled at IRQ 10 [ 2.873763] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 2.900542] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 2.928682] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 2.933619] Non-volatile memory driver v1.3 [ 2.935231] Linux agpgart interface v0.103 [ 2.967097] virtio_blk virtio1: [vda] 149768 512-byte logical blocks (76.7 MB/73.1 MiB) [ 2.970073] vda: detected capacity change from 0 to 76681216 [ 2.986807] virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) [ 2.989150] vdb: detected capacity change from 0 to 1073741824 [ 3.009248] virtio_blk virtio3: [vdc] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 3.014659] vdc: detected capacity change from 0 to 2621440000 [ 3.030509] virtio_blk virtio4: [vdd] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 3.034286] vdd: detected capacity change from 0 to 2621440000 [ 3.047156] virtio_blk virtio5: [vde] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 3.049127] vde: detected capacity change from 0 to 4294967296 [ 3.066573] virtio_blk virtio6: [vdf] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 3.069016] vdf: detected capacity change from 0 to 4294967296 [ 3.075663] libphy: Fixed MDIO Bus: probed [ 3.084485] usbcore: registered new interface driver usbserial_generic [ 3.086252] usbserial: USB Serial support registered for generic [ 3.088194] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 3.091609] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 3.093108] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 3.095077] mousedev: PS/2 mouse device common for all mice [ 3.098901] rtc_cmos 00:05: RTC can wake from S4 [ 3.101415] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 3.101452] rtc_cmos 00:05: registered as rtc0 [ 3.107159] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 3.109649] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 [ 3.110806] intel_pstate: CPU model not supported [ 3.118335] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 [ 3.122199] hid: raw HID events driver (C) Jiri Kosina [ 3.124261] usbcore: registered new interface driver usbhid [ 3.126349] usbhid: USB HID core driver [ 3.127938] drop_monitor: Initializing network drop monitor service [ 3.130388] Initializing XFRM netlink socket [ 3.132329] NET: Registered protocol family 10 [ 3.135529] Segment Routing with IPv6 [ 3.136963] NET: Registered protocol family 17 [ 3.139312] mpls_gso: MPLS GSO support [ 3.146317] RAS: Correctable Errors collector initialized. [ 3.148348] AVX version of gcm_enc/dec engaged. [ 3.149915] AES CTR mode by8 optimization enabled [ 3.218805] sched_clock: Marking stable (3218785356, 0)->(3834603768, -615818412) [ 3.221919] registered taskstats version 1 [ 3.223425] Loading compiled-in X.509 certificates [ 3.225065] zswap: loaded using pool lzo/zbud [ 3.244862] Key type big_key registered [ 3.254445] Key type encrypted registered [ 3.256151] ima: No TPM chip found, activating TPM-bypass! [ 3.258237] ima: Allocated hash algorithm: sha1 [ 3.260183] ima: No architecture policies found [ 3.261817] evm: Initialising EVM extended attributes: [ 3.262934] evm: security.selinux [ 3.263516] evm: security.ima [ 3.264218] evm: security.capability [ 3.265356] evm: HMAC attrs: 0x1 [ 3.267354] rtc_cmos 00:05: setting system clock to 2026-09-14 06:13:46 UTC (1789366426) [ 3.272990] debug: unmapping init [mem 0xffffffff88c03000-0xffffffff88dfffff] [ 3.274871] debug: unmapping init [mem 0xffffffff87982000-0xffffffff87c58fff] [ 3.282054] Write protecting the kernel read-only data: 28672k [ 3.285402] debug: unmapping init [mem 0xffffffff86003000-0xffffffff861fffff] [ 3.287514] debug: unmapping init [mem 0xffffffff86914000-0xffffffff869fffff] [ 3.320677] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 3.326139] systemd[1]: Detected virtualization kvm. [ 3.327315] systemd[1]: Detected architecture x86-64. [ 3.329597] systemd[1]: Running in initial RAM disk. Welcome to Rocky Linux 8.10 (Green Obsidian) dracut-049-233.git20240115.el8 (Initramfs)! [ 3.361935] systemd[1]: No hostname configured. [ 3.363317] systemd[1]: Set hostname to . [ 3.365270] random: systemd: uninitialized urandom read (16 bytes read) [ 3.367173] systemd[1]: Initializing machine ID from random generator. [ 3.434866] random: ln: uninitialized urandom read (6 bytes read) [ 3.569749] random: systemd: uninitialized urandom read (16 bytes read) [ 3.574427] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 3.583992] systemd[1]: Reached target Local File Systems. [ OK ] Reached target Local File Systems. [ 3.594746] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Reached target Paths. [ OK ] Reached target Initrd Root Device. Starting Setup Virtual Console... Starting Create Volatile Files and Directories... [ OK ] Listening on udev Kernel Socket. Starting Create list of required st…ce nodes for the current kernel... [ OK ] Reached target Swap. Starting Apply Kernel Variables... [ OK ] Reached target Slices. [ OK ] Reached target Timers. [ OK ] Listening on Journal Socket (/dev/log). Starting Journal Service... [ OK ] Reached target Sockets. [ OK ] Started Memstrack Anylazing Service. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Started Setup Virtual Console. [ OK ] Started Create Volatile Files and Directories. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Apply Kernel Variables. Starting Create Static Device Nodes in /dev... Starting dracut cmdline hook... [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started Journal Service. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ 4.210485] device-mapper: uevent: version 1.0.3 [ 4.212414] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting dracut pre-trigger hook... [ OK ] Started dracut pre-trigger hook. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. Starting dracut initqueue hook... [ OK ] Reached target System Initialization. [ OK ] Reached target Basic System. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. [ 5.020706] virtio_net virtio0 ens2: renamed from eth0 [ 5.047134] random: fast init done [ 5.110380] scsi host0: ata_piix [ 5.120556] scsi host1: ata_piix [ 5.121483] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc320 irq 14 [ 5.123600] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc328 irq 15 [ 9.774356] random: crng init done [ 9.775728] random: 7 urandom warning(s) missed due to ratelimiting [ 9.802688] dracut-initqueue[582]: RTNETLINK answers: File exists Starting nbd nbd0... [ OK ] Started nbd nbd0. [ OK ] Started dracut initqueue hook. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Mounting /sysroot... [ 12.129942] EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Timers. [ OK ] Stopped dracut pre-pivot and cleanup hook. Stopping Hardware RNG Entropy Gatherer Daemon... [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped Hardware RNG Entropy Gatherer Daemon. [ OK ] Stopped target Basic System. [ OK ] Stopped target Paths. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Local Encrypted Volumes. [ OK ] Stopped Dispatch Password Requests to Console Directory Watch. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped dracut pre-trigger hook. Stopping udev Kernel Device Manager... [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Swap. [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped target Slices. [ OK ] Stopped target Sockets. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Reached target Switch Root. Starting Switch Root... [ 14.954848] printk: systemd: 26 output lines suppressed due to ratelimiting [ 15.346199] SELinux: Disabled at runtime. [ 15.897825] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 15.931083] systemd[1]: Detected virtualization kvm. [ 15.937503] systemd[1]: Detected architecture x86-64. Welcome to Rocky Linux 8.10 (Green Obsidian)! [ 16.994990] systemd[1]: initrd-switch-root.service: Succeeded. [ 16.999495] systemd[1]: Stopped Switch Root. [ OK ] Stopped Switch Root. [ 17.007378] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. [ 17.013956] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 17.020323] systemd[1]: Stopped Journal Service. [ OK ] Stopped Journal Service. [ 17.036529] systemd[1]: Starting Journal Service... Starting Journal Service... [ 17.050117] systemd[1]: Reached target rpc_pipefs.target. [ OK ] Reached target rpc_pipefs.target. [ OK ] Listening on udev Kernel Socket. [ OK ] Listening on udev Control Socket. [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd File Systems. Starting udev Coldplug all Devices... Mounting Kernel Debug File System... [ OK ] Created slice system-serial\x2dgetty.slice. [ OK ] Created slice system-sshd\x2dkeygen.slice. Starting Remount Root and Kernel File Systems... [ OK ] Created slice system-getty.slice. [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Stopped target Initrd Root File System. [ OK ] Started Forward Password Requests to Wall Directory Watch. Mounting Huge Pages File System... [ OK ] Created slice User and Session Slice. [ OK ] Reached target Slices. [ OK ] Reached target Paths. Mounting POSIX Message Queue File System... [FAILED] Failed to set up automount Arbitrar…rmats File System Automount Point. See 'systemctl status proc-sys-fs-binfmt_misc.automount' for details. Activating swap /dev/disk/by-label/SWAP... [ OK ] Listening on initctl Compatibility Named Pipe. Starting Create list of required st…ce nodes for the current kernel... [ OK ] Reached target Local Encrypted Volumes. [ 17.552354] Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. Starting Apply Kernel Variables... [ OK ] Listening on Process Core Dump Socket. [ OK ] Started Journal Service. [ OK ] Mounted Kernel Debug File System. [FAILED] Failed to start Remount Root and Kernel File Systems. See 'systemctl status systemd-remount-fs.service' for details. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Activated swap /dev/disk/by-label/SWAP. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Apply Kernel Variables. [ OK ] Started udev Coldplug all Devices. [ OK ] Reached target Swap. Starting Create Static Device Nodes in /dev... Starting Configure read-only root support... Starting Flush Journal to Persistent Storage... [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started Create Static Device Nodes in /dev. Starting udev Kernel Device Manager... [ OK ] Reached target Local File Systems (Pre). Mounting /mnt... Mounting /home/green/git/lustre-release... [ OK ] Mounted /mnt. [ 18.361654] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ OK ] Mounted /home/green/git/lustre-release. [ OK ] Started udev Kernel Device Manager. [ 19.873617] input: PC Speaker as /devices/platform/pcspkr/input/input5 [ 19.923147] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 20.387056] RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer [ 20.458830] EDAC sbridge: Ver: 1.1.2 [ 23.925676] Key type dns_resolver registered [ 24.308886] NFS: Registering the id_resolver key type [ 24.310802] Key type id_resolver registered [ 24.312341] Key type id_legacy registered [ OK ] Started Configure read-only root support. Starting Load/Save Random Seed... [ OK ] Reached target Local File Systems. Starting Create Volatile Files and Directories... Starting Rebuild Dynamic Linker Cache... Starting Mark the need to relabel after reboot... [ OK ] Started Load/Save Random Seed. [ OK ] Started Create Volatile Files and Directories. [ OK ] Started Mark the need to relabel after reboot. Starting RPC Bind... Starting Update UTMP about System Boot/Shutdown... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Started RPC Bind. [ OK ] Started Rebuild Dynamic Linker Cache. Starting Update is Completed... [ OK ] Started Update is Completed. [ OK ] Reached target System Initialization. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. [ OK ] Started D-Bus System Message Bus. Starting Restore /run/initramfs on shutdown... [ OK ] Started irqbalance daemon. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. [ OK ] Started dnf makecache --timer. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Reached target Timers. Starting Login Service... [ OK ] Reached target sshd-keygen.target. Starting Network Manager... [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Network Manager. Starting Network Manager Wait Online... [ OK ] Reached target Network. Starting Dynamic System Tuning Daemon... Starting OpenSSH server daemon... Starting GSSAPI Proxy Daemon... [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Started Login Service. [ OK ] Started OpenSSH server daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... Starting Hostname Service... [ OK ] Started Permit User Sessions. [ OK ] Started Serial Getty on ttyS0. [ OK ] Started Serial Getty on ttyS1. [ OK ] Started Getty on tty1. [ OK ] Reached target Login Prompts. [ OK ] Started Command Scheduler. [ OK ] Started Hostname Service. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... Starting Notify NFS peers of a restart... Starting System Logging Service... [ OK ] Started Notify NFS peers of a restart. Rocky Linux 8.10 (Green Obsidian) Kernel 4.18.0rh8.10-debug on an x86_64 oleg147-server login: [ 64.731888] libcfs: loading out-of-tree module taints kernel. [ 64.755753] Key type ._llcrypt registered [ 64.757488] Key type .llcrypt registered [ 64.806327] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_hostid [ 73.358218] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 73.992219] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 73.999516] alg: No test for adler32 (adler32-zlib) [ 74.991218] Lustre: Lustre: Build Version: 2.17.58_6_ge9bcf18 [ 75.298511] LNet: Added LNI 192.168.201.147@tcp [8/256/0/180] [ 76.919127] Key type lgssc registered [ 77.566253] Lustre: Echo OBD driver; http://www.lustre.org/ [ 84.917211] ZFS: Loaded module v2.3.2-1, ZFS pool version 5000, ZFS filesystem version 5 [ 101.155309] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 106.499559] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 106.509638] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 107.612783] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 107.627424] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 107.669936] Lustre: lustre-MDT0000: new disk, initializing [ 107.745445] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 107.761846] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 109.501403] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 117.421530] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 117.527349] Lustre: 6488:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 117.553598] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 117.556899] Lustre: Skipped 1 previous similar message [ 117.632815] Lustre: lustre-MDT0001: new disk, initializing [ 117.694665] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 117.729062] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 117.735959] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 121.682338] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 126.925557] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 133.257149] hrtimer: interrupt took 61742201 ns [ 140.737414] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 141.028396] Lustre: lustre-OST0000: new disk, initializing [ 141.030827] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 141.034564] Lustre: 8424:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 141.077390] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 149.881861] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 151.135110] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 151.161328] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 151.367394] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 178.406977] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 178.781510] Lustre: lustre-OST0001: new disk, initializing [ 178.800154] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 178.819873] Lustre: 9499:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 179.002780] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 187.459903] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 187.465423] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 187.525987] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 188.479277] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 200.481383] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 206.822305] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 212.428555] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing check_logdir /tmp/testlogs/ [ 216.798259] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing yml_node [ 221.918853] Lustre: DEBUG MARKER: Client: 2.17.58.6 [ 224.307228] Lustre: DEBUG MARKER: MDS: 2.17.58.6 [ 226.480655] Lustre: DEBUG MARKER: OSS: 2.17.58.6 [ 228.078179] Lustre: DEBUG MARKER: -----============= acceptance-small: conf-sanity ============----- Mon Sep 14 02:17:30 EDT 2026 [ 241.585153] Lustre: DEBUG MARKER: excepting tests: 102 106 115 32newtarball [ 243.019827] Lustre: DEBUG MARKER: skipping tests SLOW=no: 45 69 106 111 114 [ 259.043294] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 259.043844] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 259.049167] Lustre: Skipped 3 previous similar messages [ 259.053847] Lustre: Skipped 3 previous similar messages [ 263.969996] Lustre: server umount lustre-MDT0000 complete [ 267.800939] LustreError: 6477:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789366691 with bad export cookie 13260482866575794434 [ 267.810175] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 267.814330] LustreError: 6477:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 269.287227] LustreError: 6492:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 269.288336] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 269.302959] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 269.316780] LustreError: 6492:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 6 previous similar messages [ 269.338743] Lustre: Skipped 1 previous similar message [ 272.295253] LustreError: 6494:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 272.296066] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 272.320383] Lustre: Skipped 2 previous similar messages [ 274.201315] Lustre: server umount lustre-MDT0001 complete [ 277.902201] Lustre: server umount lustre-OST0000 complete [ 281.557797] Lustre: server umount lustre-OST0001 complete [ 287.150901] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_hostid [ 295.452798] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 329.223792] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 329.525357] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 329.553420] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 329.647359] Lustre: lustre-MDT0000: new disk, initializing [ 329.743787] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 329.761377] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 333.849840] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 344.568437] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 344.659927] Lustre: 15046:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 344.703756] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 344.706838] Lustre: Skipped 1 previous similar message [ 344.761433] Lustre: lustre-MDT0001: new disk, initializing [ 344.843813] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 344.884224] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 344.898457] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 348.711507] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 358.130870] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 363.946434] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 371.254228] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 371.564181] Lustre: lustre-OST0000: new disk, initializing [ 371.567400] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 371.572628] Lustre: 17018:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 371.658184] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 373.184867] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 373.193193] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 373.330257] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 378.347146] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 388.202398] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 393.001836] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 393.243198] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 398.725989] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 398.957826] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 403.945618] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 403.950133] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 403.962321] LustreError: Skipped 1 previous similar message [ 403.962975] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 403.995276] Lustre: Skipped 1 previous similar message [ 409.073554] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 409.086083] Lustre: Skipped 2 previous similar messages [ 415.200027] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 415.363719] Lustre: server umount lustre-OST0000 complete [ 421.858762] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 421.867701] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 421.879837] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 421.884087] Lustre: Skipped 2 previous similar messages [ 426.635806] Lustre: server umount lustre-MDT0000 complete [ 429.546110] LustreError: 16768:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 429.562957] LustreError: 16768:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 431.491958] LustreError: 15038:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789366854 with bad export cookie 13260482866575795960 [ 431.505838] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 431.510372] LustreError: 15038:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 432.143715] Lustre: server umount lustre-MDT0001 complete [ 437.737604] Lustre: DEBUG MARKER: == conf-sanity test 76a: set permanent params with lctl across mounts ========================================================== 02:20:59 (1789366859) [ 444.247473] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 444.936603] LustreError: 19284:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 445.019234] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 449.498972] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 450.018187] LustreError: 19285:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 458.496325] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 463.202214] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 470.847399] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 476.414172] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 483.094866] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 489.134676] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 496.659738] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 500.480981] Lustre: Modifying parameter general.osc.*.max_dirty_mb=452 in log params [ 506.341532] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 506.349264] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 506.360524] Lustre: Skipped 3 previous similar messages [ 506.371934] Lustre: Skipped 4 previous similar messages [ 512.306046] Lustre: server umount lustre-MDT0000 complete [ 516.554182] LustreError: 19264:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789366939 with bad export cookie 13260482866575796842 [ 516.567280] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 516.580073] LustreError: 19281:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 516.585562] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 516.602683] LustreError: 19281:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 516.906419] Lustre: server umount lustre-MDT0001 complete [ 522.918853] Lustre: server umount lustre-OST0000 complete [ 545.024800] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 555.439328] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 555.804623] LustreError: 23663:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 555.865251] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 555.872771] Lustre: Skipped 2 previous similar messages [ 561.449989] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 571.656256] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 576.888867] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 580.434828] Lustre: Setting parameter general.debug_raw_pointers=Y in log params [ 587.438414] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 594.191180] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 602.180106] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 602.339300] Lustre: lustre-OST0001: new disk, initializing [ 602.342573] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 602.347701] Lustre: 25977:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 604.405375] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 604.431717] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 604.557674] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 608.896553] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 617.745245] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 622.160866] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 635.370769] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 635.373609] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 635.383773] Lustre: Skipped 3 previous similar messages [ 635.387130] Lustre: Skipped 6 previous similar messages [ 640.165627] Lustre: server umount lustre-MDT0000 complete [ 640.483207] LustreError: 23658:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 640.505222] LustreError: 23658:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 6 previous similar messages [ 643.580622] LustreError: 23643:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789367066 with bad export cookie 13260482866575797696 [ 643.587253] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 643.591939] LustreError: 23643:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 5 previous similar messages [ 643.896656] Lustre: server umount lustre-MDT0001 complete [ 657.774516] Lustre: server umount lustre-OST0000 complete [ 660.790139] Lustre: 3626:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789367068/real 1789367068] req@ffff923242e36a00 x1876286765251072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789367084 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 661.519821] Lustre: server umount lustre-OST0001 complete [ 677.330388] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 686.991756] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 687.466806] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 687.473562] Lustre: Skipped 3 previous similar messages [ 691.805350] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 700.915940] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 705.984622] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 708.701722] Lustre: 30144:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 715.023173] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 720.730695] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 725.802301] LustreError: 30498:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 725.825771] LustreError: 30498:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [ 728.751745] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 734.498682] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 741.176911] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 744.100500] Lustre: 32023:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 752.609777] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 752.632419] Lustre: Skipped 2 previous similar messages [ 752.636350] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 752.644153] Lustre: Skipped 2 previous similar messages [ 755.217493] Lustre: server umount lustre-MDT0000 complete [ 758.927221] LustreError: 28977:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789367182 with bad export cookie 13260482866575798991 [ 758.934823] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 758.941901] LustreError: 28977:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 759.256594] Lustre: server umount lustre-MDT0001 complete [ 772.140755] Lustre: server umount lustre-OST0000 complete [ 785.876866] Lustre: server umount lustre-OST0001 complete [ 794.579681] Lustre: DEBUG MARKER: == conf-sanity test 76b: verify params log setup correctly ========================================================== 02:26:57 (1789367217) [ 817.784892] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 826.961725] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 830.314342] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 837.363753] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 841.166735] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 843.629654] Lustre: 35973:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 848.912439] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 854.309271] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 858.592635] LustreError: 36327:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 858.619336] LustreError: 36327:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 7 previous similar messages [ 861.735529] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 867.420923] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 873.425282] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 876.306613] Lustre: 37850:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 883.680341] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 883.690669] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 883.700780] Lustre: Skipped 3 previous similar messages [ 883.716280] Lustre: Skipped 5 previous similar messages [ 886.201617] Lustre: server umount lustre-MDT0000 complete [ 889.183982] LustreError: 34807:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789367312 with bad export cookie 13260482866575800097 [ 889.191136] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 889.195481] LustreError: 34807:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 889.419518] Lustre: server umount lustre-MDT0001 complete [ 902.231775] Lustre: server umount lustre-OST0000 complete [ 915.398221] Lustre: server umount lustre-OST0001 complete [ 921.351638] Lustre: DEBUG MARKER: == conf-sanity test 76c: verify changelog_mask is applied with lctl set_param -P ========================================================== 02:29:04 (1789367344) [ 933.693732] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 942.189755] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 945.927253] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 953.764341] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 954.117892] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 954.125199] Lustre: Skipped 8 previous similar messages [ 957.788948] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 960.381100] Lustre: 41138:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 965.877225] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 971.200649] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 977.601169] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 982.612100] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 988.663420] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 992.200988] Lustre: Setting parameter general.mdd.*.changelog_mask=-CLOSE in log params [ 992.205466] Lustre: Skipped 1 previous similar message [ 995.297899] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1000.968829] Lustre: server umount lustre-MDT0000 complete [ 1004.496431] LustreError: 39971:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789367427 with bad export cookie 13260482866575801203 [ 1004.498636] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1004.510993] LustreError: 39971:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 1010.823927] Lustre: server umount lustre-MDT0001 complete [ 1017.695689] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1029.088558] LustreError: 3622:0:(client.c:1404:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff923376c95500 x1876286765391744/t0(0) o250->MGC192.168.201.147@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 1033.289857] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 1039.796057] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 1039.878554] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1043.994800] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 1045.486968] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 1045.494126] Lustre: Skipped 1 previous similar message [ 1050.841252] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1052.091360] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 1056.618413] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 1057.928599] Lustre: DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec [ 1065.960381] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1065.974808] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1065.976575] Lustre: Skipped 9 previous similar messages [ 1069.245679] Lustre: server umount lustre-MDT0000 complete [ 1072.586170] LustreError: 39973:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789367495 with bad export cookie 13260482866575802330 [ 1072.595270] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1072.597718] LustreError: 39973:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 1072.928793] Lustre: server umount lustre-MDT0001 complete [ 1086.818409] Lustre: server umount lustre-OST0000 complete [ 1100.556823] Lustre: server umount lustre-OST0001 complete [ 1109.054386] Lustre: DEBUG MARKER: == conf-sanity test 76d: verify llite.*.xattr_cache can be set by 'lctl set_param -P' correctly ========================================================== 02:32:11 (1789367531) [ 1123.694135] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 1132.549185] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1133.030817] LustreError: 47626:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1133.051207] LustreError: 47626:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 28 previous similar messages [ 1137.867626] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 1146.802216] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1151.117223] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 1154.090454] Lustre: 48777:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 1154.100351] Lustre: 48777:0:(mgs_llog.c:1450:mgs_modify_param()) Skipped 1 previous similar message [ 1160.223726] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1165.616668] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 1172.703641] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1177.997864] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 1184.940729] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1188.339710] Lustre: Setting parameter general.llite.*.xattr_cache=0 in log params [ 1198.570289] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1198.574591] Lustre: Skipped 17 previous similar messages [ 1198.576683] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1202.646977] Lustre: server umount lustre-MDT0000 complete [ 1205.196927] LustreError: 48779:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789367628 with bad export cookie 13260482866575803114 [ 1205.200472] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1205.203143] LustreError: 48779:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 1205.467128] Lustre: server umount lustre-MDT0001 complete [ 1218.083211] Lustre: server umount lustre-OST0000 complete [ 1231.539514] Lustre: server umount lustre-OST0001 complete [ 1238.533904] Lustre: DEBUG MARKER: == conf-sanity test 77: comma-separated MGS NIDs and failover node NIDs ========================================================== 02:34:21 (1789367661) [ 1240.321358] Lustre: DEBUG MARKER: SKIP: conf-sanity test_77 mixed loopback and real device not working [ 1241.693030] Lustre: DEBUG MARKER: == conf-sanity test 78: run resize2fs on MDT and OST filesystems ========================================================== 02:34:24 (1789367664) [ 1249.245638] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_hostid [ 1255.080505] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 1272.195225] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1272.468990] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1272.532568] Lustre: lustre-MDT0000: new disk, initializing [ 1272.628709] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1276.103299] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 1282.393679] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1286.942595] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1287.228542] Lustre: 54845:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1288.368347] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 1288.393086] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 1291.688747] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 1298.886341] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1300.368335] Lustre: DEBUG MARKER: create test files [ 1324.521304] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1324.522033] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1324.533708] Lustre: Skipped 5 previous similar messages [ 1337.311196] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 1337.597491] Lustre: server umount lustre-OST0000 complete [ 1340.933400] Lustre: server umount lustre-MDT0000 complete [ 1348.727925] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing unload_modules_local [ 1350.819315] Key type lgssc unregistered [ 1351.066069] LNet: 56471:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1351.070550] LNetError: 56471:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1351.084699] LNet: Removed LNI 192.168.201.147@tcp [ 1351.900648] Key type .llcrypt unregistered [ 1351.904340] Key type ._llcrypt unregistered [ 1371.108227] Key type ._llcrypt registered [ 1371.109650] Key type .llcrypt registered [ 1371.167944] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 1371.924391] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1371.934059] alg: No test for adler32 (adler32-zlib) [ 1372.899755] Lustre: Lustre: Build Version: 2.17.58_6_ge9bcf18 [ 1373.077319] LNet: Added LNI 192.168.201.147@tcp [8/256/0/180] [ 1374.687223] Key type lgssc registered [ 1375.394679] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1380.219809] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1380.236697] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1381.535752] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1384.852266] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 1390.205538] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1394.605227] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1394.813176] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1398.715541] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 1403.033163] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1406.056454] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:102 to 0x240000400:129) [ 1406.102817] Lustre: 59180:0:(osd_internal.h:1460:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 510 < left 544, rollback = 9 [ 1406.108666] Lustre: 59180:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 32/128/5, destroy: 0/0/0 [ 1406.112792] Lustre: 59180:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 1406.116515] Lustre: 59180:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/18/1, punch: 0/0/0, quota 1/3/0 [ 1406.119707] Lustre: 59180:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 1406.124425] Lustre: 59180:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 1412.022834] Lustre: DEBUG MARKER: check files after expanding the MDT and OST filesystems [ 1415.225615] Lustre: DEBUG MARKER: create more files after expanding the MDT and OST filesystems [ 1421.800260] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1421.804276] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1421.818630] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1425.219354] Lustre: server umount lustre-OST0000 complete [ 1427.666380] Lustre: server umount lustre-MDT0000 complete [ 1435.222850] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing unload_modules_local [ 1437.242655] Key type lgssc unregistered [ 1437.457829] LNet: 60789:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1437.466771] LNetError: 60789:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1438.504942] LNet: Removed LNI 192.168.201.147@tcp [ 1439.001373] Key type .llcrypt unregistered [ 1439.003493] Key type ._llcrypt unregistered [ 1459.236951] Key type ._llcrypt registered [ 1459.239509] Key type .llcrypt registered [ 1459.306359] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 1459.994453] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1460.018875] alg: No test for adler32 (adler32-zlib) [ 1461.003826] Lustre: Lustre: Build Version: 2.17.58_6_ge9bcf18 [ 1461.187750] LNet: Added LNI 192.168.201.147@tcp [8/256/0/180] [ 1462.816667] Key type lgssc registered [ 1463.645862] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1468.705559] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1468.723164] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1470.000824] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1472.435043] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 1477.045403] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1481.441723] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1481.641855] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1485.200575] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 1489.744783] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1494.888133] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:140 to 0x240000400:161) [ 1494.926357] Lustre: 63593:0:(osd_internal.h:1460:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 509 < left 544, rollback = 9 [ 1494.932300] Lustre: 63593:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 32/128/6, destroy: 0/0/0 [ 1494.936658] Lustre: 63593:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 1494.941104] Lustre: 63593:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/18/1, punch: 0/0/0, quota 1/3/0 [ 1494.945116] Lustre: 63593:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 1494.948524] Lustre: 63593:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 1498.838829] Lustre: DEBUG MARKER: check files after shrinking the MDT and OST filesystems [ 1505.248066] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1505.254700] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1505.256082] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1509.155355] Lustre: server umount lustre-OST0000 complete [ 1511.567431] Lustre: server umount lustre-MDT0000 complete [ 1516.566827] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing unload_modules_local [ 1517.855472] Key type lgssc unregistered [ 1518.013423] LNet: 65152:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1518.019336] LNetError: 65152:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1518.037497] LNet: Removed LNI 192.168.201.147@tcp [ 1518.423103] Key type .llcrypt unregistered [ 1518.424562] Key type ._llcrypt unregistered [ 1527.932979] Key type ._llcrypt registered [ 1527.934287] Key type .llcrypt registered [ 1528.016451] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_hostid [ 1538.328544] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 1538.974354] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1539.070246] alg: No test for adler32 (adler32-zlib) [ 1539.996751] Lustre: Lustre: Build Version: 2.17.58_6_ge9bcf18 [ 1540.167776] LNet: Added LNI 192.168.201.147@tcp [8/256/0/180] [ 1541.783200] Key type lgssc registered [ 1542.430848] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1561.040379] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1561.071136] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1562.225593] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1562.262466] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1562.327928] Lustre: lustre-MDT0000: new disk, initializing [ 1562.372981] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1562.387530] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1564.829848] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 1572.699640] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1572.765469] Lustre: 68275:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1572.805364] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 1572.809259] Lustre: Skipped 1 previous similar message [ 1572.871785] Lustre: lustre-MDT0001: new disk, initializing [ 1572.967930] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1573.015194] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 1573.030328] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1575.692631] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 1581.621297] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1585.022958] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 1588.971086] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1589.106555] Lustre: lustre-OST0000: new disk, initializing [ 1589.109833] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1589.116470] Lustre: 70242:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1589.173070] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1592.433880] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 1598.513038] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1598.522468] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 1598.530543] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1598.620199] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1601.212650] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1601.352413] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1604.465979] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1604.631057] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1609.192678] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1609.199540] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1609.203179] LustreError: Skipped 1 previous similar message [ 1609.208140] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1609.216683] Lustre: Skipped 1 previous similar message [ 1609.229634] Lustre: Skipped 1 previous similar message [ 1612.067628] Lustre: server umount lustre-OST0000 complete [ 1618.913062] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1618.915961] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1618.928952] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1624.544878] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1624.550897] Lustre: Skipped 3 previous similar messages [ 1629.151199] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 1629.318663] Lustre: server umount lustre-MDT0000 complete [ 1631.909387] LustreError: 68268:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789368055 with bad export cookie 2833746679209085964 [ 1631.916481] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1631.918321] LustreError: 68268:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 1632.155980] Lustre: server umount lustre-MDT0001 complete [ 1637.875428] Lustre: DEBUG MARKER: == conf-sanity test 79: format MDT/OST without mgs option (should return errors) ========================================================== 02:41:00 (1789368060) [ 1644.403339] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 1670.572572] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_hostid [ 1677.174987] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 1702.522954] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1702.660326] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1702.680486] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1702.732739] Lustre: lustre-MDT0000: new disk, initializing [ 1702.768264] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1702.778060] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1705.542922] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 1712.494978] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1712.551378] Lustre: 76260:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1712.620495] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 1712.624280] Lustre: Skipped 1 previous similar message [ 1712.690523] Lustre: lustre-MDT0001: new disk, initializing [ 1712.754244] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1712.780576] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 1712.785738] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1715.577496] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 1721.716239] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1724.953970] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 1729.348086] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1729.519648] Lustre: lustre-OST0000: new disk, initializing [ 1729.522693] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1729.527716] Lustre: 78227:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1729.591938] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1733.633487] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 1739.294114] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 1739.304864] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1739.359290] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1740.229595] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1743.244437] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1743.378906] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1745.985271] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1746.083866] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1749.472140] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1749.474754] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1749.485249] Lustre: Skipped 1 previous similar message [ 1749.489537] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1749.498297] Lustre: Skipped 1 previous similar message [ 1753.349083] Lustre: server umount lustre-OST0000 complete [ 1759.201276] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1759.212818] LustreError: Skipped 1 previous similar message [ 1759.220214] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1759.225497] Lustre: Skipped 1 previous similar message [ 1759.228844] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1761.672166] Lustre: server umount lustre-MDT0000 complete [ 1764.048598] LustreError: 76251:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789368187 with bad export cookie 2833746679209086839 [ 1764.055370] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1764.057424] LustreError: 76251:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 1764.262171] Lustre: server umount lustre-MDT0001 complete [ 1769.902321] Lustre: DEBUG MARKER: == conf-sanity test 80: mgc import reconnect race ======== 02:43:12 (1789368192) [ 1773.987953] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1774.241226] LustreError: 80636:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1774.257926] LustreError: 80636:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [ 1774.292965] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1777.110410] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 1779.684212] LustreError: 80635:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1782.255233] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1784.758753] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 1788.818617] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1792.326378] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 1796.297064] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1800.272104] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 1804.708910] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1806.966744] Lustre: 83303:0:(genops.c:1774:obd_export_evict_by_uuid()) MGS: evicting ab1eab39-6b7c-463f-874a-4892b73df095 at adminstrative request [ 1807.793598] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1807.806350] Lustre: *** cfs_fail_loc=906, val=2147483648*** [ 1818.087087] Lustre: MGS: Client ab1eab39-6b7c-463f-874a-4892b73df095 (at 0@lo) reconnecting [ 1818.099918] Lustre: Evicted from MGS (at 0@lo) after server handle changed from 0x27537d9745b352f0 to 0x27537d9745b35590 [ 1818.117468] Lustre: MGC192.168.201.147@tcp: Connection restored to 0@lo (at 0@lo) [ 1841.334343] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1841.477648] Lustre: lustre-OST0001: new disk, initializing [ 1841.481702] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 1841.486276] Lustre: 83699:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1841.538505] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 1841.544024] Lustre: Skipped 2 previous similar messages [ 1844.718570] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 1850.509195] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1851.428821] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 1851.432869] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 1851.478564] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 1856.482357] LustreError: lustre-OST0001-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1856.487359] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1856.489792] LustreError: Skipped 1 previous similar message [ 1856.492397] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 1856.496280] Lustre: Skipped 2 previous similar messages [ 1856.499864] Lustre: Skipped 1 previous similar message [ 1858.245996] Lustre: server umount lustre-OST0001 complete [ 1861.602786] LustreError: 82456:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1861.619586] LustreError: 82456:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 1866.493221] Lustre: server umount lustre-OST0000 complete [ 1869.793057] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1869.800556] LustreError: Skipped 1 previous similar message [ 1869.801989] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1869.809235] Lustre: Skipped 2 previous similar messages [ 1876.960478] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1876.963095] Lustre: Skipped 7 previous similar messages [ 1883.103231] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 1883.254857] Lustre: server umount lustre-MDT0000 complete [ 1885.381220] LustreError: 80616:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789368308 with bad export cookie 2833746679209088400 [ 1885.389957] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1885.393565] LustreError: 80616:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 1885.566290] Lustre: server umount lustre-MDT0001 complete [ 1890.646929] Lustre: DEBUG MARKER: == conf-sanity test 81: sparse OST indexing ============== 02:45:13 (1789368313) [ 1891.547285] Lustre: DEBUG MARKER: SKIP: conf-sanity test_81 needs >= 3 OSTs [ 1892.553635] Lustre: DEBUG MARKER: == conf-sanity test 82a: specify OSTs for file (succeed) or directory (succeed) ========================================================== 02:45:15 (1789368315) [ 1893.434621] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82a needs >= 3 OSTs [ 1894.528208] Lustre: DEBUG MARKER: == conf-sanity test 82b: specify OSTs for file with --pool and --ost-list options ========================================================== 02:45:17 (1789368317) [ 1895.487682] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82b needs >= 4 OSTs [ 1896.415066] Lustre: DEBUG MARKER: == conf-sanity test 82c: specify sparse OSTs for setstripe (should not crash) ========================================================== 02:45:19 (1789368319) [ 1897.257857] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82c needs >= 4 OSTs [ 1898.271587] Lustre: DEBUG MARKER: == conf-sanity test 83: ENOSPACE on OST doesn't cause message VFS: Busy inodes after unmount ... ========================================================== 02:45:21 (1789368321) [ 1899.216177] Lustre: DEBUG MARKER: mount the OST /dev/mapper/ost1_flakey as a ldiskfs filesystem [ 1903.311589] loop: module loaded [ 1903.331328] loop0: detected capacity change from 0 to 4294967296 [ 1903.372055] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 1904.334482] Lustre: DEBUG MARKER: run llverfs in partial mode on the OST ldiskfs /mnt/lustre-ost1 [ 1906.212917] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing run_llverfs /mnt/lustre-ost1 -vpl no [ 1908.749954] Lustre: DEBUG MARKER: unmount the OST /dev/mapper/ost1_flakey [ 1922.904288] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1922.922444] LustreError: 87816:0:(obd_config.c:845:class_setup()) setup lustre-OST0000-osd failed (-28) [ 1922.926038] LustreError: 87816:0:(obd_mount.c:259:lustre_start_simple()) lustre-OST0000-osd setup error -28 [ 1922.929887] LustreError: 87816:0:(tgt_mount.c:2585:server_fill_super()) Unable to start osd on /dev/mapper/ost1_flakey: -28 [ 1922.933995] LustreError: 87816:0:(super25.c:179:lustre_fill_super()) llite: Unable to mount : rc = -28 [ 1931.791762] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_hostid [ 1937.266272] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 1959.266736] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1959.373648] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1959.386078] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1959.445634] Lustre: lustre-MDT0000: new disk, initializing [ 1959.500822] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1959.516594] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1962.779558] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 1969.880580] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1969.942634] Lustre: 90679:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1970.075857] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1972.178843] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 1977.468612] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1980.541171] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 1984.343954] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1984.496520] Lustre: 92647:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1987.716106] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 1990.682668] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1990.739372] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1993.880472] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1996.706776] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1996.875954] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1999.724957] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1999.866699] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2005.989774] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2005.989993] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2006.012503] Lustre: Skipped 1 previous similar message [ 2006.015515] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2006.018415] LustreError: Skipped 1 previous similar message [ 2006.040476] Lustre: Skipped 3 previous similar messages [ 2007.219725] Lustre: server umount lustre-OST0000 complete [ 2015.873833] Lustre: server umount lustre-MDT0000 complete [ 2016.225048] LustreError: 90691:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2016.238342] LustreError: 90691:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 2018.056132] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2018.054752] LustreError: 91472:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789368441 with bad export cookie 2833746679209089016 [ 2018.069166] LustreError: 91472:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2018.250432] Lustre: server umount lustre-MDT0001 complete [ 2023.088830] Lustre: DEBUG MARKER: == conf-sanity test 84: check recovery_hard_time ========= 02:47:25 (1789368445) [ 2027.053708] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2027.370544] LustreError: 95056:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2029.704767] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 2034.308397] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2036.666899] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 2040.961345] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2044.021026] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2047.493601] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2050.550577] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 2054.519689] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2057.065485] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2057.172649] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2059.565454] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2059.672487] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2063.144425] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2063.222619] Lustre: lustre-OST0001: new disk, initializing [ 2063.226284] Lustre: Skipped 2 previous similar messages [ 2063.233267] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 2063.235557] Lustre: Skipped 3 previous similar messages [ 2063.238345] Lustre: 98420:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2066.313204] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 2070.064782] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 2070.071291] Lustre: Skipped 2 previous similar messages [ 2070.074115] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 2070.139654] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 2072.496629] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2074.915257] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid 50 [ 2075.028115] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2077.037961] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [ 2077.138936] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2089.495635] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 2102.789367] Lustre: Failing over lustre-MDT0000 [ 2103.138324] Lustre: server umount lustre-MDT0000 complete [ 2104.507409] LustreError: 97432:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.47@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2104.516406] LustreError: 97432:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 2105.825724] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2105.832292] Lustre: Skipped 6 previous similar messages [ 2119.352417] LDISKFS-fs (dm-0): 4 truncates cleaned up [ 2119.354123] LDISKFS-fs (dm-0): recovery complete [ 2119.357990] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2119.402929] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2119.510649] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-60 [ 2119.514234] Lustre: Skipped 6 previous similar messages [ 2119.540171] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 2119.846109] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 2119.846396] Lustre: 95053:0:(ldlm_lib.c:2110:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 2121.258823] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 2124.771995] Lustre: lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 2124.773125] Lustre: 95057:0:(ldlm_lib.c:2110:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 2124.781024] Lustre: 95057:0:(ldlm_lib.c:2110:extend_recovery_timer()) Skipped 1 previous similar message [ 2124.812217] LustreError: 101263:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2125.127124] LustreError: 101263:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2125.449822] LustreError: 101263:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2125.454080] LustreError: 101263:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 1 previous similar message [ 2125.767171] LustreError: 101263:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2125.770345] LustreError: 101263:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 1 previous similar message [ 2125.774975] Lustre: 101263:0:(ldlm_lib.c:2110:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2125.780677] Lustre: 101263:0:(ldlm_lib.c:2110:extend_recovery_timer()) Skipped 7 previous similar messages [ 2126.729932] LustreError: 101263:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2126.735492] LustreError: 101263:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 3 previous similar messages [ 2127.055888] LustreError: 101263:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2127.064684] LustreError: 101263:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 3 previous similar messages [ 2128.018696] Lustre: 101263:0:(ldlm_lib.c:2110:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2128.024102] Lustre: 101263:0:(ldlm_lib.c:2110:extend_recovery_timer()) Skipped 6 previous similar messages [ 2128.968183] LustreError: 101263:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2128.975592] LustreError: 101263:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 6 previous similar messages [ 2129.295127] LustreError: 101263:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2129.298271] LustreError: 101263:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 6 previous similar messages [ 2132.127804] Lustre: 101263:0:(ldlm_lib.c:2110:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2132.131940] Lustre: 101263:0:(ldlm_lib.c:2110:extend_recovery_timer()) Skipped 12 previous similar messages [ 2133.073373] LustreError: 101263:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2133.078841] LustreError: 101263:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 12 previous similar messages [ 2133.391124] LustreError: 101263:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2133.394883] LustreError: 101263:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 12 previous similar messages [ 2140.288646] Lustre: 101263:0:(ldlm_lib.c:2110:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2140.293035] Lustre: 101263:0:(ldlm_lib.c:2110:extend_recovery_timer()) Skipped 25 previous similar messages [ 2141.233577] LustreError: 101263:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2141.241508] LustreError: 101263:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 25 previous similar messages [ 2141.559157] LustreError: 101263:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2141.563165] LustreError: 101263:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 25 previous similar messages [ 2156.322048] Lustre: 101263:0:(ldlm_lib.c:2110:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2156.326373] Lustre: 101263:0:(ldlm_lib.c:2110:extend_recovery_timer()) Skipped 50 previous similar messages [ 2157.263965] LustreError: 101263:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2157.268614] LustreError: 101263:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 50 previous similar messages [ 2157.583209] LustreError: 101263:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2157.587568] LustreError: 101263:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 50 previous similar messages [ 2179.151133] Lustre: 101263:0:(ldlm_lib.c:2419:target_recovery_overseer()) lustre-MDT0000 recovery is aborted by hard timeout [ 2179.154550] Lustre: 101263:0:(ldlm_lib.c:2429:target_recovery_overseer()) recovery is aborted, evict exports in recovery [ 2179.157650] Lustre: 101263:0:(genops.c:1601:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client 1d7bd828-c0f6-465f-b0f5-4caf97276976@192.168.201.47@tcp [ 2179.163822] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 2179.166983] Lustre: 101263:0:(ldlm_lib.c:1939:abort_req_replay_queue()) @@@ aborted: req@00000000239f7528 x1876288290751360/t0(8589934770) o35->1d7bd828-c0f6-465f-b0f5-4caf97276976@192.168.201.47@tcp:493/0 lens 392/0 e 0 to 0 dl 1789368613 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:0 [ 2179.179037] Lustre: lustre-MDT0000-osd: cancel update llog [0x200000400:0x1:0x0] [ 2179.186369] Lustre: lustre-MDT0000: Denying connection for new client 1d7bd828-c0f6-465f-b0f5-4caf97276976 (at 192.168.201.47@tcp), waiting for 3 known clients (2 recovered, 0 in progress, and 1 evicted) to recover in 0:00 [ 2179.190560] Lustre: lustre-MDT0001-osp-MDT0000: cancel update llog [0x240000401:0x1:0x0] [ 2179.213378] Lustre: lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 2179.221107] Lustre: Skipped 2 previous similar messages [ 2179.223311] Lustre: lustre-MDT0000: Recovery over after 1:00, of 3 clients 2 recovered and 1 was evicted. [ 2179.245960] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:45 to 0x2c0000401:545) [ 2179.251205] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:78 to 0x280000401:577) [ 2184.672739] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2184.676530] LustreError: Skipped 1 previous similar message [ 2184.678560] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2184.685903] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2184.688753] Lustre: Skipped 2 previous similar messages [ 2186.443370] Lustre: server umount lustre-OST0000 complete [ 2191.328780] LustreError: 101632:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2191.335448] LustreError: 101632:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 17 previous similar messages [ 2194.218226] Lustre: server umount lustre-OST0001 complete [ 2210.271137] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2210.350744] Lustre: server umount lustre-MDT0000 complete [ 2212.005253] LustreError: 95036:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789368635 with bad export cookie 2833746679209140228 [ 2212.008930] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2212.009786] LustreError: 95036:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2212.172449] Lustre: server umount lustre-MDT0001 complete [ 2215.892427] Lustre: DEBUG MARKER: == conf-sanity test 85: osd_ost init: fail ea_fid_set ==== 02:50:38 (1789368638) [ 2219.528793] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2219.533755] Lustre: *** cfs_fail_loc=197, val=0*** [ 2235.039561] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 2240.159685] LustreError: 103236:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.201.147@tcp: failed processing log, type 4: rc = -110 [ 2245.297761] Lustre: *** cfs_fail_loc=197, val=0*** [ 2245.300422] Lustre: Skipped 65 previous similar messages [ 2268.670542] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 2272.471571] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2273.629329] Lustre: server umount lustre-OST0000 complete [ 2278.165332] Lustre: DEBUG MARKER: == conf-sanity test 86: Replacing mkfs.lustre -G option == 02:51:41 (1789368701) [ 2293.352589] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2293.548534] LustreError: 104856:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2293.556691] LustreError: 104856:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 2295.262632] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 2300.147850] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2302.563927] LustreError: 104889:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x200000009:0x1:0x0]: rc = -5 [ 2302.571380] LustreError: 104889:0:(lod_sub_object.c:917:lod_sub_prep_llog()) lustre-MDT0000-mdtlov: can't get id from catalogs: rc = -5 [ 2302.575251] LustreError: 104889:0:(lod_dev.c:511:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 9, retries 0, failed: rc = -5 [ 2302.734777] Lustre: server umount lustre-MDT0000 complete [ 2319.667452] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_hostid [ 2325.376094] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 2344.755148] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2344.902663] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2344.917788] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2344.963970] Lustre: lustre-MDT0000: new disk, initializing [ 2345.023751] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2347.683368] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 2354.246116] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2354.315904] Lustre: 109057:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2354.450769] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2356.662750] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 2362.330860] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2365.185745] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2368.550656] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2368.699386] Lustre: 111022:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2372.010501] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 2377.210861] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2378.810219] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2379.121541] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2379.212418] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2380.931227] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2381.024817] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2383.846143] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2383.846937] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2383.847846] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2383.847854] Lustre: Skipped 11 previous similar messages [ 2383.849333] LustreError: Skipped 2 previous similar messages [ 2383.859762] Lustre: Skipped 6 previous similar messages [ 2388.091641] Lustre: server umount lustre-OST0000 complete [ 2404.319144] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2404.449617] Lustre: server umount lustre-MDT0000 complete [ 2406.532393] LustreError: 109849:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789368829 with bad export cookie 2833746679209150826 [ 2406.535790] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2406.543267] LustreError: 109849:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 2406.717331] Lustre: server umount lustre-MDT0001 complete [ 2411.550753] Lustre: DEBUG MARKER: == conf-sanity test 87: check if MDT inode can hold EAs with N stripes properly ========================================================== 02:53:54 (1789368834) [ 2416.442511] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing unload_modules_local [ 2417.882582] Key type lgssc unregistered [ 2418.035530] LNet: 113504:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2418.039789] LNetError: 113504:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2418.052425] LNet: Removed LNI 192.168.201.147@tcp [ 2418.477276] Key type .llcrypt unregistered [ 2418.478934] Key type ._llcrypt unregistered [ 2427.546889] Key type ._llcrypt registered [ 2427.548404] Key type .llcrypt registered [ 2427.591582] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_hostid [ 2435.861996] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 2436.374246] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2436.404314] alg: No test for adler32 (adler32-zlib) [ 2437.294466] Lustre: Lustre: Build Version: 2.17.58_6_ge9bcf18 [ 2437.406654] LNet: Added LNI 192.168.201.147@tcp [8/256/0/180] [ 2439.015180] Key type lgssc registered [ 2439.763123] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2457.972888] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2457.980959] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2459.081793] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2459.098953] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2459.137390] Lustre: lustre-MDT0000: new disk, initializing [ 2459.185471] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2459.194655] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2460.844639] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 2465.858745] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2465.971320] Lustre: lustre-OST0000: new disk, initializing [ 2465.973540] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 2465.975957] Lustre: Skipped 1 previous similar message [ 2465.978745] Lustre: 117648:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2466.007228] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2468.514856] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 2473.634037] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2473.716764] Lustre: lustre-OST0001: new disk, initializing [ 2473.719399] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 2473.723054] Lustre: 118505:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2473.761990] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 2474.170993] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 2474.183092] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 2474.201649] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 2474.219194] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 [ 2476.370710] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 2484.703910] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2484.707821] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2484.712939] Lustre: Skipped 1 previous similar message [ 2484.718333] Lustre: Skipped 1 previous similar message [ 2487.435782] Lustre: server umount lustre-MDT0000 complete [ 2490.400350] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null) [ 2492.545438] LustreError: 116836:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789368915 with bad export cookie 15554825899458436506 [ 2492.549657] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2492.551940] LustreError: 116836:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 2492.594055] Lustre: server umount lustre-OST0000 complete [ 2494.331293] Lustre: server umount lustre-OST0001 complete [ 2498.208199] Lustre: DEBUG MARKER: == conf-sanity test 88a: tunefs.lustre persists a --mountfsoptions-only change ========================================================== 02:55:21 (1789368921) [ 2507.958978] Lustre: DEBUG MARKER: == conf-sanity test 88b: check the default mount options can be overridden ========================================================== 02:55:31 (1789368931) [ 2512.154623] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 2523.739335] Lustre: DEBUG MARKER: == conf-sanity test 89: check tunefs --param and --erase-param{s} options ========================================================== 02:55:46 (1789368946) [ 2540.893941] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_hostid [ 2545.099716] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 2559.917699] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2560.017028] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2560.035861] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2560.075669] Lustre: lustre-MDT0000: new disk, initializing [ 2560.125682] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2560.138197] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2560.142385] Lustre: Skipped 1 previous similar message [ 2562.030877] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 2567.702144] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2567.759509] Lustre: 126244:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2567.795046] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 2567.797640] Lustre: Skipped 1 previous similar message [ 2567.840189] Lustre: lustre-MDT0001: new disk, initializing [ 2567.903571] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2567.927419] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 2567.932558] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2567.936898] Lustre: Skipped 1 previous similar message [ 2570.248552] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 2575.127350] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2577.505899] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2580.765637] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2580.931431] Lustre: lustre-OST0000: new disk, initializing [ 2580.933817] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 2580.938499] Lustre: 128213:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2580.994621] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2583.587073] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 2587.139104] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 2587.143369] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2587.192736] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2588.283135] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount (FULL|IDLE) failover.node=192.0.2.254@tcp0,osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2590.065712] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2590.176567] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2592.008464] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2592.119286] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2597.346996] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2597.347312] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2597.353431] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2597.357440] Lustre: Skipped 1 previous similar message [ 2597.361818] Lustre: Skipped 1 previous similar message [ 2599.237666] Lustre: server umount lustre-OST0000 complete [ 2602.468389] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2602.477303] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2602.481193] Lustre: Skipped 1 previous similar message [ 2607.210636] Lustre: server umount lustre-MDT0000 complete [ 2608.965334] LustreError: 126235:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789369032 with bad export cookie 15554825899458437675 [ 2608.967726] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2608.971136] LustreError: 126235:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2609.124846] Lustre: server umount lustre-MDT0001 complete [ 2613.180115] Lustre: DEBUG MARKER: == conf-sanity test 90a: check max_mod_rpcs_in_flight is enforced ========================================================== 02:57:16 (1789369036) [ 2616.507467] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2616.791091] LustreError: 130621:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2616.807461] LustreError: 130621:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [ 2616.844123] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2618.990635] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 2621.920899] LustreError: 130622:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2623.241781] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2625.519337] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 2629.109996] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2631.514465] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2634.562219] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2637.239709] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 2639.964431] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2651.916639] Lustre: *** cfs_fail_loc=159, val=0*** [ 2651.918684] Lustre: Skipped 1 previous similar message [ 2668.216111] Lustre: lustre-MDT0000: Client 7e7d3bef-327d-4f37-aedb-e35cbf4d12ec (at 192.168.201.47@tcp) reconnecting [ 2669.018246] Lustre: *** cfs_fail_loc=159, val=0*** [ 2669.020189] Lustre: Skipped 4 previous similar messages [ 2684.623041] Lustre: lustre-MDT0000: Client 7e7d3bef-327d-4f37-aedb-e35cbf4d12ec (at 192.168.201.47@tcp) reconnecting [ 2687.969627] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2687.973710] LustreError: Skipped 1 previous similar message [ 2687.975832] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2687.980148] Lustre: Skipped 1 previous similar message [ 2687.983372] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2688.993299] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2692.710033] Lustre: server umount lustre-OST0000 complete [ 2695.136424] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2695.146274] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2695.152158] Lustre: Skipped 1 previous similar message [ 2695.155382] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2695.159666] Lustre: Skipped 2 previous similar messages [ 2700.806872] Lustre: server umount lustre-MDT0000 complete [ 2702.481713] LustreError: 130603:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789369125 with bad export cookie 15554825899458438557 [ 2702.485059] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2702.487125] LustreError: 130603:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2702.625203] Lustre: server umount lustre-MDT0001 complete [ 2707.731962] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing unload_modules_local [ 2709.254799] Key type lgssc unregistered [ 2709.445985] LNet: 134411:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2709.450082] LNetError: 134411:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2709.461626] LNet: Removed LNI 192.168.201.147@tcp [ 2709.884576] Key type .llcrypt unregistered [ 2709.886341] Key type ._llcrypt unregistered [ 2721.420672] Key type ._llcrypt registered [ 2721.421853] Key type .llcrypt registered [ 2721.469674] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 2721.978975] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2722.003248] alg: No test for adler32 (adler32-zlib) [ 2722.898470] Lustre: Lustre: Build Version: 2.17.58_6_ge9bcf18 [ 2723.047243] LNet: Added LNI 192.168.201.147@tcp [8/256/0/180] [ 2724.647203] Key type lgssc registered [ 2725.093601] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2728.384547] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2728.395263] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2729.581313] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2731.264436] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 2735.152247] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2735.360326] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2737.323077] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 2740.520658] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2743.087229] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2746.304746] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2746.486482] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2749.159672] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 2752.664717] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2754.661736] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:42 to 0x280000401:65) [ 2765.718521] Lustre: *** cfs_fail_loc=159, val=0*** [ 2781.880751] Lustre: lustre-MDT0000: Client f568c45c-3f8b-41a0-80aa-e65119c0dae7 (at 192.168.201.47@tcp) reconnecting [ 2783.096484] Lustre: *** cfs_fail_loc=159, val=0*** [ 2783.098126] Lustre: Skipped 1 previous similar message [ 2799.304539] Lustre: lustre-MDT0001: Client f568c45c-3f8b-41a0-80aa-e65119c0dae7 (at 192.168.201.47@tcp) reconnecting [ 2800.155326] Lustre: *** cfs_fail_loc=159, val=0*** [ 2800.160322] Lustre: Skipped 1 previous similar message [ 2815.676043] Lustre: lustre-MDT0001: Client f568c45c-3f8b-41a0-80aa-e65119c0dae7 (at 192.168.201.47@tcp) reconnecting [ 2831.403871] Lustre: 138851:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 2832.861730] Lustre: *** cfs_fail_loc=159, val=0*** [ 2832.863790] Lustre: Skipped 3 previous similar messages [ 2848.470078] Lustre: lustre-MDT0000: Client ab457dbd-242b-4f07-b627-86a9db7e839c (at 192.168.201.47@tcp) reconnecting [ 2849.367661] Lustre: *** cfs_fail_loc=159, val=0*** [ 2849.370080] Lustre: Skipped 13 previous similar messages [ 2865.848267] Lustre: lustre-MDT0000: Client ab457dbd-242b-4f07-b627-86a9db7e839c (at 192.168.201.47@tcp) reconnecting [ 2866.707747] Lustre: 139155:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 2871.778762] LustreError: lustre-OST0000-osc-MDT0000: operation ost_destroy to node 0@lo failed: rc = -107 [ 2871.785111] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2871.796401] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2872.801748] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2872.802935] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2872.805886] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2874.855468] Lustre: server umount lustre-OST0000 complete [ 2877.920850] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2877.927547] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2877.930078] Lustre: Skipped 2 previous similar messages [ 2882.802367] Lustre: server umount lustre-MDT0000 complete [ 2883.041080] LustreError: 139043:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2883.047909] LustreError: 139043:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [ 2884.541780] LustreError: 135778:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789369307 with bad export cookie 12643017424925158760 [ 2884.544585] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2884.546182] LustreError: 135778:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 2884.712344] Lustre: server umount lustre-MDT0001 complete [ 2889.435192] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing unload_modules_local [ 2890.685209] Key type lgssc unregistered [ 2890.831494] LNet: 140203:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2890.833753] LNetError: 140203:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2890.849359] LNet: Removed LNI 192.168.201.147@tcp [ 2891.283157] Key type .llcrypt unregistered [ 2891.284881] Key type ._llcrypt unregistered [ 2901.758698] Key type ._llcrypt registered [ 2901.759706] Key type .llcrypt registered [ 2901.802692] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 2902.256090] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2902.270652] alg: No test for adler32 (adler32-zlib) [ 2903.155227] Lustre: Lustre: Build Version: 2.17.58_6_ge9bcf18 [ 2903.281168] LNet: Added LNI 192.168.201.147@tcp [8/256/0/180] [ 2904.911172] Key type lgssc registered [ 2905.350764] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2908.766725] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2908.774464] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2909.980535] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2911.556358] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 2914.937062] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2915.103945] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2916.616380] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 2919.689787] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2921.706680] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2924.002377] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2924.118449] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2925.159156] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:97) [ 2926.055283] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 2928.546867] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2935.400345] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:129) [ 2941.672660] Lustre: 144198:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 2942.433297] Lustre: 144246:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 2943.003156] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 in log params [ 2944.374147] Lustre: 144391:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre/mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 (mode = 0) failed: rc = -17 [ 2944.723705] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=7 in log params [ 2944.726807] Lustre: Skipped 1 previous similar message [ 2945.103272] Lustre: 144489:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 2948.519493] Lustre: server umount lustre-OST0000 complete [ 2951.136806] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2951.137061] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2951.137809] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2951.147136] Lustre: Skipped 1 previous similar message [ 2956.256047] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2956.258309] Lustre: Skipped 2 previous similar messages [ 2960.377532] Lustre: server umount lustre-MDT0000 complete [ 2961.376409] LustreError: 141591:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2961.382292] LustreError: 141591:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [ 2961.787278] LustreError: 141570:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789369385 with bad export cookie 1467444631684187559 [ 2961.789564] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2961.792064] LustreError: 141570:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 2972.178134] Lustre: server umount lustre-MDT0001 complete [ 2975.670086] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing unload_modules_local [ 2976.661550] Key type lgssc unregistered [ 2976.781408] LNet: 145546:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2976.783862] LNetError: 145546:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2976.795332] LNet: Removed LNI 192.168.201.147@tcp [ 2977.102327] Key type .llcrypt unregistered [ 2977.103798] Key type ._llcrypt unregistered [ 2985.651328] Key type ._llcrypt registered [ 2985.652346] Key type .llcrypt registered [ 2985.688921] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 2986.032123] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2986.076303] alg: No test for adler32 (adler32-zlib) [ 2986.923790] Lustre: Lustre: Build Version: 2.17.58_6_ge9bcf18 [ 2987.019923] LNet: Added LNI 192.168.201.147@tcp [8/256/0/180] [ 2988.599148] Key type lgssc registered [ 2988.956547] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2991.563641] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2991.569957] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2992.709872] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2994.060374] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 2996.903511] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2997.028960] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2998.328881] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 3000.618436] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3002.351928] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3004.590565] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3004.712723] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3006.575772] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 3007.780456] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:129) [ 3008.902875] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3016.997435] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:161) [ 3021.570912] Lustre: *** cfs_fail_loc=159, val=0*** [ 3037.875505] Lustre: lustre-MDT0000: Client 54e5c603-508f-4d0e-9f08-c66dffad8243 (at 192.168.201.47@tcp) reconnecting [ 3053.024773] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3053.026717] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3053.028140] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3053.035769] Lustre: Skipped 1 previous similar message [ 3058.145365] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3058.147504] Lustre: Skipped 2 previous similar messages [ 3058.834844] Lustre: server umount lustre-OST0000 complete [ 3063.264695] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3063.265532] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3063.269270] Lustre: Skipped 1 previous similar message [ 3063.272906] Lustre: Skipped 1 previous similar message [ 3066.332783] Lustre: server umount lustre-MDT0000 complete [ 3067.605094] LustreError: 147672:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789369490 with bad export cookie 4015886752828809476 [ 3067.607799] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3067.609096] LustreError: 147672:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 3067.729131] Lustre: server umount lustre-MDT0001 complete [ 3071.783869] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing unload_modules_local [ 3072.934297] Key type lgssc unregistered [ 3073.073470] LNet: 150614:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3073.077828] LNetError: 150614:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3073.085283] LNet: Removed LNI 192.168.201.147@tcp [ 3073.459498] Key type .llcrypt unregistered [ 3073.460622] Key type ._llcrypt unregistered [ 3083.682684] Key type ._llcrypt registered [ 3083.684030] Key type .llcrypt registered [ 3083.725428] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 3084.191456] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3084.206132] alg: No test for adler32 (adler32-zlib) [ 3085.065394] Lustre: Lustre: Build Version: 2.17.58_6_ge9bcf18 [ 3085.164405] LNet: Added LNI 192.168.201.147@tcp [8/256/0/180] [ 3086.751160] Key type lgssc registered [ 3087.164807] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3090.064923] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3090.071606] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3091.236676] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3092.685033] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 3095.600475] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3095.776485] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3097.204358] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 3099.737797] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3101.829559] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3104.147834] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3104.269817] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3105.319227] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:161) [ 3106.320570] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 3108.945917] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3116.582488] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:170 to 0x280000401:193) [ 3133.237663] Lustre: lustre-OST0000: evicting 24ed9feb-428d-42ca-964b-9decc47bd26c (at 192.168.201.47@tcp) by administrative request [ 3133.241193] Lustre: Skipped 1 previous similar message [ 3157.474064] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3157.474575] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3157.475450] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3157.478889] Lustre: Skipped 1 previous similar message [ 3162.593915] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3162.597017] Lustre: Skipped 2 previous similar messages [ 3163.413979] Lustre: server umount lustre-OST0000 complete [ 3167.712292] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3167.712640] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3167.713217] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3167.716497] Lustre: Skipped 1 previous similar message [ 3170.839186] Lustre: server umount lustre-MDT0000 complete [ 3172.156270] LustreError: 152740:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789369595 with bad export cookie 2585704726020317190 [ 3172.158879] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3172.164143] LustreError: 152740:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3172.283282] Lustre: server umount lustre-MDT0001 complete [ 3175.992343] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing unload_modules_local [ 3177.091134] Key type lgssc unregistered [ 3177.234389] LNet: 156088:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3177.238631] LNetError: 156088:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3177.245406] LNet: Removed LNI 192.168.201.147@tcp [ 3177.591916] Key type .llcrypt unregistered [ 3177.593092] Key type ._llcrypt unregistered [ 3204.317631] Key type ._llcrypt registered [ 3204.318932] Key type .llcrypt registered [ 3204.356609] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 3204.713103] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3204.772809] alg: No test for adler32 (adler32-zlib) [ 3205.667657] Lustre: Lustre: Build Version: 2.17.58_6_ge9bcf18 [ 3205.758592] LNet: Added LNI 192.168.201.147@tcp [8/256/0/180] [ 3207.351148] Key type lgssc registered [ 3207.802221] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3210.974830] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3210.988395] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3212.165449] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3213.688611] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 3217.060798] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3217.204213] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3218.646852] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 3221.227341] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3223.155211] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3225.835076] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3225.992663] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3227.045545] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:193) [ 3228.013321] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 3230.700148] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3237.288916] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:195 to 0x280000401:225) [ 3247.586640] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3247.586888] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3247.589399] LustreError: Skipped 1 previous similar message [ 3247.595492] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3247.599298] Lustre: Skipped 1 previous similar message [ 3251.165463] Lustre: server umount lustre-OST0000 complete [ 3252.704347] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3252.704992] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3252.709331] Lustre: Skipped 2 previous similar messages [ 3257.824704] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3257.826928] Lustre: Skipped 2 previous similar messages [ 3258.779801] Lustre: server umount lustre-MDT0000 complete [ 3260.209318] LustreError: 159282:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789369683 with bad export cookie 5264012526550117872 [ 3260.212144] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3260.213398] LustreError: 159282:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3260.336951] Lustre: server umount lustre-MDT0001 complete [ 3264.260366] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing unload_modules_local [ 3265.350236] Key type lgssc unregistered [ 3265.476410] LNet: 162105:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3265.479948] LNetError: 162105:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3265.488338] LNet: Removed LNI 192.168.201.147@tcp [ 3265.839421] Key type .llcrypt unregistered [ 3265.840926] Key type ._llcrypt unregistered [ 3275.575855] Key type ._llcrypt registered [ 3275.577232] Key type .llcrypt registered [ 3275.611600] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 3275.986847] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3276.028775] alg: No test for adler32 (adler32-zlib) [ 3276.895037] Lustre: Lustre: Build Version: 2.17.58_6_ge9bcf18 [ 3276.988726] LNet: Added LNI 192.168.201.147@tcp [8/256/0/180] [ 3278.583161] Key type lgssc registered [ 3278.957205] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3284.265765] Lustre: DEBUG MARKER: == conf-sanity test 100: check lshowmount lists MGS, MDT, OST and 0@lo ========================================================== 03:08:27 (1789369707) [ 3290.656990] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_hostid [ 3294.300326] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 3306.404305] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3306.410372] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3307.491884] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3307.500723] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3307.531818] Lustre: lustre-MDT0000: new disk, initializing [ 3307.551618] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3307.558130] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3308.893834] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 3313.056853] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3313.094157] Lustre: 166351:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 3313.118298] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 3313.120646] Lustre: Skipped 1 previous similar message [ 3313.152269] Lustre: lustre-MDT0001: new disk, initializing [ 3313.179393] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3313.189188] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 3313.192300] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 3314.461581] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 3318.118506] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3319.936206] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3322.133532] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3322.228338] Lustre: lustre-OST0000: new disk, initializing [ 3322.230460] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3322.233368] Lustre: 168320:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3322.264195] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3324.186991] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 3327.872051] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3332.600937] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 3332.604447] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 3332.636929] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 3337.698254] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3337.700160] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3337.701539] LustreError: Skipped 1 previous similar message [ 3337.706892] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3337.709988] Lustre: Skipped 1 previous similar message [ 3338.453794] Lustre: server umount lustre-OST0000 complete [ 3342.816672] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3342.817302] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3342.821609] Lustre: Skipped 2 previous similar messages [ 3345.885406] Lustre: server umount lustre-MDT0000 complete [ 3347.276090] LustreError: 166345:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789369770 with bad export cookie 5314424650230729688 [ 3347.278905] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3347.280029] LustreError: 166345:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3347.396702] Lustre: server umount lustre-MDT0001 complete [ 3351.374235] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing unload_modules_local [ 3352.420229] Key type lgssc unregistered [ 3352.562375] LNet: 170221:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3352.564789] LNetError: 170221:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3352.574293] LNet: Removed LNI 192.168.201.147@tcp [ 3352.902340] Key type .llcrypt unregistered [ 3352.903977] Key type ._llcrypt unregistered [ 3362.549302] Key type ._llcrypt registered [ 3362.550764] Key type .llcrypt registered [ 3362.587574] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 3363.038208] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3363.047312] alg: No test for adler32 (adler32-zlib) [ 3363.906269] Lustre: Lustre: Build Version: 2.17.58_6_ge9bcf18 [ 3363.992651] LNet: Added LNI 192.168.201.147@tcp [8/256/0/180] [ 3365.575522] Key type lgssc registered [ 3365.985924] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3368.726350] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3368.734691] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3369.883546] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3371.391437] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 3374.694692] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3374.860184] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3376.373736] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 3379.215948] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3381.139703] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3383.700508] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3383.831201] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3386.019081] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 3388.581596] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3395.107467] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:33) [ 3401.798758] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3401.807213] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3401.812341] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3401.816103] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3401.820612] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3402.166391] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3402.531699] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3402.534312] Lustre: Skipped 1 previous similar message [ 3402.540470] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3402.549702] Lustre: Skipped 1 previous similar message [ 3402.552086] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3402.555058] Lustre: Skipped 1 previous similar message [ 3402.557091] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3402.561539] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3402.565314] Lustre: Skipped 1 previous similar message [ 3402.898355] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3403.245115] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3403.619072] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3403.622527] Lustre: Skipped 2 previous similar messages [ 3403.628955] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3403.633712] Lustre: Skipped 2 previous similar messages [ 3403.635853] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3403.638644] Lustre: Skipped 2 previous similar messages [ 3403.640542] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3403.645249] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3403.647550] Lustre: Skipped 2 previous similar messages [ 3403.989792] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3404.352584] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3404.695653] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3405.030452] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3405.437118] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3405.757295] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3405.760335] Lustre: Skipped 5 previous similar messages [ 3405.766283] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3405.770645] Lustre: Skipped 5 previous similar messages [ 3405.772432] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3405.774504] Lustre: Skipped 5 previous similar messages [ 3405.775817] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3405.779321] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3405.780990] Lustre: Skipped 5 previous similar messages [ 3406.093199] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3406.401850] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3406.731654] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3407.057171] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3407.390799] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3407.721960] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3408.036461] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3408.373600] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3408.697792] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3408.997771] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3409.348651] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3409.714734] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3410.024217] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3410.026045] Lustre: Skipped 12 previous similar messages [ 3410.031872] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3410.037811] Lustre: Skipped 12 previous similar messages [ 3410.040053] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3410.043421] Lustre: Skipped 12 previous similar messages [ 3410.045216] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3410.050138] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3410.052716] Lustre: Skipped 12 previous similar messages [ 3410.379973] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3410.724351] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3411.069933] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3411.415259] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3411.784634] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3412.123015] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3412.454517] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3412.773046] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3413.091366] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3413.409430] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3413.724445] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3414.043249] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3414.386944] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3414.708314] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3415.017802] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3415.326898] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3415.633747] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3415.975630] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3416.300537] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3416.608011] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3416.908237] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3417.212399] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3417.514194] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3417.804460] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3418.100417] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3418.102531] Lustre: Skipped 24 previous similar messages [ 3418.108773] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3418.113849] Lustre: Skipped 24 previous similar messages [ 3418.115929] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3418.118728] Lustre: Skipped 24 previous similar messages [ 3418.120669] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3418.124564] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3418.126676] Lustre: Skipped 24 previous similar messages [ 3418.450423] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3418.751841] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3419.050603] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3419.358150] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3419.663708] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3419.970801] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3420.290325] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3420.590814] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3420.912931] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3421.209579] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3421.516729] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3421.807135] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3422.093876] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3422.374420] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3422.658945] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3422.966933] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3423.278675] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3423.586049] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3423.897507] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3424.204233] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3424.516241] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3424.800667] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3425.109777] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3425.425787] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3425.769847] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3426.083437] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3426.362599] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3426.640873] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3426.938589] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3427.222506] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3427.511588] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3427.794876] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3428.100726] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3428.382771] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3428.662329] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3428.943034] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3429.235985] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3429.530414] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3429.815638] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3430.096027] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3430.390452] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3430.680606] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3430.966602] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3431.275444] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3431.593540] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3431.895353] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3432.185715] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3432.486607] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3432.781081] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3433.068387] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3433.355393] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3433.642124] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3433.938601] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3434.228823] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3434.231853] Lustre: Skipped 53 previous similar messages [ 3434.238234] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3434.244068] Lustre: Skipped 53 previous similar messages [ 3434.246611] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3434.248531] Lustre: Skipped 53 previous similar messages [ 3434.249880] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3434.254394] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3434.256651] Lustre: Skipped 53 previous similar messages [ 3434.547543] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3434.835549] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3435.129722] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3435.411973] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3435.694076] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3435.988182] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3436.296584] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3436.580251] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3436.868375] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3437.145186] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3437.427517] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3437.714316] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3437.986986] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3438.272323] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3438.568093] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3438.858648] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3439.174875] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3439.484159] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3439.782395] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3440.082249] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3440.378220] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3440.696667] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3441.018047] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3441.329183] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3441.636801] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3441.946193] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3442.266053] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3442.556226] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3442.859801] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3443.154543] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3443.496398] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3443.827568] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3444.153982] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3444.478290] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3444.816660] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3445.115611] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3445.432724] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3445.738256] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3446.051922] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3446.361401] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3446.670837] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3446.976684] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3447.283696] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3447.588978] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3447.896373] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3448.198432] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3448.526882] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3448.835148] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3449.144781] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3449.474253] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3449.851474] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3450.225352] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3450.556270] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3450.874233] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3451.210434] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3451.544831] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3451.874277] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3452.207417] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3452.515460] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3452.848186] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3453.156027] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3453.462266] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3453.781971] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3454.116945] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3454.464810] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3454.810691] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3455.154446] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3455.505126] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3455.868613] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3456.223947] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3456.585264] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3456.958768] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3457.325506] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3457.693575] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3458.059079] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3458.416528] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3458.750121] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3459.076319] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3459.383620] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3459.711075] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3460.026993] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3460.324662] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3460.631457] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3460.955645] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3461.277867] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3461.616670] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3461.982059] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3462.327339] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3462.636441] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3462.959926] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3463.282086] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3463.614912] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3463.943841] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3464.250823] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3464.544136] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3464.854292] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3465.151875] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3465.450821] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3465.783236] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3466.133748] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3466.468818] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3466.471396] Lustre: Skipped 100 previous similar messages [ 3466.478236] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3466.482285] Lustre: Skipped 100 previous similar messages [ 3466.484131] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3466.486526] Lustre: Skipped 100 previous similar messages [ 3466.488576] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3466.492335] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3466.495418] Lustre: Skipped 100 previous similar messages [ 3466.838435] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3467.163521] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3467.491524] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3467.817906] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3468.145220] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3468.470076] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3468.780535] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3469.075907] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3469.368110] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3469.657089] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3469.946237] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3470.242478] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3470.532511] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3470.836751] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3471.160348] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3471.473174] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3471.808630] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3472.204839] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3472.544649] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3472.871159] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3473.216858] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3473.551245] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3473.869480] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3474.192071] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3474.508860] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3474.864218] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3475.190785] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3475.498353] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3475.796436] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3476.142034] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3476.485231] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3476.801616] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3477.108492] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3477.434116] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3477.748180] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3478.082964] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3478.394141] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3478.715623] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3479.020962] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3479.329055] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3479.627172] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3479.934717] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3480.240200] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3480.558469] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3480.875983] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3481.239249] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3481.587852] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3481.928032] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3482.243359] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3482.568940] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3482.863690] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3483.163048] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3483.495259] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3483.823070] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3484.128699] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3484.451273] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3484.751616] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3485.104224] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3485.425770] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3485.727931] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3486.036493] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3486.359342] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3486.671046] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3486.973206] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3487.290875] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3487.601507] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3487.911437] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3488.212920] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3488.506968] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3488.816319] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3489.101459] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3489.390235] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3489.677431] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3489.982519] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3490.267809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3490.566599] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3490.849915] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3491.136175] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3491.406084] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3491.675996] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3491.955823] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3492.234716] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3492.520936] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3492.795440] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3493.078169] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3493.371124] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3493.653351] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3493.940996] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3494.225732] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3494.517153] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3494.801082] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3495.104901] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3495.421754] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3495.762759] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3496.076778] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3496.391487] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3496.683230] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3497.002403] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3497.298852] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3497.583639] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3497.875446] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3498.187977] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3498.503191] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3498.815466] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3499.126032] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3499.453638] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3499.752875] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3500.045544] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3500.351834] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3500.657480] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3500.958911] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3501.257464] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3501.562170] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3501.879322] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3502.172792] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3502.490985] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3502.796934] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3503.112254] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3503.412810] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3503.722240] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3504.034818] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3504.377022] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3504.695620] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3505.019187] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3505.326351] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3505.664398] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3505.957031] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3506.267699] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3506.571241] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3506.881959] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3507.180830] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3507.514887] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3507.841900] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3508.170893] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3508.516266] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3508.832824] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3509.127240] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3509.442821] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3509.746199] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3510.062986] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3510.383916] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3510.733860] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3511.044273] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3511.363749] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3511.677720] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3512.012407] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3512.332056] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3512.650861] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3512.967308] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3513.296770] LustreError: 171633:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 3513.300496] LustreError: 171633:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 3513.300555] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3513.654132] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3514.001734] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3514.351263] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3514.690264] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3515.032959] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3515.363480] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3515.693262] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3516.033438] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3516.368995] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3516.710917] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3517.035847] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3517.355833] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3517.684240] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3517.980883] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3518.283046] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3518.605074] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3518.914949] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3519.212745] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3519.506889] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3519.795842] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3520.115253] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3520.421478] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3520.732750] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3521.042614] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3521.373568] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3521.688232] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3521.997892] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3522.302707] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3522.623589] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3522.928652] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3523.265219] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3523.619585] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3523.979103] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3524.310451] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3524.649169] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3524.992532] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3525.312630] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3525.617320] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3525.940145] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3526.251540] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3526.586040] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3526.894271] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3527.200493] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3527.519791] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3527.846531] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3528.190709] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3528.511632] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3528.819774] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3529.161040] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3529.469145] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3529.786076] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3530.095474] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3530.428955] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3530.731111] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3530.733643] Lustre: Skipped 203 previous similar messages [ 3530.739708] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3530.744532] Lustre: Skipped 203 previous similar messages [ 3530.746506] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3530.749441] Lustre: Skipped 203 previous similar messages [ 3530.750839] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3530.755348] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3530.757729] Lustre: Skipped 203 previous similar messages [ 3531.094335] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3531.418045] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3531.747289] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3532.060823] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3532.364068] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3532.669515] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3532.978655] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3533.296808] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3533.625379] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3533.928603] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3534.271637] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3534.582500] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3534.891081] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3535.201095] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3535.545926] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3535.839687] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3536.171444] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3536.470095] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3536.781247] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3537.085056] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3537.393783] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3537.736328] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3538.040888] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3538.353088] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3538.673235] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3538.981775] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3539.301268] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3539.620382] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3539.938171] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3540.239280] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3540.540138] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3540.843808] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3541.136159] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3541.435743] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3541.746912] LustreError: 171633:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 3541.750352] LustreError: 171633:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 3541.751493] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3542.057935] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3542.365526] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3542.675114] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3543.018638] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3543.346964] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3543.677797] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3544.051451] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3544.377976] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3544.695547] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3545.007690] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3545.364871] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3545.693187] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3546.008072] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3546.318972] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3546.651609] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3546.972651] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3547.288042] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3547.587455] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3547.914319] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3548.219431] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3548.535905] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3548.867128] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3549.206316] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3549.525762] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3549.842108] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3550.156062] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3550.487256] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3550.797220] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3551.096996] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3551.418818] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3551.782844] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3552.132494] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3552.476715] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3552.817022] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3553.140062] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3553.493152] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3553.840826] LustreError: 171633:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 3553.846057] LustreError: 171633:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 3553.846072] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3554.162626] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3554.500606] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3554.816508] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3555.155099] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3555.467912] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3555.830431] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3556.138721] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3556.474090] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3556.852495] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3557.178647] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3557.493344] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3557.817875] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3558.115790] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3558.416747] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3558.740599] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3559.043310] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3559.346758] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3559.635888] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3559.944102] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3560.243432] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3560.544515] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3560.846532] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3561.155994] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3561.442475] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3561.739550] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3562.041895] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3562.337843] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3562.621825] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3562.904360] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3563.208694] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3563.537938] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3563.837230] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3564.151573] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3564.437043] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3564.732752] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3565.020871] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3565.316210] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3565.611579] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3565.926455] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3566.231428] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3566.509254] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3566.786317] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3567.082240] LustreError: 171633:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 3567.086322] LustreError: 171633:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 3567.086531] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3567.376529] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3567.653098] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3567.943807] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3568.236123] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3568.518255] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3568.796884] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3569.074316] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3569.365738] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3569.644308] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3569.924395] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3570.207600] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3570.492074] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3570.776122] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3571.053859] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3571.345037] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3571.638328] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3571.929155] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3572.208456] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3572.491580] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3572.786122] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3573.053094] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3573.333778] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3573.625507] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3573.928602] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3574.211762] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3574.496200] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3574.790804] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3575.084732] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3575.376842] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3575.671250] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3575.965548] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3576.264320] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3576.549684] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3576.834305] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3577.124469] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3577.426247] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3577.737792] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3578.046808] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3578.359299] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3578.677854] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3578.979137] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3579.281038] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3579.588818] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3579.915810] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3580.238557] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3580.545083] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3580.844573] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3581.144946] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3581.451987] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3581.775424] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3582.087317] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3582.427420] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3582.750336] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3583.062681] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3583.361206] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3583.663518] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3583.978243] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3584.267469] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3584.577819] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3584.900447] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3585.201561] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3585.490769] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3585.781380] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3586.083666] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3586.369968] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3586.664529] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3586.964829] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3587.269101] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3587.550871] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3587.830495] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3588.128614] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3588.461718] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3588.773549] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3589.068418] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3589.360602] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3589.672682] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3589.977479] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3590.296259] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3590.629853] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3590.970236] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3591.280837] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3591.594753] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3591.895862] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3592.208279] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3592.537151] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3592.835992] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3593.142976] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3593.446397] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3593.736591] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3594.013855] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3594.301951] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3594.589857] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3594.873121] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3595.162448] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3595.450611] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3595.750639] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3596.055638] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3596.358648] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3596.652067] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3596.967458] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3597.260700] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3597.562484] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3597.865037] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3598.170528] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3598.465601] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3598.771572] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3599.089807] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3599.389198] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3599.680364] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3599.978916] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3600.265328] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3600.561668] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3600.857777] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3601.151149] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3601.438259] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3601.734241] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3602.016950] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3602.292316] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3602.575150] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3602.885242] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3603.179776] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3603.470154] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3603.768568] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3604.085105] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3604.377195] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3604.667349] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3604.974678] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3605.291439] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3605.593951] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3605.890129] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3606.180354] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3606.488855] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3606.766355] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3607.047756] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3607.333516] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3607.623888] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3607.927968] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3608.212204] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3608.487517] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3608.770283] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3609.058370] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3609.350064] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3609.655309] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3609.955484] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3610.256695] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3610.557807] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3610.876451] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3611.194277] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3611.494071] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3611.789059] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3612.105085] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3612.409201] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3612.695159] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3612.988250] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3613.283035] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3613.589457] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3613.902571] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3614.224421] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3614.537169] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3614.865059] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3615.181075] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3615.491596] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3615.790589] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3616.093661] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3616.383499] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3616.677539] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3617.003540] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3617.317877] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3617.601166] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3617.911939] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3618.225415] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3618.548201] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3618.834159] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3619.135167] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3619.429926] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3619.752023] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3620.082289] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3620.402971] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3620.749857] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3621.074670] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3621.378606] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3621.680224] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3621.992336] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3622.327032] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3622.616440] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3622.903774] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3623.218406] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3623.521044] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3623.808493] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3624.099368] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3624.378939] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3624.661197] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3624.932342] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3625.215036] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3625.494959] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3625.785293] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3626.074398] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3626.360671] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3626.647913] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3626.938809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3627.226408] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3627.502965] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3627.784121] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3628.074670] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3628.356047] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3628.633831] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3628.930246] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3629.225543] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3629.507469] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3629.780177] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3630.061740] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3630.337813] LustreError: 171633:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 3630.340702] LustreError: 171633:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 3630.341782] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3630.616651] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3630.897643] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3631.175391] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3631.455762] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3631.737653] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3632.019377] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3632.293556] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3632.574158] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3632.845875] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3633.117258] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3633.389077] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3633.673170] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3633.950205] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3634.220628] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3634.504648] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3634.809525] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3635.089388] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3635.380324] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3635.684620] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3635.995515] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3636.287087] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3636.570049] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3636.855374] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3637.141840] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3637.430974] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3637.705176] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3637.977437] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3638.265420] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3638.543737] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3638.821689] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3639.094504] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3639.393523] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3639.662074] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3639.935741] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3640.219608] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3640.495586] LustreError: 171633:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 3640.499995] LustreError: 171633:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 3640.500718] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3640.776118] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3641.046760] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3641.316596] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3641.597022] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3641.866149] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3642.129058] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3642.392639] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3642.659958] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3642.942014] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3643.223393] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3643.512016] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3643.782117] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3644.070286] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3644.390563] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3644.688491] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3644.975800] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3645.265916] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3645.548503] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3645.822413] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3646.099565] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3646.401398] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3646.697431] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3646.980207] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3647.296457] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3647.585490] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3647.856724] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3648.134294] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3648.429832] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3648.753613] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3649.048585] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3649.326853] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3649.621831] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3649.899946] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3650.175772] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3650.452985] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3650.732551] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3651.008434] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3651.275314] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3651.563275] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3651.867015] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3652.168690] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3652.471181] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3652.792658] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3653.128714] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3653.443105] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3653.757496] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3654.069261] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3654.381521] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3654.690726] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3655.006846] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3655.317132] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3655.624135] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3655.916473] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3656.196832] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3656.482533] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3656.776073] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3657.054679] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3657.340380] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3657.640565] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3657.935332] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3658.207057] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3658.485047] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3658.757109] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3658.758959] Lustre: Skipped 425 previous similar messages [ 3658.764124] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3658.767986] Lustre: Skipped 425 previous similar messages [ 3658.769467] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3658.771820] Lustre: Skipped 425 previous similar messages [ 3658.773463] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3658.777209] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3658.778931] Lustre: Skipped 425 previous similar messages [ 3659.077594] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3659.384364] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3659.688203] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3659.983793] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3660.286935] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3660.605377] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3660.905718] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3661.203053] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3661.526538] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3661.833857] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3662.138311] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3662.434810] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3662.768579] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3663.101996] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3663.409511] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3663.746277] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3664.110269] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3664.507097] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3664.919987] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3665.296368] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3665.657837] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3666.057763] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3666.456852] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3666.819731] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3667.129462] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3667.453232] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3667.788144] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3668.093837] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3668.443180] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3668.787710] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3669.153692] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3669.483817] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3669.800455] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3670.111488] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3670.429929] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3670.742682] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3671.052370] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3671.387124] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3671.713841] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3672.042640] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3672.384354] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3672.740437] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3673.077177] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3673.416135] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3673.745757] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3674.071446] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3674.390364] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3674.770779] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3675.163954] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3675.492677] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3675.829515] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3676.142918] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3676.457798] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3676.751184] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3677.047579] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3677.335709] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3677.640761] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3677.919328] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3678.201909] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3678.469805] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3678.756532] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3679.032653] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3679.313392] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3679.599765] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3679.902881] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3680.198552] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3680.485627] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3680.767468] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3681.093968] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3681.387843] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3681.683584] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3681.969257] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3682.249561] LustreError: 171633:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 3682.253176] LustreError: 171633:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 3682.254331] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3682.530783] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3682.798633] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3683.085956] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3683.384888] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3683.654458] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3683.932732] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3684.215651] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3684.532464] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3684.835621] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3685.144137] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3685.433358] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3685.727491] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3686.026502] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3686.310265] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3686.594323] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3686.883541] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3687.155097] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3687.439642] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3687.723071] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3688.019247] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3688.302700] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3688.589325] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3688.871670] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3689.152384] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3689.426913] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3689.709576] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3689.989617] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3690.273333] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3690.545692] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3690.814356] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3691.099259] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3691.386239] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3691.664701] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3691.941082] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3692.219514] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3692.488446] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3692.748309] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3693.014294] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3693.292554] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3693.570403] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3693.841097] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3694.130623] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3694.413302] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3694.695753] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3694.980960] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3695.263037] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3695.545149] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3695.831503] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3696.099563] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3696.370757] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3696.643181] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3696.921504] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3697.207923] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3697.498265] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3697.782619] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3698.062896] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3698.335654] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3698.610062] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3698.883831] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3699.163808] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3699.435920] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3699.705050] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3699.969371] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3700.250528] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3700.514408] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3700.784699] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3701.056546] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3701.339445] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3701.608334] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3701.878302] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3702.161049] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3702.440973] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3702.716646] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3702.994816] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3703.275388] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3703.578446] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3703.873349] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3704.166083] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3704.456742] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3704.760414] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3705.041844] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3705.326489] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3705.619076] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3705.921936] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3706.194627] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3706.471178] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3706.746497] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3707.034404] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3707.315267] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3707.589963] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3707.872053] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3708.165592] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3775.343264] LustreError: 174101:0:(ofd_dev.c:1780:ofd_create_hdl()) lustre-OST0000: unable to precreate: rc = -28 [ 3775.346401] LustreError: 171633:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -28 [ 3775.350441] LustreError: 171633:0:(osp_precreate.c:655:osp_precreate_send()) Skipped 2 previous similar messages [ 3835.360427] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3835.363956] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3835.364135] LustreError: Skipped 1 previous similar message [ 3835.367347] Lustre: Skipped 1 previous similar message [ 3838.730862] Lustre: server umount lustre-OST0000 complete [ 3840.481627] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3840.484203] Lustre: Skipped 1 previous similar message [ 3845.600071] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3845.602147] Lustre: Skipped 1 previous similar message [ 3850.720209] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3850.722650] Lustre: Skipped 1 previous similar message [ 3854.303117] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 3854.424191] Lustre: server umount lustre-MDT0000 complete [ 3854.816252] LustreError: 171614:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3854.821244] LustreError: 171614:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [ 3855.669437] LustreError: 171595:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789370278 with bad export cookie 12485673899725917610 [ 3855.671843] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3855.676070] LustreError: 171595:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 3855.792347] Lustre: server umount lustre-MDT0001 complete [ 3859.478165] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing unload_modules_local [ 3860.542936] Key type lgssc unregistered [ 3860.686307] LNet: 226638:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3860.688968] LNetError: 226638:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3860.699318] LNet: Removed LNI 192.168.201.147@tcp [ 3861.012244] Key type .llcrypt unregistered [ 3861.013587] Key type ._llcrypt unregistered [ 3870.285414] Key type ._llcrypt registered [ 3870.286492] Key type .llcrypt registered [ 3870.325702] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 3870.663313] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3870.701236] alg: No test for adler32 (adler32-zlib) [ 3871.564103] Lustre: Lustre: Build Version: 2.17.58_6_ge9bcf18 [ 3871.655285] LNet: Added LNI 192.168.201.147@tcp [8/256/0/180] [ 3873.239113] Key type lgssc registered [ 3873.593190] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3876.226149] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3876.233684] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3877.380770] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3878.730698] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 3881.661807] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3881.796879] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3883.192719] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 3885.620348] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3887.453530] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3889.779309] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3889.910755] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3892.000126] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 3894.418291] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3902.183172] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49665 to 0x280000401:49696) [ 3907.048057] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3907.633902] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3907.637647] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3907.640854] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3907.643600] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3907.643613] LustreError: 228046:0:(osp_precreate.c:1268:osp_precreate_thread()) cfs_fail_timeout id 2107 sleeping for 20000ms [ 3908.576602] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3908.578255] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3908.581357] Lustre: Skipped 1 previous similar message [ 3910.314047] Lustre: lustre-OST0000: Not available for connect from 192.168.201.47@tcp (stopping) [ 3910.315769] Lustre: Skipped 1 previous similar message [ 3913.696975] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3913.699352] Lustre: Skipped 1 previous similar message [ 3914.319113] Lustre: server umount lustre-OST0000 complete [ 3927.719068] LustreError: 228046:0:(osp_precreate.c:1268:osp_precreate_thread()) cfs_fail_timeout id 2107 awake [ 3942.219763] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3942.327457] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3944.163453] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 3946.488914] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3952.074335] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 5 sec [ 3953.841835] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8946c5682000.ost_server_uuid 50 [ 3954.306074] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff8946c5682000.ost_server_uuid in FULL state after 0 sec [ 3961.350678] Lustre: server umount lustre-OST0000 complete [ 3963.871889] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3963.875550] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3963.882034] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3968.597232] Lustre: server umount lustre-MDT0000 complete [ 3969.753085] LustreError: 229865:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789370392 with bad export cookie 7198551049418672931 [ 3969.755927] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3969.756862] LustreError: 229865:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 3969.860541] Lustre: server umount lustre-MDT0001 complete [ 3973.425210] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing unload_modules_local [ 3974.344245] Key type lgssc unregistered [ 3974.454266] LNet: 233246:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3974.456299] LNetError: 233246:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3974.465222] LNet: Removed LNI 192.168.201.147@tcp [ 3974.759828] Key type .llcrypt unregistered [ 3974.760809] Key type ._llcrypt unregistered [ 3985.728770] Key type ._llcrypt registered [ 3985.730122] Key type .llcrypt registered [ 3985.772314] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 3986.331209] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3986.346466] alg: No test for adler32 (adler32-zlib) [ 3987.200741] Lustre: Lustre: Build Version: 2.17.58_6_ge9bcf18 [ 3987.291492] LNet: Added LNI 192.168.201.147@tcp [8/256/0/180] [ 3988.879177] Key type lgssc registered [ 3989.250722] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3992.378802] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3992.385052] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3993.524446] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3994.951939] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 3997.894654] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3998.036617] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3999.420248] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 4000.375365] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 4002.535744] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4002.661073] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4003.688702] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49728) [ 4005.090511] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 4007.926788] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4007.999875] Lustre: lustre-OST0001: new disk, initializing [ 4008.002413] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 4008.004827] Lustre: 237262:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 4008.044811] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 4010.068367] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 4014.088767] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 4014.094761] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 4014.129119] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 4015.489828] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 4022.161535] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 4028.895897] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4028.899920] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4028.906712] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4029.410700] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4029.411429] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4029.416644] Lustre: Skipped 1 previous similar message [ 4029.418539] Lustre: Skipped 1 previous similar message [ 4034.528209] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4034.530046] Lustre: Skipped 2 previous similar messages [ 4034.720946] Lustre: server umount lustre-MDT0000 complete [ 4035.890421] LustreError: 236082:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789370459 with bad export cookie 11299132048929741711 [ 4035.894124] LustreError: 235683:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0000-osp-MDT0001: osp_attr_get update error [0x200001b72:0x1:0x0]: rc = -5 [ 4035.895342] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4035.895884] LustreError: 236082:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4036.003526] Lustre: server umount lustre-MDT0001 complete [ 4046.854222] Lustre: server umount lustre-OST0000 complete [ 4058.401394] Lustre: server umount lustre-OST0001 complete [ 4065.276638] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 4068.700162] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4068.853401] LustreError: 240365:0:(ldlm_lib.c:1190:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4068.858465] LustreError: 240365:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 4068.869225] Lustre: mylustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4070.216435] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 4073.112893] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4074.667526] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 4075.719483] Lustre: 241507:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 4077.772090] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4077.880661] Lustre: mylustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4077.883338] Lustre: Skipped 1 previous similar message [ 4078.882817] LustreError: 241861:0:(ldlm_lib.c:1190:target_handle_connect()) mylustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4078.886449] Lustre: mylustre-OST0000: new connection from mylustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49760) [ 4079.608296] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 4082.194129] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4083.308900] Lustre: mylustre-OST0000: new connection from mylustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:100 to 0x280000400:129) [ 4084.043190] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 4087.018434] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 4088.169334] Lustre: 243376:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 4093.924110] Lustre: mylustre-MDT0000-osp-MDT0001: Connection to mylustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4093.925561] Lustre: mylustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4093.925846] LustreError: mylustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4093.928576] Lustre: Skipped 3 previous similar messages [ 4093.930572] Lustre: Skipped 1 previous similar message [ 4098.531437] Lustre: server umount mylustre-MDT0000 complete [ 4099.042866] LustreError: 241108:0:(ldlm_lib.c:1190:target_handle_connect()) mylustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4099.050250] LustreError: 241108:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [ 4099.849309] LustreError: 240342:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789370523 with bad export cookie 11299132048929744546 [ 4099.853827] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4099.854043] LustreError: 240342:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4099.956877] Lustre: server umount mylustre-MDT0001 complete [ 4111.366045] Lustre: server umount mylustre-OST0000 complete [ 4121.946233] Lustre: server umount mylustre-OST0001 complete [ 4128.979279] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 4132.572163] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4132.740145] LustreError: 245690:0:(ldlm_lib.c:1190:target_handle_connect()) tfs-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4132.757547] Lustre: tfs-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4132.760041] Lustre: Skipped 1 previous similar message [ 4134.068967] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 4136.955819] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4138.466032] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 4139.459412] Lustre: 246832:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 4141.720055] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4142.881373] LustreError: 247374:0:(ldlm_lib.c:1190:target_handle_connect()) tfs-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4142.885608] Lustre: tfs-OST0000: new connection from tfs-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49792) [ 4143.718982] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 4146.640040] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4147.754800] Lustre: tfs-OST0000: new connection from tfs-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:100 to 0x280000400:161) [ 4147.756516] Lustre: tfs-OST0001: new connection from tfs-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:35 to 0x2c0000400:65) [ 4148.684873] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 4151.826487] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 4153.129431] Lustre: 248700:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 4157.921282] LustreError: tfs-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4157.924114] Lustre: tfs-MDT0000-osp-MDT0001: Connection to tfs-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4157.925400] Lustre: tfs-MDT0000: Not available for connect from 0@lo (stopping) [ 4157.929885] Lustre: Skipped 2 previous similar messages [ 4157.932102] Lustre: Skipped 2 previous similar messages [ 4161.560808] Lustre: server umount tfs-MDT0000 complete [ 4162.884810] LustreError: 246434:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789370586 with bad export cookie 11299132048929746499 [ 4162.887985] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4162.889602] LustreError: 246434:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 4163.003658] Lustre: server umount tfs-MDT0001 complete [ 4174.469198] Lustre: server umount tfs-OST0000 complete [ 4184.934892] Lustre: server umount tfs-OST0001 complete [ 4192.235247] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 4195.493944] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4195.630595] LustreError: 250949:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4195.646600] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4195.648784] Lustre: Skipped 3 previous similar messages [ 4197.010676] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 4199.945551] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4201.493099] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 4202.503468] Lustre: 252091:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 4204.838951] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4205.990823] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49824) [ 4206.988315] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 4209.890281] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4210.994478] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:100 to 0x280000400:193) [ 4210.996152] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:35 to 0x2c0000400:97) [ 4211.958324] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 4215.227913] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 4216.457803] Lustre: 253962:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 4218.587634] Lustre: DEBUG MARKER: == conf-sanity test 104a: Make sure user defined options are reflected in mount ========================================================== 03:24:01 (1789370641) [ 4231.136445] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4231.142548] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4231.151802] Lustre: Skipped 2 previous similar messages [ 4231.156923] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4231.159881] Lustre: Skipped 3 previous similar messages [ 4236.681233] Lustre: server umount lustre-MDT0000 complete [ 4236.771491] LustreError: 251681:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4236.785035] LustreError: 251681:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 4 previous similar messages [ 4238.903733] LustreError: 250924:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789370662 with bad export cookie 11299132048929748410 [ 4238.907634] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4238.913400] LustreError: 250924:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 4241.890302] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4241.900786] Lustre: Skipped 3 previous similar messages [ 4245.172868] Lustre: server umount lustre-MDT0001 complete [ 4253.452907] Lustre: server umount lustre-OST0000 complete [ 4261.644863] Lustre: server umount lustre-OST0001 complete [ 4265.561300] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_hostid [ 4271.143703] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 4287.708747] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4287.805498] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 4287.816351] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 4287.850735] Lustre: lustre-MDT0000: new disk, initializing [ 4287.874783] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 188-180 [ 4287.877986] Lustre: Skipped 3 previous similar messages [ 4287.887559] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 4289.511310] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 4294.581723] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4294.634851] Lustre: 257139:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 4294.677741] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 4294.681460] Lustre: Skipped 1 previous similar message [ 4294.737281] Lustre: lustre-MDT0001: new disk, initializing [ 4294.792823] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 4294.797073] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 4296.528993] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 4301.816785] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4301.943594] Lustre: lustre-OST0000: new disk, initializing [ 4301.945695] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 4301.948961] Lustre: 258721:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 4303.939314] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 4303.943039] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 4303.988221] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 4304.296071] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 4309.922083] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4309.996753] Lustre: lustre-OST0001: new disk, initializing [ 4309.999141] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 4310.002170] Lustre: 259594:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 4311.252984] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 4311.257239] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 4311.315119] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 4312.477611] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 4318.418323] Lustre: DEBUG MARKER: == conf-sanity test 104b: Mount uses last flock argument ========================================================== 03:25:41 (1789370741) [ 4323.201844] Lustre: DEBUG MARKER: == conf-sanity test 105: check file creation for ro and rw bind mnt pt ========================================================== 03:25:46 (1789370746) [ 4335.071865] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4335.075108] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4335.080410] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4335.082860] Lustre: Skipped 7 previous similar messages [ 4340.944753] Lustre: server umount lustre-OST0000 complete [ 4342.244541] LustreError: 259021:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4342.250414] LustreError: 259021:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 5 previous similar messages [ 4346.336016] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4348.741962] Lustre: server umount lustre-MDT0000 complete [ 4350.457246] LustreError: 259593:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789370773 with bad export cookie 11299132048929750188 [ 4350.459117] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4350.464351] LustreError: 259593:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 4356.838560] Lustre: server umount lustre-MDT0001 complete [ 4367.194692] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing unload_modules_local [ 4452.319129] Lustre: lustre-OST0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 4452.476266] Lustre: server umount lustre-OST0001 complete [ 4457.040262] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_hostid [ 4467.761311] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 4493.821761] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4494.034455] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 4494.055793] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 4494.149661] Lustre: lustre-MDT0000: new disk, initializing [ 4494.236130] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4494.239167] Lustre: Skipped 3 previous similar messages [ 4494.255136] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 4497.969699] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 4505.846865] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4505.945555] Lustre: 264418:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 4506.161948] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 4509.089631] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 4516.025306] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 4519.891467] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 4524.666165] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4524.869518] Lustre: lustre-OST0000: new disk, initializing [ 4524.873292] Lustre: Skipped 1 previous similar message [ 4524.877654] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 4524.881845] Lustre: Skipped 2 previous similar messages [ 4524.887502] Lustre: 266384:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 4526.430466] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 4526.439551] Lustre: Skipped 1 previous similar message [ 4526.444950] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 4526.535741] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 4529.290130] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 4535.998368] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 4541.921417] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4541.935055] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4541.955532] Lustre: Skipped 5 previous similar messages [ 4541.965785] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4541.970510] Lustre: Skipped 8 previous similar messages [ 4546.606556] Lustre: server umount lustre-OST0000 complete [ 4555.560325] Lustre: server umount lustre-MDT0000 complete [ 4557.281462] LustreError: 264424:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4557.298621] LustreError: 264424:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 4 previous similar messages [ 4558.437940] LustreError: 264411:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789370981 with bad export cookie 11299132048929751651 [ 4558.446887] LustreError: 264411:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 4558.456615] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4558.822440] Lustre: server umount lustre-MDT0001 complete [ 4568.872816] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing unload_modules_local [ 4570.977664] Key type lgssc unregistered [ 4571.214625] LNet: 268142:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4571.221695] LNetError: 268142:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4571.238269] LNet: Removed LNI 192.168.201.147@tcp [ 4571.944167] Key type .llcrypt unregistered [ 4571.947389] Key type ._llcrypt unregistered [ 4592.715665] Key type ._llcrypt registered [ 4592.717385] Key type .llcrypt registered [ 4592.812947] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 4593.787289] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4593.859846] alg: No test for adler32 (adler32-zlib) [ 4594.966499] Lustre: Lustre: Build Version: 2.17.58_6_ge9bcf18 [ 4595.243106] LNet: Added LNI 192.168.201.147@tcp [8/256/0/180] [ 4596.893840] Key type lgssc registered [ 4597.879924] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4604.286658] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4604.297914] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4605.648152] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4608.946478] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 4615.100520] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4615.140510] LustreError: 269581:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4615.159396] LustreError: 269581:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 4615.339073] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4618.743447] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 4624.549887] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 4628.492407] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 4633.257308] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4633.500235] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4637.789284] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 4642.767667] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 4643.412429] Lustre: Setting parameter lustre-OST0000.ost.unknown_param=50 in log lustre-OST0000 [ 4645.859533] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4645.859702] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4645.873960] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4649.953604] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4650.893368] Lustre: server umount lustre-OST0000 complete [ 4655.074079] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4655.081595] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4655.084095] Lustre: Skipped 1 previous similar message [ 4659.518927] Lustre: server umount lustre-MDT0000 complete [ 4660.192543] LustreError: 272204:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4660.197866] LustreError: 272204:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 4661.958356] LustreError: 269562:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789371085 with bad export cookie 13958497923633264160 [ 4661.963639] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4661.966876] LustreError: 269562:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4662.161963] Lustre: server umount lustre-MDT0001 complete [ 4669.931438] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing unload_modules_local [ 4672.027465] Key type lgssc unregistered [ 4672.253813] LNet: 273160:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4672.257082] LNetError: 273160:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4672.266420] LNet: Removed LNI 192.168.201.147@tcp [ 4672.855162] Key type .llcrypt unregistered [ 4672.858432] Key type ._llcrypt unregistered [ 4683.807710] Key type ._llcrypt registered [ 4683.810290] Key type .llcrypt registered [ 4683.889983] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 4684.518899] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4684.546916] alg: No test for adler32 (adler32-zlib) [ 4685.508808] Lustre: Lustre: Build Version: 2.17.58_6_ge9bcf18 [ 4685.657106] LNet: Added LNI 192.168.201.147@tcp [8/256/0/180] [ 4687.287982] Key type lgssc registered [ 4688.021354] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4694.104970] Lustre: lustre-OST0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4694.118853] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4709.599354] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 4714.719260] LustreError: 274328:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.201.147@tcp: failed processing log, type 4: rc = -110 [ 4741.343219] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4745.339983] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 4750.358023] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 4751.757946] Lustre: server umount lustre-OST0000 complete [ 4762.496755] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing unload_modules_local [ 4764.424244] Key type lgssc unregistered [ 4764.629869] LNet: 275956:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4764.637452] LNetError: 275956:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4765.676258] LNet: Removed LNI 192.168.201.147@tcp [ 4766.262195] Key type .llcrypt unregistered [ 4766.266388] Key type ._llcrypt unregistered [ 4790.555971] Key type ._llcrypt registered [ 4790.557580] Key type .llcrypt registered [ 4790.620956] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 4791.044578] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4791.060126] alg: No test for adler32 (adler32-zlib) [ 4791.995659] Lustre: Lustre: Build Version: 2.17.58_6_ge9bcf18 [ 4792.153195] LNet: Added LNI 192.168.201.147@tcp [8/256/0/180] [ 4793.799171] Key type lgssc registered [ 4794.450919] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4801.913804] loop0: detected capacity change from 0 to 204800000 [ 4802.019567] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 4802.025863] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 4802.217209] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 4802.801421] loop0: detected capacity change from 0 to 204800000 [ 4802.921201] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 4802.931796] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 4803.113786] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 4803.730395] loop0: detected capacity change from 0 to 204800000 [ 4803.841767] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 4803.849344] blk_update_request: operation not supported error, dev loop0, sector 8224 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 4803.907226] blk_update_request: operation not supported error, dev loop0, sector 58264 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 4804.520880] loop0: detected capacity change from 0 to 204800000 [ 4804.640834] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 4805.394335] loop0: detected capacity change from 0 to 204800000 [ 4805.409553] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 4807.871082] loop0: detected capacity change from 0 to 204800000 [ 4807.902469] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 4810.298723] loop0: detected capacity change from 0 to 204800000 [ 4810.330154] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 4812.698935] loop0: detected capacity change from 0 to 204800000 [ 4812.720078] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 4815.323709] loop0: detected capacity change from 0 to 204800000 [ 4815.385441] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4815.441557] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4815.510860] Lustre: 279342:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 4815.516945] Lustre: 279342:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000-MDT0000' with [0x200000005:0x3:0x0]: rc = 0 [ 4815.524063] Lustre: 279342:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000-MDT0000' with [0x200000005:0x2:0x0]: rc = 0 [ 4815.530327] Lustre: 279342:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000003:0xa:0x0]: rc = 0 [ 4815.536954] Lustre: 279342:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000-MDT0000' with [0x200000005:0x1:0x0]: rc = 0 [ 4815.543393] Lustre: 279342:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000003:0xc:0x0]: rc = 0 [ 4815.550498] Lustre: 279342:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000003:0xb:0x0]: rc = 0 [ 4815.557417] Lustre: 279342:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index 'nodemap' with [0x200000003:0x3:0x0]: rc = 0 [ 4815.563253] Lustre: 279342:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000006:0x10000:0x0]: rc = 0 [ 4815.568539] Lustre: 279342:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000006:0x2010000:0x0]: rc = 0 [ 4815.575499] Lustre: 279342:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000006:0x1010000:0x0]: rc = 0 [ 4815.580213] Lustre: 279342:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x20000' with [0x200000006:0x20000:0x0]: rc = 0 [ 4815.589543] Lustre: 279342:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1020000' with [0x200000006:0x1020000:0x0]: rc = 0 [ 4815.594947] Lustre: 279342:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2020000' with [0x200000006:0x2020000:0x0]: rc = 0 [ 4819.994134] Lustre: server umount MGS complete [ 4820.588893] loop0: detected capacity change from 0 to 204800000 [ 4820.685814] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4820.995905] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4821.028979] Lustre: lustre-MDT0000: Aborting client recovery [ 4821.532126] loop1: detected capacity change from 0 to 204800000 [ 4821.639111] LDISKFS-fs (loop1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4821.731197] Lustre: 279774:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 4821.738232] Lustre: 279774:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x2010000-MDT0001' with [0x200000005:0x3:0x0]: rc = 0 [ 4821.744453] Lustre: 279774:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x2010000' with [0x200000003:0x6:0x0]: rc = 0 [ 4821.751593] Lustre: 279774:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x10000-MDT0001' with [0x200000005:0x1:0x0]: rc = 0 [ 4821.756991] Lustre: 279774:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x10000' with [0x200000003:0x4:0x0]: rc = 0 [ 4821.764390] Lustre: 279774:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x1010000-MDT0001' with [0x200000005:0x2:0x0]: rc = 0 [ 4821.771429] Lustre: 279774:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x1010000' with [0x200000003:0x5:0x0]: rc = 0 [ 4821.786078] Lustre: Found index 1 for lustre-MDT0001, updating log [ 4821.903790] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4821.933129] Lustre: lustre-MDT0001: Aborting client recovery [ 4822.499366] loop2: detected capacity change from 0 to 204800000 [ 4822.564577] LDISKFS-fs (loop2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4822.604612] Lustre: 279853:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 4822.614062] Lustre: 279853:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x2020000-OST0000' with [0x200000005:0x3:0x0]: rc = 0 [ 4822.624530] Lustre: 279853:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 4822.637442] Lustre: 279853:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 4822.648452] Lustre: 279853:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x1020000-OST0000' with [0x200000005:0x2:0x0]: rc = 0 [ 4822.657342] Lustre: 279853:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x20000-OST0000' with [0x200000005:0x1:0x0]: rc = 0 [ 4822.669524] Lustre: 279853:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 4822.742881] Lustre: Found index 0 for lustre-OST0000, updating log [ 4822.765520] Lustre: 279870:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 4822.828755] Lustre: lustre-OST0000: Aborting recovery [ 4823.411604] loop3: detected capacity change from 0 to 204800000 [ 4823.539034] LDISKFS-fs (loop3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4823.619140] Lustre: 279936:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 4823.627064] Lustre: 279936:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 4823.637831] Lustre: 279936:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x1020000-OST0001' with [0x200000005:0x2:0x0]: rc = 0 [ 4823.652036] Lustre: 279936:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x20000-OST0001' with [0x200000005:0x1:0x0]: rc = 0 [ 4823.660981] Lustre: 279936:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 4823.671270] Lustre: 279936:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 4823.680995] Lustre: 279936:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x2020000-OST0001' with [0x200000005:0x3:0x0]: rc = 0 [ 4823.737834] Lustre: 279942:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 4823.798693] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 4823.803461] Lustre: Skipped 1 previous similar message [ 4823.818239] Lustre: lustre-OST0001: Aborting recovery [ 4829.164539] LustreError: 279718:0:(lod_dev.c:511:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 8, retries 0, failed: rc = -108 [ 4831.201521] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 4831.202513] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 4831.216146] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000bd0 [ 4831.220220] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000bd0 [ 4832.234478] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:5 to 0x280000400:33) [ 4832.234599] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:5 to 0x2c0000400:33) [ 4835.495419] LustreError: 279685:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0000: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0000 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0000/identity_upcall, time 545us: rc = -2 [ 4836.001281] LustreError: 279684:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0000: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0000 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0000/identity_upcall, time 757us: rc = -2 [ 4836.016107] LustreError: 279684:0:(mdt_identity.c:115:mdt_identity_do_upcall()) Skipped 27 previous similar messages [ 4847.588392] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4847.588690] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4847.590116] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4847.597826] Lustre: Skipped 2 previous similar messages [ 4852.706330] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4852.716285] Lustre: Skipped 6 previous similar messages [ 4853.569197] Lustre: server umount lustre-MDT0000 complete [ 4854.049052] LustreError: 279667:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789371277 with bad export cookie 3887609825774009219 [ 4854.052143] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4854.059967] LustreError: 279667:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4857.826367] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4857.828889] LustreError: 279682:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4857.829098] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 4857.836094] Lustre: Skipped 2 previous similar messages [ 4857.848248] LustreError: 279682:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [ 4859.871901] LustreError: 280167:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4859.871948] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 4859.877343] LustreError: 280167:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 4859.880767] Lustre: Skipped 2 previous similar messages [ 4860.292172] Lustre: server umount lustre-MDT0001 complete [ 4866.784518] Lustre: server umount lustre-OST0000 complete [ 4873.397296] Lustre: server umount lustre-OST0001 complete [ 4876.654649] Lustre: DEBUG MARKER: == conf-sanity test 109a: test lctl clear_conf fsname ==== 03:34:59 (1789371299) [ 4888.988348] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_hostid [ 4892.763529] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 4906.210341] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4906.311669] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 4906.322421] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 4906.358705] Lustre: lustre-MDT0000: new disk, initializing [ 4906.383400] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4906.394785] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 4907.845248] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 4912.743427] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4912.802467] Lustre: 284008:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 4912.840764] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 4912.844833] Lustre: Skipped 1 previous similar message [ 4912.884098] Lustre: lustre-MDT0001: new disk, initializing [ 4912.929886] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4912.948885] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 4912.952702] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 4914.561812] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 4918.861964] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 4921.224909] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 4924.084443] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4924.205942] Lustre: lustre-OST0000: new disk, initializing [ 4924.208126] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 4924.212136] Lustre: 285976:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 4924.255091] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4926.728619] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 4931.088665] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 4931.092441] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 4931.137917] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 4931.568439] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 4934.515747] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 4940.279471] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 4947.961281] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 4958.968917] Lustre: Modifying parameter lustre-client.llite.max_read_ahead_mb=64 in log lustre-client [ 4997.601695] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4997.610153] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4997.611185] Lustre: Skipped 1 previous similar message [ 4997.621416] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 5003.318677] Lustre: server umount lustre-OST0000 complete [ 5007.840685] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5007.848572] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5007.848717] Lustre: Skipped 1 previous similar message [ 5007.856390] Lustre: Skipped 4 previous similar messages [ 5014.324380] Lustre: server umount lustre-MDT0000 complete [ 5018.081058] LustreError: 284015:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5018.156379] LustreError: 284015:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 5023.200643] LustreError: 284020:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5023.237936] LustreError: 284020:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 5025.222504] LustreError: 287521:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789371448 with bad export cookie 3887609825774011942 [ 5025.235260] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5025.240245] LustreError: 287521:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 5026.367811] Lustre: server umount lustre-MDT0001 complete [ 5049.720411] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5064.319787] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 5074.139749] Lustre: server umount MGS complete [ 5094.207034] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5094.845540] LustreError: 289970:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5094.886888] LustreError: 289983:0:(qmt_pool.c:1639:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 5095.042818] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5102.543306] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 5105.637635] LustreError: 289970:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5105.657853] LustreError: 289970:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 5112.655796] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5117.652296] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 5125.096927] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 5130.783950] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 5136.278467] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5136.545306] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5136.551375] Lustre: Skipped 1 previous similar message [ 5142.162684] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 5148.473159] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 5176.808599] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5176.819757] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5176.827737] Lustre: Skipped 2 previous similar messages [ 5176.828279] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 5177.538743] Lustre: server umount lustre-OST0000 complete [ 5195.231895] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 5195.540681] Lustre: server umount lustre-MDT0000 complete [ 5197.288859] LustreError: 289970:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5197.307162] LustreError: 289970:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 5199.364994] LustreError: 289951:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789371622 with bad export cookie 3887609825774013853 [ 5199.376310] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5199.380738] LustreError: 289951:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 5199.656248] Lustre: server umount lustre-MDT0001 complete [ 5209.690128] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing unload_modules_local [ 5212.436212] Key type lgssc unregistered [ 5212.751405] LNet: 293918:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5212.756230] LNetError: 293918:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5212.770348] LNet: Removed LNI 192.168.201.147@tcp [ 5213.665357] Key type .llcrypt unregistered [ 5213.667691] Key type ._llcrypt unregistered [ 5247.974837] Key type ._llcrypt registered [ 5247.978443] Key type .llcrypt registered [ 5248.126838] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_hostid [ 5262.214588] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 5262.951277] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5263.127850] alg: No test for adler32 (adler32-zlib) [ 5264.301555] Lustre: Lustre: Build Version: 2.17.58_6_ge9bcf18 [ 5264.522292] LNet: Added LNI 192.168.201.147@tcp [8/256/0/180] [ 5266.183174] Key type lgssc registered [ 5267.264469] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5311.891162] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5311.919033] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5313.185310] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 5313.238803] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 5313.325531] Lustre: lustre-MDT0000: new disk, initializing [ 5313.444503] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5313.472467] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 5317.944937] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 5330.942214] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5331.135735] Lustre: 297874:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 5331.194493] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 5331.197210] Lustre: Skipped 1 previous similar message [ 5331.261782] Lustre: lustre-MDT0001: new disk, initializing [ 5331.353520] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5331.391425] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 5331.405712] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 5336.300851] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 5346.179537] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 5352.595746] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 5361.376267] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5361.690323] Lustre: lustre-OST0000: new disk, initializing [ 5361.703630] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 5361.716176] Lustre: 299840:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 5361.922984] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5367.891234] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 5367.902552] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 5367.988499] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 5369.830498] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 5379.630357] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 5386.524672] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 5395.948727] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 5403.627654] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 5408.397054] Lustre: Modifying parameter lustre-client.llite.max_read_ahead_mb=64 in log lustre-client [ 5455.328813] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 5455.343395] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5455.344336] LustreError: Skipped 1 previous similar message [ 5455.344908] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5455.383548] Lustre: Skipped 1 previous similar message [ 5460.455523] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5460.479066] Lustre: Skipped 2 previous similar messages [ 5461.134296] Lustre: server umount lustre-OST0000 complete [ 5465.578300] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5465.584424] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5465.590334] Lustre: Skipped 1 previous similar message [ 5465.607196] Lustre: Skipped 1 previous similar message [ 5470.693643] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5470.699236] Lustre: Skipped 1 previous similar message [ 5475.810641] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5475.814925] Lustre: Skipped 1 previous similar message [ 5479.391325] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 5479.578957] Lustre: server umount lustre-MDT0000 complete [ 5482.929665] LustreError: 297866:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789371906 with bad export cookie 406922585222856835 [ 5482.931845] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5482.936420] LustreError: 297866:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 5483.316125] Lustre: server umount lustre-MDT0001 complete [ 5492.252192] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5496.994291] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 5501.827307] Lustre: server umount MGS complete [ 5516.032017] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5516.565710] LustreError: 303709:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5516.595395] LustreError: 303709:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [ 5516.599745] LustreError: 303722:0:(qmt_pool.c:1639:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 5516.678273] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5521.139911] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 5521.898054] LustreError: 303710:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5525.993842] LustreError: 303709:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5531.114235] LustreError: 303710:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5531.654484] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5532.133322] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5537.503244] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 5545.985789] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 5552.543974] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 5560.441244] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5560.801535] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5567.200592] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 5575.478290] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 5613.038720] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 5613.052189] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5613.062285] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5613.073885] Lustre: Skipped 1 previous similar message [ 5613.089759] Lustre: Skipped 1 previous similar message [ 5623.264978] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 5623.576474] Lustre: server umount lustre-OST0000 complete [ 5628.390185] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5633.504039] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5633.510492] Lustre: Skipped 6 previous similar messages [ 5633.971085] Lustre: server umount lustre-MDT0000 complete [ 5638.229280] LustreError: 303691:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789372061 with bad export cookie 406922585222858697 [ 5638.239604] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5638.244982] LustreError: 303691:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 5638.507559] Lustre: server umount lustre-MDT0001 complete [ 5650.447896] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing unload_modules_local [ 5653.623860] Key type lgssc unregistered [ 5653.906862] LNet: 307654:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5653.914816] LNetError: 307654:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5654.951792] LNet: Removed LNI 192.168.201.147@tcp [ 5655.714379] Key type .llcrypt unregistered [ 5655.717962] Key type ._llcrypt unregistered [ 5680.688518] Key type ._llcrypt registered [ 5680.690924] Key type .llcrypt registered [ 5680.861957] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_hostid [ 5697.291240] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 5699.300481] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5699.388815] alg: No test for adler32 (adler32-zlib) [ 5700.580309] Lustre: Lustre: Build Version: 2.17.58_6_ge9bcf18 [ 5700.968317] LNet: Added LNI 192.168.201.147@tcp [8/256/0/180] [ 5702.639484] Key type lgssc registered [ 5704.109269] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5730.211597] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 5746.921448] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5746.950787] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5748.237198] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 5748.279551] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 5748.456464] Lustre: lustre-MDT0000: new disk, initializing [ 5748.618154] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5748.668521] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 5755.911987] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 5771.146687] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5771.917460] Lustre: lustre-OST0000: new disk, initializing [ 5771.952327] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 5771.973979] Lustre: Skipped 1 previous similar message [ 5771.986055] Lustre: 311705:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 5772.198085] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5781.656589] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 5781.668761] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 5781.722281] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 5783.966128] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 6610.912802] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6610.924047] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6614.456956] Lustre: server umount lustre-MDT0000 complete [ 6617.668640] LustreError: 310889:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789373040 with bad export cookie 12871409759985940164 [ 6617.675977] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6617.691050] LustreError: 310889:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 6617.845289] Lustre: server umount lustre-OST0000 complete [ 6642.281367] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_hostid [ 6651.949366] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 6686.684055] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6687.024548] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 6687.072192] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 6687.169547] Lustre: lustre-MDT0000: new disk, initializing [ 6687.264455] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6687.284107] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 6691.712200] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 6702.761986] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6702.892264] Lustre: 316049:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 6702.939436] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 6702.944288] Lustre: Skipped 1 previous similar message [ 6703.009987] Lustre: lustre-MDT0001: new disk, initializing [ 6703.107437] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6703.147166] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 6703.157648] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 6707.499919] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 6718.152450] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 6724.493537] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 6732.110189] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6732.494772] Lustre: lustre-OST0000: new disk, initializing [ 6732.500621] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 6732.511421] Lustre: 318020:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 6732.650029] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6739.955890] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 6741.586390] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 6741.603389] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 6741.717889] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 6749.452823] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 6754.000993] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 6754.164837] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 6758.727694] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 6758.930734] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 6762.464830] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 6762.466424] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6762.472274] LustreError: Skipped 1 previous similar message [ 6762.493578] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6762.501722] Lustre: Skipped 1 previous similar message [ 6762.516733] Lustre: Skipped 1 previous similar message [ 6766.855059] Lustre: server umount lustre-OST0000 complete [ 6772.706872] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6772.714735] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6772.721773] Lustre: Skipped 1 previous similar message [ 6772.743320] Lustre: Skipped 1 previous similar message [ 6776.716655] Lustre: server umount lustre-MDT0000 complete [ 6779.600216] LustreError: 316042:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789373202 with bad export cookie 12871409759988880983 [ 6779.600899] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6779.609954] LustreError: 316042:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 6779.988882] Lustre: server umount lustre-MDT0001 complete [ 6782.954831] Lustre: DEBUG MARKER: SKIP: conf-sanity test_111 skipping SLOW test 111 [ 6784.531487] Lustre: DEBUG MARKER: == conf-sanity test 112a: mount OST with no_create option ========================================================== 04:06:47 (1789373207) [ 6791.297711] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6791.984353] LustreError: 320332:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6792.002945] LustreError: 320332:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [ 6792.070764] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6796.895465] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 6797.292146] LustreError: 320333:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6797.322846] LustreError: 320333:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 6802.410022] LustreError: 320332:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6805.933573] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6806.348722] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6812.121654] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 6819.034403] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 6824.322772] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 6831.052135] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6831.399744] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6838.045676] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 6846.692478] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 6856.974927] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6857.278295] Lustre: lustre-OST0001: new disk, initializing [ 6857.287177] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 6857.292493] Lustre: 323168:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 6857.428950] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 6865.246287] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 6866.048959] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 6866.068595] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 6866.140976] LustreError: 323558:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 6867.172217] LustreError: 323558:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 6867.179035] LustreError: 323558:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 1 previous similar message [ 6868.257552] LustreError: 323566:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [ 6868.283876] LustreError: 323566:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 1 previous similar message [ 6870.381230] LustreError: 323566:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [ 6870.390714] LustreError: 323566:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 4 previous similar messages [ 6874.474401] LustreError: 323558:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 6874.488116] LustreError: 323558:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 6 previous similar messages [ 6875.465559] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 6875.692862] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 6882.494274] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8946c76de000.ost_server_uuid 50 [ 6882.732353] LustreError: 323566:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [ 6882.741717] LustreError: 323566:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 15 previous similar messages [ 6884.782455] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff8946c76de000.ost_server_uuid in FULL state after 0 sec [ 6891.998707] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8946c76de000.ost_server_uuid 50 [ 6894.348261] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-ffff8946c76de000.ost_server_uuid in IDLE state after 0 sec [ 6897.201088] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 6914.030711] LustreError: lustre-OST0001-osc-MDT0000: operation ost_destroy to node 0@lo failed: rc = -107 [ 6914.058965] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6914.114895] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 6917.637906] LustreError: lustre-OST0001-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 6919.497321] Lustre: server umount lustre-OST0001 complete [ 6921.385783] LustreError: 322152:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 192.168.201.47@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6927.858735] LustreError: 322152:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6927.898341] LustreError: 322152:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [ 6929.888399] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 6929.902449] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6929.927533] Lustre: Skipped 1 previous similar message [ 6929.940250] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6929.950760] Lustre: Skipped 3 previous similar messages [ 6934.170650] Lustre: server umount lustre-OST0000 complete [ 6939.616557] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 6939.625394] LustreError: Skipped 1 previous similar message [ 6939.634361] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6939.646087] Lustre: Skipped 1 previous similar message [ 6939.650540] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6939.657190] Lustre: Skipped 2 previous similar messages [ 6944.362052] Lustre: server umount lustre-MDT0000 complete [ 6947.797933] LustreError: 320313:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789373371 with bad export cookie 12871409759988881865 [ 6947.804863] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6947.808675] LustreError: 320313:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 6948.062071] Lustre: server umount lustre-MDT0001 complete [ 6959.092834] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing unload_modules_local [ 6961.537176] Key type lgssc unregistered [ 6961.827422] LNet: 325859:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6961.840376] LNetError: 325859:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6961.857291] LNet: Removed LNI 192.168.201.147@tcp [ 6962.750987] Key type .llcrypt unregistered [ 6962.752661] Key type ._llcrypt unregistered [ 6994.543408] Key type ._llcrypt registered [ 6994.546793] Key type .llcrypt registered [ 6994.751934] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 6996.012213] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6996.437652] alg: No test for adler32 (adler32-zlib) [ 6998.082472] Lustre: Lustre: Build Version: 2.17.58_6_ge9bcf18 [ 6998.392156] LNet: Added LNI 192.168.201.147@tcp [8/256/0/180] [ 7000.100062] Key type lgssc registered [ 7001.920667] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7011.128606] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7011.162371] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7012.726713] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7017.718194] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 7022.054286] LustreError: 327275:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7022.078030] LustreError: 327275:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 7025.075251] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 7027.174618] LustreError: 327276:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7032.291435] LustreError: 327275:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7032.760820] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7033.397355] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7038.580499] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 7047.863408] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7048.194582] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7056.334746] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 7057.402989] LustreError: 328955:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7057.450111] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:65) [ 7063.522617] LustreError: 328955:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7063.561272] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 7063.565159] LustreError: 328955:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [ 7071.248939] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7071.565966] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 7076.914600] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:33) [ 7078.272351] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 7087.401741] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 7095.980420] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing wait_import_state (FULL|IDLE) os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [ 7096.351900] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 7199.720749] LustreError: lustre-OST0001-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 7199.731841] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7199.743722] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 7199.749599] LustreError: Skipped 1 previous similar message [ 7199.762504] Lustre: Skipped 1 previous similar message [ 7201.753346] Lustre: server umount lustre-OST0001 complete [ 7204.838754] LustreError: 329831:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7204.858418] LustreError: 329831:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [ 7209.973661] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7209.979243] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7210.004037] Lustre: Skipped 2 previous similar messages [ 7210.017120] Lustre: Skipped 1 previous similar message [ 7215.073609] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7215.090161] Lustre: Skipped 1 previous similar message [ 7220.194895] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7222.239172] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 7222.385730] Lustre: server umount lustre-OST0000 complete [ 7227.877620] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7227.885131] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7227.907345] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7227.915377] Lustre: Skipped 1 previous similar message [ 7230.447463] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7232.546546] Lustre: server umount lustre-MDT0000 complete [ 7235.571269] LustreError: 329830:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7235.597539] LustreError: 329830:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 7 previous similar messages [ 7236.792481] LustreError: 330957:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789373660 with bad export cookie 952810585899772193 [ 7236.793203] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7236.801362] LustreError: 330957:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 7237.122939] Lustre: server umount lustre-MDT0001 complete [ 7249.268964] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing unload_modules_local [ 7252.486150] Key type lgssc unregistered [ 7252.860825] LNet: 332218:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7252.877982] LNetError: 332218:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7253.932807] LNet: Removed LNI 192.168.201.147@tcp [ 7254.697244] Key type .llcrypt unregistered [ 7254.699107] Key type ._llcrypt unregistered [ 7308.260419] Key type ._llcrypt registered [ 7308.268644] Key type .llcrypt registered [ 7308.428944] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 7310.138883] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7310.170165] alg: No test for adler32 (adler32-zlib) [ 7311.297380] Lustre: Lustre: Build Version: 2.17.58_6_ge9bcf18 [ 7311.579033] LNet: Added LNI 192.168.201.147@tcp [8/256/0/180] [ 7313.319200] Key type lgssc registered [ 7314.729335] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7325.265296] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7325.277688] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7326.857118] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7331.864186] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 7337.442553] LustreError: 334514:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7337.455228] LustreError: 334514:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 7340.135408] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7340.485806] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7345.103776] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 7348.631285] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 7358.024942] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7358.293542] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7365.505083] LustreError: 336004:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7365.899297] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 7370.746368] LustreError: 336327:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7371.840699] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:97) [ 7374.815236] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7375.051241] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 7380.477536] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:65) [ 7381.968808] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 7392.194910] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 7400.531779] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 7417.313606] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7417.326756] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7417.343238] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7421.413298] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7421.416693] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7421.430466] Lustre: Skipped 2 previous similar messages [ 7421.448439] Lustre: Skipped 2 previous similar messages [ 7423.836820] Lustre: server umount lustre-MDT0000 complete [ 7426.531095] LustreError: 334513:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7426.557103] LustreError: 334513:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 5 previous similar messages [ 7428.449218] LustreError: 334493:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789373851 with bad export cookie 12763439857182551658 [ 7428.459253] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7428.467358] LustreError: 334493:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 7429.003563] Lustre: server umount lustre-MDT0001 complete [ 7443.812547] Lustre: server umount lustre-OST0000 complete [ 7447.010056] Lustre: 333776:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789373854/real 1789373854] req@ffff92324e8be680 x1876294352573568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789373870 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 7447.059294] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7448.892454] Lustre: server umount lustre-OST0001 complete [ 7476.696900] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 7490.060738] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7490.407086] LustreError: 339802:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7490.470504] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7496.108669] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 7500.771061] LustreError: 339803:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7500.796326] LustreError: 339803:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 7506.284581] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7506.809392] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7512.054099] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 7515.482818] Lustre: 340942:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 7521.841153] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7529.005919] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 7531.501157] LustreError: 341299:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7531.522178] LustreError: 341299:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 7536.662645] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:129) [ 7539.624503] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7540.009751] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 7540.022413] Lustre: Skipped 1 previous similar message [ 7545.338254] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:97) [ 7547.609721] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 7556.810936] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 7561.908644] Lustre: 342815:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 7568.352741] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7568.365625] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7568.381188] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7568.389291] Lustre: Skipped 1 previous similar message [ 7570.919144] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7574.833121] Lustre: server umount lustre-MDT0000 complete [ 7576.069125] LustreError: 339798:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7576.092951] LustreError: 339798:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 5 previous similar messages [ 7580.331805] LustreError: 339783:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789374003 with bad export cookie 12763439857182553359 [ 7580.339378] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7580.361225] LustreError: 339783:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 7581.095543] Lustre: server umount lustre-MDT0001 complete [ 7596.898608] Lustre: server umount lustre-OST0000 complete [ 7597.664815] Lustre: 333774:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789374004/real 1789374004] req@ffff923345366a00 x1876294352626048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789374020 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 7597.717372] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7597.739807] Lustre: Skipped 3 previous similar messages [ 7601.232904] Lustre: server umount lustre-OST0001 complete [ 7604.395381] Lustre: DEBUG MARKER: SKIP: conf-sanity test_114 skipping SLOW test 114 [ 7606.427875] Lustre: DEBUG MARKER: SKIP: conf-sanity test_115 skipping excluded test 115 [ 7608.553558] Lustre: DEBUG MARKER: == conf-sanity test 116: big size MDT support ============ 04:20:30 (1789374030) [ 7632.991951] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 7642.016256] loop0: detected capacity change from 0 to 1099511627776 [ 7642.719756] SGI XFS with ACLs, security attributes, quota, no debug enabled [ 7642.729616] *** VALIDATE xfs *** [ 7642.754449] XFS (loop0): Mounting V5 Filesystem [ 7642.801472] XFS (loop0): Ending clean mount [ 7644.310669] loop1: detected capacity change from 0 to 18691697672192 [ 7794.559149] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_hostid [ 7805.480777] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 7846.228875] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7846.594718] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 7846.661192] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 7846.797406] Lustre: lustre-MDT0000: new disk, initializing [ 7846.908656] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7846.938797] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 7852.158502] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 7864.738466] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7864.847648] Lustre: 347957:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 7864.889164] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 7864.892536] Lustre: Skipped 1 previous similar message [ 7864.972825] Lustre: lustre-MDT0001: new disk, initializing [ 7865.170788] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 7865.196388] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 7871.168310] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 7884.730390] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 7893.257810] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 7904.845438] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7905.273801] Lustre: lustre-OST0000: new disk, initializing [ 7905.285257] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 7905.308759] Lustre: 349927:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 7906.760458] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 7906.783254] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 7906.963165] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 7913.979886] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 7924.078537] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 7929.942400] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 7930.248752] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 7936.338117] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 7936.714709] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 7942.630733] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 7942.632569] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7942.670650] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7942.686911] Lustre: Skipped 4 previous similar messages [ 7952.870822] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7952.883295] Lustre: Skipped 3 previous similar messages [ 7953.375231] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 7953.750902] Lustre: server umount lustre-OST0000 complete [ 7962.594123] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7962.600029] LustreError: Skipped 1 previous similar message [ 7962.616070] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7962.642434] Lustre: Skipped 2 previous similar messages [ 7964.122805] Lustre: server umount lustre-MDT0000 complete [ 7968.136133] LustreError: 348753:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789374391 with bad export cookie 12763439857182554913 [ 7968.145333] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7968.152303] LustreError: 348753:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 7968.717166] Lustre: server umount lustre-MDT0001 complete [ 7977.776237] XFS (loop0): Unmounting Filesystem [ 7982.152237] Lustre: DEBUG MARKER: == conf-sanity test 117: lctl get_param return errors properly ========================================================== 04:26:44 (1789374404) [ 7988.550873] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7989.232243] LustreError: 352489:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7989.340561] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7989.353786] Lustre: Skipped 2 previous similar messages [ 7994.841725] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 8005.757345] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8011.985898] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 8021.046366] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 8027.529456] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 8034.897144] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8042.387115] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 8049.938963] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 8072.160464] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 8072.182431] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8072.199862] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8072.209817] Lustre: Skipped 4 previous similar messages [ 8077.159392] Lustre: server umount lustre-OST0000 complete [ 8083.426561] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8083.441669] LustreError: Skipped 1 previous similar message [ 8087.783241] Lustre: server umount lustre-MDT0000 complete [ 8091.698936] LustreError: 355101:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789374514 with bad export cookie 12763439857182555795 [ 8091.712995] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8091.714030] LustreError: 355101:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 8092.179462] Lustre: server umount lustre-MDT0001 complete [ 8106.146584] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing unload_modules_local [ 8109.905806] Key type lgssc unregistered [ 8110.352756] LNet: 356140:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8110.358422] LNetError: 356140:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8110.382820] LNet: Removed LNI 192.168.201.147@tcp [ 8111.728829] Key type .llcrypt unregistered [ 8111.730429] Key type ._llcrypt unregistered [ 8149.557314] Key type ._llcrypt registered [ 8149.558828] Key type .llcrypt registered [ 8149.693950] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 8151.065387] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8151.157312] alg: No test for adler32 (adler32-zlib) [ 8152.501226] Lustre: Lustre: Build Version: 2.17.58_6_ge9bcf18 [ 8152.876696] LNet: Added LNI 192.168.201.147@tcp [8/256/0/180] [ 8154.663387] Key type lgssc registered [ 8155.849888] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8165.430683] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 8165.445463] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8167.327043] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8174.460159] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 8177.658336] LustreError: 357705:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8177.691509] LustreError: 357705:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 8182.774894] LustreError: 357706:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8186.823374] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8187.494658] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8194.192955] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 8201.706137] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 8207.593965] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 8215.376752] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8215.739956] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8221.621459] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 8229.404375] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 8250.594033] Lustre: lustre-MDT0001: Not available for connect from 192.168.201.47@tcp (stopping) [ 8253.966799] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [ 8253.986211] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8253.988704] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 8254.013101] Lustre: Skipped 1 previous similar message [ 8254.033293] Lustre: Skipped 1 previous similar message [ 8255.658858] Lustre: lustre-MDT0001: Not available for connect from 192.168.201.47@tcp (stopping) [ 8255.959078] Lustre: server umount lustre-MDT0001 complete [ 8259.046483] LustreError: 357706:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8259.089705] LustreError: 357706:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 8264.181178] LustreError: 358438:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8264.202174] LustreError: 358438:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 8267.786815] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8267.903448] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [ 8267.906549] Lustre: Found index 1 for lustre-MDT0001, updating log [ 8267.956836] Lustre: 357695:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8268.273795] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8273.400491] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 8273.545758] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 8275.989728] LustreError: 361301:0:(obd_mount.c:234:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [ 8276.003767] LustreError: 361301:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [ 8276.013697] LustreError: 357697:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [ 8276.112989] LustreError: 361306:0:(obd_config.c:2102:class_config_llog_handler()) MGC192.168.201.147@tcp: cfg command failed: rc = -17 [ 8276.125518] Lustre: cmd=cf001 0:lustre-MDT0001-osp-MDT0000 1:osp 2:lustre-MDT0000-mdtlov_UUID [ 8276.125518] [ 8283.617099] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [ 8283.627320] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8283.641770] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 8283.668438] Lustre: Skipped 1 previous similar message [ 8288.717508] Lustre: server umount lustre-MDT0001 complete [ 8288.758247] LustreError: 357700:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8288.798505] LustreError: 357700:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 8298.902801] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8298.990787] LustreError: 358438:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8299.012499] LustreError: 358438:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 5 previous similar messages [ 8299.052147] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [ 8299.059724] Lustre: Found index 1 for lustre-MDT0001, updating log [ 8299.120607] Lustre: 357695:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8299.587744] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8304.424363] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 8304.618516] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 8306.167339] LustreError: 362328:0:(obd_mount.c:234:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [ 8306.176429] LustreError: 362328:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [ 8306.183397] LustreError: 357697:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [ 8306.188799] LustreError: 357697:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [ 8306.264745] LustreError: 362335:0:(obd_config.c:761:class_setup()) osp: device 8 already setup: rc = -17 [ 8306.273299] LustreError: 362335:0:(obd_config.c:866:class_detach()) OBD device 8 still set up [ 8306.279692] LustreError: 362335:0:(obd_config.c:2102:class_config_llog_handler()) MGC192.168.201.147@tcp: cfg command failed: rc = -17 [ 8306.298105] Lustre: cmd=cf003 0:lustre-MDT0001-osp-MDT0000 1:lustre-MDT0001_UUID 2:192.168.201.147@tcp [ 8306.298105] [ 8611.808708] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [ 8611.814239] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8611.818219] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 8611.824783] Lustre: Skipped 1 previous similar message [ 8611.834569] Lustre: Skipped 3 previous similar messages [ 8617.361648] Lustre: server umount lustre-MDT0001 complete [ 8618.155483] LustreError: 361437:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.201.47@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8627.693287] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8627.824032] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [ 8627.829384] Lustre: Found index 1 for lustre-MDT0001, updating log [ 8627.893911] Lustre: 357694:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8628.376895] Lustre: lustre-MDT0001: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [ 8633.391989] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 8633.845399] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 8636.447628] LustreError: 370882:0:(obd_mount.c:234:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [ 8636.461147] LustreError: 370882:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [ 8636.470533] LustreError: 357697:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [ 8636.479174] LustreError: 357697:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [ 8636.579674] LustreError: 370885:0:(lod_lov.c:208:lod_add_device()) lustre-MDT0001-osp-MDT0000: cannot connect to next dev lustre-MDT0001_UUID (-114) [ 8636.607566] LustreError: 370885:0:(obd_config.c:2102:class_config_llog_handler()) MGC192.168.201.147@tcp: cfg command failed: rc = -114 [ 8636.619118] Lustre: cmd=cf014 0:lustre-MDT0000-mdtlov 1:lustre-MDT0001_UUID 2:1 3:1 [ 8636.619118] [ 8955.879087] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8955.883947] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8955.890739] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8955.895620] Lustre: Skipped 3 previous similar messages [ 8962.034577] Lustre: server umount lustre-MDT0000 complete [ 8966.521203] LustreError: 357686:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789375389 with bad export cookie 12728738166590972811 [ 8966.526413] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8966.548292] LustreError: 357686:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 8966.625155] LustreError: 357702:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8966.628044] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8966.658477] LustreError: 357702:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 5 previous similar messages [ 8966.708399] Lustre: Skipped 2 previous similar messages [ 8973.292756] Lustre: server umount lustre-MDT0001 complete [ 8978.861101] Lustre: server umount lustre-OST0000 complete [ 8992.133492] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_hostid [ 9004.416809] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 9049.378847] Lustre: DEBUG MARKER: == conf-sanity test 120: cross-target rename should not create bad symlinks ========================================================== 04:44:31 (1789375471) [ 9056.655814] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9056.911051] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 9056.945449] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 9057.056627] Lustre: lustre-MDT0000: new disk, initializing [ 9057.123428] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9057.140425] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 9061.627447] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 9072.623286] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9072.739343] Lustre: 381370:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 9072.786674] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 9072.788894] Lustre: Skipped 1 previous similar message [ 9072.853868] Lustre: lustre-MDT0001: new disk, initializing [ 9072.938300] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9072.977251] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 9072.993742] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 9078.381523] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 9089.521847] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 9096.096365] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 9103.667095] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9104.034537] Lustre: lustre-OST0000: new disk, initializing [ 9104.043626] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 9104.055692] Lustre: 383341:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 9104.174616] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9111.207960] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all [ 9111.701501] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 9111.712663] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 9111.828877] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 9122.571683] Lustre: DEBUG MARKER: oleg147-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 9132.512486] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9132.522045] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9132.528142] Lustre: Skipped 1 previous similar message [ 9132.545374] Lustre: Skipped 9 previous similar messages [ 9134.561475] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 9138.529216] Lustre: server umount lustre-MDT0000 complete [ 9142.763858] LustreError: 382496:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9142.797663] LustreError: 382496:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [ 9142.836701] LustreError: 381364:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789375566 with bad export cookie 12728738166590974764 [ 9142.849310] LustreError: MGC192.168.201.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9142.862106] LustreError: 381364:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 9143.344758] Lustre: server umount lustre-MDT0001 complete [ 9157.934215] Lustre: server umount lustre-OST0000 complete [ 9192.839200] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing set_hostid [ 9204.911492] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing load_modules_local [ 9236.716370] Lustre: DEBUG MARKER: == conf-sanity test complete, duration 9008 sec ========== 04:47:39 (1789375659) [ 9238.374572] Lustre: DEBUG MARKER: === conf-sanity: start cleanup 04:47:40 (1789375660) === [ 9241.828053] Lustre: DEBUG MARKER: === conf-sanity: finish cleanup 04:47:44 (1789375664) === [ 9280.686367] Lustre: DEBUG MARKER: oleg147-server.virtnet: executing unload_modules_local [ 9283.352359] Key type lgssc unregistered [ 9283.640113] LNet: 389708:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 9283.643412] LNetError: 389708:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 9283.668471] LNet: Removed LNI 192.168.201.147@tcp [ 9284.469412] Key type .llcrypt unregistered [ 9284.472771] Key type ._llcrypt unregistered