[ 0.000000] Linux version 4.18.0rh8.10-debug (green@maintenance) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-26) (GCC)) #2 SMP Mon Jul 14 01:24:22 EDT 2025 [ 0.000000] Command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffcdfff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffce000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x0000000146dfffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.8 present. [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 [ 0.000000] Hypervisor detected: KVM [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 465403906 cycles [ 0.000000] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns [ 0.000000] tsc: Detected 2399.998 MHz processor [ 0.000000] last_pfn = 0x146e00 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0xbffce max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000f54b0-0x000f54bf] [ 0.000000] RAMDISK: [mem 0xbcc54000-0xbffbffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F52D0 000014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 0x00000000BFFE247C 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 0x00000000BFFE2318 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 0x00000000BFFE0040 0022D8 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 0x00000000BFFE0000 000040 [ 0.000000] ACPI: APIC 0x00000000BFFE238C 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: HPET 0x00000000BFFE241C 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: WAET 0x00000000BFFE2454 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0xbffe2318-0xbffe238b] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe2317] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0xbffe238c-0xbffe241b] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0xbffe241c-0xbffe2453] [ 0.000000] ACPI: Reserving WAET table memory at [mem 0xbffe2454-0xbffe247b] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x0000000146dfffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x1465a3000-0x1465cdfff] [ 0.000000] Reserving 256MB of memory at 2752MB for crashkernel (System RAM: 4205MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009efff] [ 0.000000] node 0: [mem 0x0000000000100000-0x00000000bffcdfff] [ 0.000000] node 0: [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Zeroed struct page in unavailable ranges: 4756 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x0000000146dfffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] TSC deadline timer available [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] kvm-guest: KVM setup pv remote TLB flush [ 0.000000] kvm-guest: setup PV sched yield [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbffce000-0xbfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.000000] [mem 0xc0000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u524288 [ 0.000000] kvm-guest: PV spinlocks enabled [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1059606 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] audit: disabled (until reboot) [ 0.000000] software IO TLB: area num 4. [ 0.000000] Memory: 2829652K/4306352K available (18435K kernel code, 11221K rwdata, 7248K rodata, 2908K init, 18040K bss, 524580K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] ftrace: allocating 41240 entries in 162 pages [ 0.000000] ftrace: allocated 162 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU event tracing is enabled. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=4. [ 0.000000] rcu: RCU callback double-/use-after-free debug enabled. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 [ 0.000000] NR_IRQS: 524544, nr_irqs: 456, preallocated irqs: 16 [ 0.000000] random: get_random_bytes called from start_kernel+0x622/0x9a8 with crng_init=0 [ 0.001000] Console: colour *CGA 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns [ 0.001010] APIC: Switch to symmetric I/O mode setup [ 0.002337] x2apic enabled [ 0.003008] Switched APIC routing to physical x2apic. [ 0.004010] kvm-guest: setup PV IPIs [ 0.007000] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.007000] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 0.007022] Calibrating delay loop (skipped) preset value.. 4799.99 BogoMIPS (lpj=2399998) [ 0.008012] pid_max: default: 32768 minimum: 301 [ 0.009134] LSM: Security Framework initializing [ 0.010050] Yama: becoming mindful. [ 0.011029] SELinux: Initializing. [ 0.012084] *** VALIDATE selinux *** [ 0.021172] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, vmalloc) [ 0.025585] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc) [ 0.026142] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.027116] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.028106] *** VALIDATE tmpfs *** [ 0.030348] *** VALIDATE proc *** [ 0.031253] *** VALIDATE cgroup *** [ 0.032010] *** VALIDATE cgroup2 *** [ 0.033212] x86/cpu: User Mode Instruction Prevention (UMIP) activated [ 0.034156] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.035007] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 [ 0.037029] Spectre V2 : User space: Vulnerable [ 0.039005] Speculative Store Bypass: Vulnerable [ 0.042215] debug: unmapping init [mem 0xffffffffb4a59000-0xffffffffb4a60fff] [ 0.045223] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (family: 0x6, model: 0x3e, stepping: 0x4) [ 0.046728] Performance Events: IvyBridge events, full-width counters, Intel PMU driver. [ 0.047025] ... version: 2 [ 0.048014] ... bit width: 48 [ 0.049012] ... generic registers: 4 [ 0.050011] ... value mask: 0000ffffffffffff [ 0.051015] ... max period: 00007fffffffffff [ 0.052016] ... fixed-purpose events: 3 [ 0.053013] ... event mask: 000000070000000f [ 0.054328] rcu: Hierarchical SRCU implementation. [ 0.056463] smp: Bringing up secondary CPUs ... [ 0.057591] x86: Booting SMP configuration: [ 0.058028] .... node #0, CPUs: #1 #2 #3 [ 0.062027] smp: Brought up 1 node, 4 CPUs [ 0.064015] smpboot: Max logical packages: 1 [ 0.065017] smpboot: Total of 4 processors activated (19199.98 BogoMIPS) [ 0.139163] node 0 deferred pages initialised in 71ms [ 0.142021] devtmpfs: initialized [ 0.143260] x86/mm: Memory block size: 128MB [ 0.147293] gcov: version magic: 0x41383552 [ 0.151314] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.156090] futex hash table entries: 1024 (order: 4, 65536 bytes, vmalloc) [ 0.160305] pinctrl core: initialized pinctrl subsystem [ 0.162184] [ 0.162973] ************************************************************* [ 0.167013] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.170026] ** ** [ 0.174014] ** IOMMU DebugFS SUPPORT HAS BEEN ENABLED IN THIS KERNEL ** [ 0.178013] ** ** [ 0.180010] ** This means that this kernel is built to expose internal ** [ 0.183010] ** IOMMU data structures, which may compromise security on ** [ 0.184008] ** your system. ** [ 0.187012] ** ** [ 0.189007] ** If you see this message and you are not debugging the ** [ 0.191013] ** kernel, report this immediately to your vendor! ** [ 0.194013] ** ** [ 0.196011] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.199012] ************************************************************* [ 0.201606] NET: Registered protocol family 16 [ 0.204436] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations [ 0.207057] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.211062] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.215049] cpuidle: using governor menu [ 0.217133] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.221439] PCI: Using configuration type 1 for base access [ 0.223145] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.232337] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.235052] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.238541] cryptd: max_cpu_qlen set to 1000 [ 0.240417] ACPI: Added _OSI(Module Device) [ 0.242016] ACPI: Added _OSI(Processor Device) [ 0.244014] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.245013] ACPI: Added _OSI(Processor Aggregator Device) [ 0.251347] ACPI: 1 ACPI AML tables successfully acquired and loaded [ 0.258091] ACPI: Interpreter enabled [ 0.260064] ACPI: PM: (supports S0 S3 S4 S5) [ 0.261012] ACPI: Using IOAPIC for interrupt routing [ 0.263194] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.267456] ACPI: Enabled 2 GPEs in block 00 to 0F [ 0.277000] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.280040] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3] [ 0.283017] acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI] [ 0.286074] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.291986] acpiphp: Slot [2] registered [ 0.293137] acpiphp: Slot [5] registered [ 0.295105] acpiphp: Slot [6] registered [ 0.297105] acpiphp: Slot [7] registered [ 0.298124] acpiphp: Slot [8] registered [ 0.300126] acpiphp: Slot [9] registered [ 0.301120] acpiphp: Slot [10] registered [ 0.303207] acpiphp: Slot [3] registered [ 0.304095] acpiphp: Slot [4] registered [ 0.305105] acpiphp: Slot [11] registered [ 0.307103] acpiphp: Slot [12] registered [ 0.308128] acpiphp: Slot [13] registered [ 0.310107] acpiphp: Slot [14] registered [ 0.312103] acpiphp: Slot [15] registered [ 0.314102] acpiphp: Slot [16] registered [ 0.316123] acpiphp: Slot [17] registered [ 0.317152] acpiphp: Slot [18] registered [ 0.319096] acpiphp: Slot [19] registered [ 0.321150] acpiphp: Slot [20] registered [ 0.322097] acpiphp: Slot [21] registered [ 0.323057] acpiphp: Slot [22] registered [ 0.325087] acpiphp: Slot [23] registered [ 0.326199] acpiphp: Slot [24] registered [ 0.329111] acpiphp: Slot [25] registered [ 0.331117] acpiphp: Slot [26] registered [ 0.333111] acpiphp: Slot [27] registered [ 0.335106] acpiphp: Slot [28] registered [ 0.336105] acpiphp: Slot [29] registered [ 0.338100] acpiphp: Slot [30] registered [ 0.340108] acpiphp: Slot [31] registered [ 0.342134] PCI host bridge to bus 0000:00 [ 0.344021] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.346021] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.349021] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.351023] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 0.354024] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] [ 0.357028] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.360090] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.361959] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.364440] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 0.374739] pci 0000:00:01.1: reg 0x20: [io 0xc320-0xc32f] [ 0.380053] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.383017] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.386018] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.390026] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.393568] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 0.396826] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 0.400057] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 0.404720] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 [ 0.410014] pci 0000:00:02.0: reg 0x10: [io 0xc300-0xc31f] [ 0.421925] pci 0000:00:02.0: reg 0x20: [mem 0xe0000000000-0xe0000003fff 64bit pref] [ 0.427014] pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 0.433865] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 [ 0.441013] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] [ 0.451015] pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] [ 0.470016] pci 0000:00:05.0: reg 0x20: [mem 0xe0000004000-0xe0000007fff 64bit pref] [ 0.488804] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 [ 0.497013] pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] [ 0.507011] pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 0.529013] pci 0000:00:06.0: reg 0x20: [mem 0xe0000008000-0xe000000bfff 64bit pref] [ 0.540704] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 [ 0.549014] pci 0000:00:07.0: reg 0x10: [io 0xc100-0xc17f] [ 0.557013] pci 0000:00:07.0: reg 0x14: [mem 0xfebc2000-0xfebc2fff] [ 0.580016] pci 0000:00:07.0: reg 0x20: [mem 0xe000000c000-0xe000000ffff 64bit pref] [ 0.592590] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 [ 0.598013] pci 0000:00:08.0: reg 0x10: [io 0xc180-0xc1ff] [ 0.606014] pci 0000:00:08.0: reg 0x14: [mem 0xfebc3000-0xfebc3fff] [ 0.622014] pci 0000:00:08.0: reg 0x20: [mem 0xe0000010000-0xe0000013fff 64bit pref] [ 0.631868] pci 0000:00:09.0: [1af4:1001] type 00 class 0x010000 [ 0.638012] pci 0000:00:09.0: reg 0x10: [io 0xc200-0xc27f] [ 0.643014] pci 0000:00:09.0: reg 0x14: [mem 0xfebc4000-0xfebc4fff] [ 0.661015] pci 0000:00:09.0: reg 0x20: [mem 0xe0000014000-0xe0000017fff 64bit pref] [ 0.672830] pci 0000:00:0a.0: [1af4:1001] type 00 class 0x010000 [ 0.681013] pci 0000:00:0a.0: reg 0x10: [io 0xc280-0xc2ff] [ 0.688977] pci 0000:00:0a.0: reg 0x14: [mem 0xfebc5000-0xfebc5fff] [ 0.708015] pci 0000:00:0a.0: reg 0x20: [mem 0xe0000018000-0xe000001bfff 64bit pref] [ 0.721661] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 [ 0.723314] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 0.725288] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 [ 0.727287] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 0.729178] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 [ 0.733144] iommu: Default domain type: Passthrough [ 0.735489] SCSI subsystem initialized [ 0.737120] ACPI: bus type USB registered [ 0.738103] usbcore: registered new interface driver usbfs [ 0.740125] usbcore: registered new interface driver hub [ 0.742068] usbcore: registered new device driver usb [ 0.744174] pps_core: LinuxPPS API ver. 1 registered [ 0.746010] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 0.749112] PTP clock support registered [ 0.751076] EDAC MC: Ver: 3.0.0 [ 0.754159] PCI: Using ACPI for IRQ routing [ 0.755452] NetLabel: Initializing [ 0.756000] NetLabel: domain hash size = 128 [ 0.758010] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 0.760087] NetLabel: unlabeled traffic allowed by default [ 0.762132] vgaarb: loaded [ 0.763360] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 0.766017] hpet0: 3 comparators, 64-bit 100.000000 MHz counter [ 0.773000] clocksource: Switched to clocksource kvm-clock [ 0.882568] VFS: Disk quotas dquot_6.6.0 [ 0.884102] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 0.886712] *** VALIDATE ramfs *** [ 0.888158] *** VALIDATE hugetlbfs *** [ 0.889794] pnp: PnP ACPI init [ 0.892064] pnp: PnP ACPI: found 6 devices [ 0.926809] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 0.930273] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 0.932790] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 0.935168] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 0.937860] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 0.940453] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] [ 0.943515] NET: Registered protocol family 2 [ 0.946320] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, vmalloc) [ 0.951606] tcp_listen_portaddr_hash hash table entries: 4096 (order: 5, 163840 bytes, vmalloc) [ 0.955102] TCP established hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.960394] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc) [ 0.963151] TCP: Hash tables configured (established 65536 bind 65536) [ 0.966370] MPTCP token hash table entries: 8192 (order: 6, 393216 bytes, vmalloc) [ 0.969778] UDP hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.973176] UDP-Lite hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.975587] NET: Registered protocol family 1 [ 0.978193] RPC: Registered named UNIX socket transport module. [ 0.980193] RPC: Registered udp transport module. [ 0.981841] RPC: Registered tcp transport module. [ 0.982899] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 0.985826] NET: Registered protocol family 44 [ 0.987423] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 0.989344] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 0.991659] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 0.994203] PCI: CLS 0 bytes, default 64 [ 0.995468] Unpacking initramfs... [ 2.388851] debug: unmapping init [mem 0xffff8be1bcc54000-0xffff8be1bffbffff] [ 2.393219] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 2.395772] software IO TLB: mapped [mem 0x00000000a8000000-0x00000000ac000000] (64MB) [ 2.398295] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 2.878735] Initialise system trusted keyrings [ 2.880527] Key type blacklist registered [ 2.882739] workingset: timestamp_bits=36 max_order=20 bucket_order=0 [ 2.895058] zbud: loaded [ 2.899266] *** VALIDATE nfs *** [ 2.900664] *** VALIDATE nfs4 *** [ 2.902646] pstore: using deflate compression [ 2.909386] Platform Keyring initialized [ 3.013960] NET: Registered protocol family 38 [ 3.015325] Key type asymmetric registered [ 3.016850] Asymmetric key parser 'x509' registered [ 3.018743] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 3.021968] io scheduler mq-deadline registered [ 3.024258] io scheduler kyber registered [ 3.026378] io scheduler bfq registered [ 3.031445] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 3.035206] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.038484] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 3.042118] ACPI: Power Button [PWRF] [ 3.048238] ACPI: \_SB_.LNKB: Enabled at IRQ 10 [ 3.055386] ACPI: \_SB_.LNKA: Enabled at IRQ 11 [ 3.077102] ACPI: \_SB_.LNKC: Enabled at IRQ 11 [ 3.096293] ACPI: \_SB_.LNKD: Enabled at IRQ 10 [ 3.120047] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 3.148509] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.176594] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.181865] Non-volatile memory driver v1.3 [ 3.184261] Linux agpgart interface v0.103 [ 3.214810] virtio_blk virtio1: [vda] 145960 512-byte logical blocks (74.7 MB/71.3 MiB) [ 3.218071] vda: detected capacity change from 0 to 74731520 [ 3.235860] virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) [ 3.239568] vdb: detected capacity change from 0 to 1073741824 [ 3.255885] virtio_blk virtio3: [vdc] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 3.258474] vdc: detected capacity change from 0 to 2621440000 [ 3.273451] virtio_blk virtio4: [vdd] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 3.276744] vdd: detected capacity change from 0 to 2621440000 [ 3.291040] virtio_blk virtio5: [vde] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 3.293764] vde: detected capacity change from 0 to 4294967296 [ 3.308941] virtio_blk virtio6: [vdf] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 3.312080] vdf: detected capacity change from 0 to 4294967296 [ 3.318079] libphy: Fixed MDIO Bus: probed [ 3.323152] usbcore: registered new interface driver usbserial_generic [ 3.325412] usbserial: USB Serial support registered for generic [ 3.327563] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 3.331427] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 3.332936] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 3.335132] mousedev: PS/2 mouse device common for all mice [ 3.340447] rtc_cmos 00:05: RTC can wake from S4 [ 3.342286] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 3.346604] rtc_cmos 00:05: registered as rtc0 [ 3.349016] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 3.351435] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 [ 3.352294] intel_pstate: CPU model not supported [ 3.357928] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 [ 3.361624] hid: raw HID events driver (C) Jiri Kosina [ 3.363916] usbcore: registered new interface driver usbhid [ 3.366036] usbhid: USB HID core driver [ 3.367418] drop_monitor: Initializing network drop monitor service [ 3.369107] Initializing XFRM netlink socket [ 3.370796] NET: Registered protocol family 10 [ 3.373500] Segment Routing with IPv6 [ 3.375073] NET: Registered protocol family 17 [ 3.377036] mpls_gso: MPLS GSO support [ 3.382196] RAS: Correctable Errors collector initialized. [ 3.384438] AVX version of gcm_enc/dec engaged. [ 3.386376] AES CTR mode by8 optimization enabled [ 3.464052] sched_clock: Marking stable (3464017675, 0)->(4341228687, -877211012) [ 3.467660] registered taskstats version 1 [ 3.469434] Loading compiled-in X.509 certificates [ 3.471721] zswap: loaded using pool lzo/zbud [ 3.494057] Key type big_key registered [ 3.505565] Key type encrypted registered [ 3.507032] ima: No TPM chip found, activating TPM-bypass! [ 3.508734] ima: Allocated hash algorithm: sha1 [ 3.510518] ima: No architecture policies found [ 3.512450] evm: Initialising EVM extended attributes: [ 3.514696] evm: security.selinux [ 3.516008] evm: security.ima [ 3.516921] evm: security.capability [ 3.518115] evm: HMAC attrs: 0x1 [ 3.520884] rtc_cmos 00:05: setting system clock to 2026-09-08 21:30:26 UTC (1788903026) [ 3.526148] debug: unmapping init [mem 0xffffffffb5a03000-0xffffffffb5bfffff] [ 3.529302] debug: unmapping init [mem 0xffffffffb4782000-0xffffffffb4a58fff] [ 3.542065] Write protecting the kernel read-only data: 28672k [ 3.545593] debug: unmapping init [mem 0xffffffffb2e03000-0xffffffffb2ffffff] [ 3.548497] debug: unmapping init [mem 0xffffffffb3714000-0xffffffffb37fffff] [ 3.582129] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 3.589555] systemd[1]: Detected virtualization kvm. [ 3.590870] systemd[1]: Detected architecture x86-64. [ 3.592175] systemd[1]: Running in initial RAM disk. Welcome to Rocky Linux 8.10 (Green Obsidian) dracut-049-233.git20240115.el8 (Initramfs)! [ 3.616654] systemd[1]: No hostname configured. [ 3.617585] systemd[1]: Set hostname to . [ 3.618945] random: systemd: uninitialized urandom read (16 bytes read) [ 3.620572] systemd[1]: Initializing machine ID from random generator. [ 3.659750] random: ln: uninitialized urandom read (6 bytes read) [ 3.751561] random: systemd: uninitialized urandom read (16 bytes read) [ 3.754937] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 3.760188] systemd[1]: Reached target Local File Systems. [ OK ] Reached target Local File Systems. [ 3.764884] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket. Starting Create Volatile Files and Directories... Starting Journal Service... Starting Create list of required st…ce nodes for the current kernel... Starting Setup Virtual Console... [ OK ] Reached target Swap. [ OK ] Reached target Slices. [ OK ] Reached target Timers. [ OK ] Started Memstrack Anylazing Service. [ OK ] Reached target Initrd Root Device. [ OK ] Listening on udev Kernel Socket. [ OK ] Reached target Sockets. Starting Apply Kernel Variables... [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Paths. [ OK ] Started Create Volatile Files and Directories. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Setup Virtual Console. [ OK ] Started Apply Kernel Variables. Starting dracut cmdline hook... Starting Create Static Device Nodes in /dev... [ OK ] Started Journal Service. [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ 4.373339] device-mapper: uevent: version 1.0.3 [ 4.375770] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting dracut pre-trigger hook... [ OK ] Started dracut pre-trigger hook. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. [ OK ] Reached target System Initialization. [ OK ] Reached target Basic System. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. Starting dracut initqueue hook... [ 5.148330] virtio_net virtio0 ens2: renamed from eth0 [ 5.151200] random: fast init done [ 5.229532] scsi host0: ata_piix [ 5.273621] scsi host1: ata_piix [ 5.275264] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc320 irq 14 [ 5.278403] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc328 irq 15 [ 9.613335] dracut-initqueue[588]: RTNETLINK answers: File exists [ 10.027652] random: crng init done [ 10.028793] random: 7 urandom warning(s) missed due to ratelimiting Starting nbd nbd0... [ OK ] Started nbd nbd0. [ OK ] Started dracut initqueue hook. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Mounting /sysroot... [ 10.415603] EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Timers. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped dracut initqueue hook. Stopping Hardware RNG Entropy Gatherer Daemon... [ OK ] Stopped Hardware RNG Entropy Gatherer Daemon. [ OK ] Stopped target Basic System. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Swap. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped dracut pre-trigger hook. Stopping udev Kernel Device Manager... [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped target Local Encrypted Volumes. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Slices. [ OK ] Stopped target Paths. [ OK ] Stopped Dispatch Password Requests to Console Directory Watch. [ OK ] Stopped target Sockets. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Closed udev Kernel Socket. [ OK ] Closed udev Control Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Reached target Switch Root. Starting Switch Root... [ 11.504337] printk: systemd: 25 output lines suppressed due to ratelimiting [ 11.759565] SELinux: Disabled at runtime. [ 11.818764] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 11.827552] systemd[1]: Detected virtualization kvm. [ 11.829512] systemd[1]: Detected architecture x86-64. Welcome to Rocky Linux 8.10 (Green Obsidian)! [ 12.282053] systemd[1]: initrd-switch-root.service: Succeeded. [ 12.285473] systemd[1]: Stopped Switch Root. [ OK ] Stopped Switch Root. [ 12.290436] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. [ 12.297545] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 12.301313] systemd[1]: Stopped Journal Service. [ OK ] Stopped Journal Service. [ 12.311549] systemd[1]: Starting Journal Service... Starting Journal Service... [ 12.317318] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ OK ] Started Forward Password Requests to Wall Directory Watch. Mounting Kernel Debug File System... [ OK ] Listening on initctl Compatibility Named Pipe. Starting Remount Root and Kernel File Systems... [ OK ] Listening on udev Control Socket. Starting Create list of required st…ce nodes for the current kernel... Starting udev Coldplug all Devices... [ OK ] Created slice User and Session Slice. [ OK ] Listening on RPCbind Server Activation Socket. Activating swap /dev/disk/by-label/SWAP... Mounting POSIX Message Queue File System... [ 12.415418] Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS [ OK ] Listening on Process Core Dump Socket. [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Reached target Paths. [ OK ] Created slice system-getty.slice. [FAILED] Failed to set up automount Arbitrar…rmats File System Automount Point. See 'systemctl status proc-sys-fs-binfmt_misc.automount' for details. [ OK ] Reached target rpc_pipefs.target. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Slices. [ OK ] Created slice system-sshd\x2dkeygen.slice. [ OK ] Reached target RPC Port Mapper. [ OK ] Created slice system-serial\x2dgetty.slice. Mounting Huge Pages File System... Starting Apply Kernel Variables... [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd Root File System. [ OK ] Stopped target Initrd File Systems. [ OK ] Started Journal Service. [ OK ] Mounted Kernel Debug File System. [FAILED] Failed to start Remount Root and Kernel File Systems. See 'systemctl status systemd-remount-fs.service' for details. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Activated swap /dev/disk/by-label/SWAP. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted Huge Pages File System. [ OK ] Started Apply Kernel Variables. [ OK ] Reached target Swap. Starting Configure read-only root support... Starting Create Static Device Nodes in /dev... Starting Flush Journal to Persistent Storage... [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started Create Static Device Nodes in /dev. Starting udev Kernel Device Manager... [ OK ] Reached target Local File Systems (Pre). Mounting /mnt... Mounting /home/green/git/lustre-release... [ OK ] Started udev Coldplug all Devices. [ OK ] Mounted /mnt. [ 12.729286] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ OK ] Mounted /home/green/git/lustre-release. [ OK ] Started udev Kernel Device Manager. [ 12.965609] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 13.079866] input: PC Speaker as /devices/platform/pcspkr/input/input5 [ 13.136139] RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer [ 13.154476] EDAC sbridge: Ver: 1.1.2 [ 14.853855] Key type dns_resolver registered [ 15.146367] NFS: Registering the id_resolver key type [ 15.148312] Key type id_resolver registered [ 15.149453] Key type id_legacy registered [ OK ] Started Configure read-only root support. Starting Load/Save Random Seed... [ OK ] Reached target Local File Systems. Starting Mark the need to relabel after reboot... Starting Rebuild Dynamic Linker Cache... Starting Create Volatile Files and Directories... [ OK ] Started Load/Save Random Seed. [ OK ] Started Mark the need to relabel after reboot. [ OK ] Started Create Volatile Files and Directories. Starting RPC Bind... Starting Update UTMP about System Boot/Shutdown... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Started RPC Bind. [ OK ] Started Rebuild Dynamic Linker Cache. Starting Update is Completed... [ OK ] Started Update is Completed. [ OK ] Reached target System Initialization. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Reached target Sockets. [ OK ] Started dnf makecache --timer. [ OK ] Reached target Basic System. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. Starting Login Service... Starting Restore /run/initramfs on shutdown... [ OK ] Started D-Bus System Message Bus. Starting Network Manager... [ OK ] Reached target sshd-keygen.target. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Reached target Timers. [ OK ] Started irqbalance daemon. [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Login Service. [ OK ] Started Network Manager. Starting Network Manager Wait Online... [ OK ] Reached target Network. Starting OpenSSH server daemon... Starting GSSAPI Proxy Daemon... Starting Dynamic System Tuning Daemon... Starting Hostname Service... [ OK ] Started OpenSSH server daemon. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Started Permit User Sessions. [ OK ] Started Command Scheduler. [ OK ] Started Getty on tty1. [ OK ] Started Serial Getty on ttyS0. [ OK ] Started Serial Getty on ttyS1. [ OK ] Reached target Login Prompts. [ OK ] Started Hostname Service. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting System Logging Service... Starting Notify NFS peers of a restart... Starting Crash recovery kernel arming... [ OK ] Started Notify NFS peers of a restart. [ OK ] Started System Logging Service. Starting Authorization Manager... [ OK ] Started Authorization Manager. [ OK ] Started Dynamic System Tuning Daemon. [ OK ] Reached target Multi-User System. [ OK ] Reached target Graphical Interface. Starting Update UTMP about System Runlevel Changes... [ OK ] Started Update UTMP about System Runlevel Changes. Rocky Linux 8.10 (Green Obsidian) Kernel 4.18.0rh8.10-debug on an x86_64 oleg343-server login: [ 55.718401] libcfs: loading out-of-tree module taints kernel. [ 55.779793] Key type ._llcrypt registered [ 55.782484] Key type .llcrypt registered [ 55.857730] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_hostid [ 73.631075] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 75.309956] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 75.340661] alg: No test for adler32 (adler32-zlib) [ 76.727030] hrtimer: interrupt took 6022660 ns [ 76.843555] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 77.632691] LNet: Added LNI 192.168.203.143@tcp [8/256/0/180] [ 79.377913] Key type lgssc registered [ 81.086962] Lustre: Echo OBD driver; http://www.lustre.org/ [ 99.181636] ZFS: Loaded module v2.3.2-1, ZFS pool version 5000, ZFS filesystem version 5 [ 141.621162] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 154.768869] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 154.823135] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 156.054669] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 156.077486] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 156.145141] Lustre: lustre-MDT0000: new disk, initializing [ 156.220585] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 156.255378] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 160.501787] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 174.211724] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 174.312181] Lustre: 6522:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 174.416386] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 174.422327] Lustre: Skipped 1 previous similar message [ 174.547241] Lustre: lustre-MDT0001: new disk, initializing [ 174.607642] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 174.632059] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 174.650814] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 178.832438] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 183.443393] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 192.663445] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 193.065847] Lustre: lustre-OST0000: new disk, initializing [ 193.069631] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 193.081064] Lustre: 8460:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 193.206531] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 199.344323] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 201.752983] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 201.770526] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 201.878539] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 213.299140] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 213.442721] Lustre: lustre-OST0001: new disk, initializing [ 213.447319] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 213.452571] Lustre: 9533:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 213.545459] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 219.193933] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 220.183403] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 220.192140] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 220.305031] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 230.894540] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 241.444038] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 247.147873] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing check_logdir /tmp/testlogs/ [ 253.140620] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing yml_node [ 261.142565] Lustre: DEBUG MARKER: Client: 2.17.55.26 [ 264.151983] Lustre: DEBUG MARKER: MDS: 2.17.55.26 [ 268.750333] Lustre: DEBUG MARKER: OSS: 2.17.55.26 [ 271.147198] Lustre: DEBUG MARKER: -----============= acceptance-small: conf-sanity ============----- Tue Sep 8 17:34:52 EDT 2026 [ 289.657900] Lustre: DEBUG MARKER: excepting tests: 102 106 115 32newtarball [ 291.590295] Lustre: DEBUG MARKER: skipping tests SLOW=no: 45 69 106 111 114 [ 307.168959] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 307.170083] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 307.190953] Lustre: Skipped 1 previous similar message [ 307.201494] Lustre: Skipped 3 previous similar messages [ 312.300164] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 312.307306] Lustre: Skipped 3 previous similar messages [ 313.167909] Lustre: server umount lustre-MDT0000 complete [ 317.130601] LustreError: 9532:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788903340 with bad export cookie 14181915815811317769 [ 317.137381] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 317.144903] LustreError: 9532:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 317.421329] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 317.434891] Lustre: Skipped 2 previous similar messages [ 317.445490] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 317.457782] Lustre: Skipped 1 previous similar message [ 322.528551] LustreError: 6529:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 322.529769] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 322.548825] LustreError: 6529:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 4 previous similar messages [ 322.556794] Lustre: Skipped 1 previous similar message [ 323.609123] Lustre: server umount lustre-MDT0001 complete [ 327.735831] Lustre: server umount lustre-OST0000 complete [ 332.132341] Lustre: server umount lustre-OST0001 complete [ 340.198734] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_hostid [ 353.093916] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 388.997272] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 389.184212] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 389.209554] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 389.262799] Lustre: lustre-MDT0000: new disk, initializing [ 389.321438] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 389.343668] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 392.729727] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 401.074025] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 401.175328] Lustre: 15082:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 401.229542] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 401.232605] Lustre: Skipped 1 previous similar message [ 401.273151] Lustre: lustre-MDT0001: new disk, initializing [ 401.366299] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 401.390060] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 401.402296] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 404.357913] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 410.911439] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 414.548516] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 418.954024] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 419.169261] Lustre: lustre-OST0000: new disk, initializing [ 419.172446] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 419.177556] Lustre: 17053:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 419.243284] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 420.889486] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 420.895408] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 420.999992] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 423.510623] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 430.884196] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 434.371855] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 434.574580] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 437.746508] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 437.911159] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 441.314113] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 441.314820] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 441.330655] LustreError: Skipped 1 previous similar message [ 441.333352] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 441.348323] Lustre: Skipped 2 previous similar messages [ 441.363910] Lustre: Skipped 1 previous similar message [ 445.476016] Lustre: server umount lustre-OST0000 complete [ 451.557839] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 451.559691] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 451.573063] Lustre: Skipped 1 previous similar message [ 451.585783] Lustre: Skipped 1 previous similar message [ 462.303125] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 462.460430] Lustre: server umount lustre-MDT0000 complete [ 465.096581] LustreError: 15077:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788903488 with bad export cookie 14181915815811319302 [ 465.107030] LustreError: 15077:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 465.112285] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 465.374260] Lustre: server umount lustre-MDT0001 complete [ 469.108987] Lustre: DEBUG MARKER: == conf-sanity test 76a: set permanent params with lctl across mounts ========================================================== 17:38:11 (1788903491) [ 473.958153] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 474.245426] LustreError: 19316:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 474.305761] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 476.996594] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 479.712896] LustreError: 19317:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 483.217030] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 486.685747] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 491.704890] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 495.089414] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 499.336261] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 503.115891] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 508.089653] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 514.190878] Lustre: Modifying parameter general.osc.*.max_dirty_mb=452 in log params [ 519.143122] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 519.146911] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 519.153333] Lustre: Skipped 2 previous similar messages [ 519.162305] Lustre: Skipped 5 previous similar messages [ 521.131087] Lustre: server umount lustre-MDT0000 complete [ 523.779743] LustreError: 21843:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788903546 with bad export cookie 14181915815811320184 [ 523.782704] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 523.786267] LustreError: 21843:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 523.965474] Lustre: server umount lustre-MDT0001 complete [ 537.155548] Lustre: server umount lustre-OST0000 complete [ 550.224331] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 556.769481] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 557.101389] LustreError: 23690:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 557.163661] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 557.171151] Lustre: Skipped 2 previous similar messages [ 560.071762] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 562.658344] LustreError: 23691:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 565.902440] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 569.824611] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 571.973325] Lustre: Setting parameter general.debug_raw_pointers=Y in log params [ 576.753280] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 580.908259] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 586.430462] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 586.536628] Lustre: lustre-OST0001: new disk, initializing [ 586.538677] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 586.542429] Lustre: 26005:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 588.313265] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 588.321771] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 588.392348] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 590.489335] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 597.679915] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 600.124651] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 611.811655] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 611.819813] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 611.827029] Lustre: Skipped 3 previous similar messages [ 611.832955] Lustre: Skipped 2 previous similar messages [ 614.318202] Lustre: server umount lustre-MDT0000 complete [ 616.717180] LustreError: 26004:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788903639 with bad export cookie 14181915815811321031 [ 616.718440] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 616.725462] LustreError: 26004:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 616.926449] Lustre: server umount lustre-MDT0001 complete [ 629.761929] Lustre: server umount lustre-OST0000 complete [ 632.270585] Lustre: 3653:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788903639/real 1788903639] req@ffff8be101f3ca80 x1875800857214464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788903655 ref 1 fl Rpc:EXNQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 642.636852] Lustre: server umount lustre-OST0001 complete [ 654.102551] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 661.019688] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 661.282694] LustreError: 29021:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 664.094054] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 668.712095] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 671.314861] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 672.941612] Lustre: 30169:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 676.622437] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 678.885482] LustreError: 30722:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 678.900571] LustreError: 30722:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 680.203628] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 685.090285] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 685.252442] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 685.257376] Lustre: Skipped 6 previous similar messages [ 688.631397] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 693.226537] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 695.533151] Lustre: 32047:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 699.872309] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 699.879226] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 699.887337] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 705.646775] Lustre: server umount lustre-MDT0000 complete [ 708.167205] LustreError: 32049:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788903731 with bad export cookie 14181915815811322326 [ 708.174305] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 708.180133] LustreError: 32049:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 708.431350] Lustre: server umount lustre-MDT0001 complete [ 721.421413] Lustre: server umount lustre-OST0000 complete [ 733.194705] Lustre: server umount lustre-OST0001 complete [ 739.403397] Lustre: DEBUG MARKER: == conf-sanity test 76b: verify params log setup correctly ========================================================== 17:42:41 (1788903761) [ 758.869642] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 765.858439] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 766.117598] LustreError: 34847:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 766.128039] LustreError: 34847:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 5 previous similar messages [ 768.946259] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 774.830131] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 777.996261] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 779.791657] Lustre: 35996:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 784.284850] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 788.606916] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 794.425271] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 799.148650] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 804.302875] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 806.249789] Lustre: 37873:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 809.956418] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 809.961997] Lustre: Skipped 6 previous similar messages [ 814.712988] Lustre: server umount lustre-MDT0000 complete [ 816.610232] LustreError: 34829:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788903839 with bad export cookie 14181915815811323425 [ 816.612943] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 816.614579] LustreError: 34829:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 816.777517] Lustre: server umount lustre-MDT0001 complete [ 829.470295] Lustre: server umount lustre-OST0000 complete [ 841.989552] Lustre: server umount lustre-OST0001 complete [ 846.342904] Lustre: DEBUG MARKER: == conf-sanity test 76c: verify changelog_mask is applied with lctl set_param -P ========================================================== 17:44:28 (1788903868) [ 853.577553] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 858.269069] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 858.472587] LustreError: 40010:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 858.484277] LustreError: 40010:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 9 previous similar messages [ 860.369106] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 864.791846] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 866.921825] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 868.531419] Lustre: 41157:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 871.892051] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 874.990569] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 879.048866] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 881.997401] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 891.398250] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 893.641591] Lustre: Setting parameter general.mdd.*.changelog_mask=-CLOSE in log params [ 893.644629] Lustre: Skipped 1 previous similar message [ 895.975562] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 895.987914] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 896.001074] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 896.005631] Lustre: Skipped 8 previous similar messages [ 901.237871] Lustre: server umount lustre-MDT0000 complete [ 902.949418] LustreError: 42345:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788903925 with bad export cookie 14181915815811324531 [ 902.956262] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 902.957078] LustreError: 42345:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 909.134410] Lustre: server umount lustre-MDT0001 complete [ 913.638990] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 927.714847] Lustre: Evicted from MGS (at 0@lo) after server handle changed from 0x0 to 0xc4d0494ba3ed9eda [ 927.726350] Lustre: MGC192.168.203.143@tcp: Connection restored to 0@lo (at 0@lo) [ 930.337815] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 934.795619] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 936.947361] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 937.066260] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 940.644438] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 941.443545] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 944.135373] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 944.952118] Lustre: DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec [ 953.213412] Lustre: server umount lustre-MDT0000 complete [ 955.040634] LustreError: 39991:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788903978 with bad export cookie 14181915815811325658 [ 955.046236] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 955.046720] LustreError: 39991:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 955.200504] Lustre: server umount lustre-MDT0001 complete [ 967.124982] Lustre: server umount lustre-OST0000 complete [ 978.155439] Lustre: server umount lustre-OST0001 complete [ 982.572527] Lustre: DEBUG MARKER: == conf-sanity test 76d: verify llite.*.xattr_cache can be set by 'lctl set_param -P' correctly ========================================================== 17:46:44 (1788904004) [ 991.481126] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 996.105074] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 996.291315] LustreError: 47641:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 996.302653] LustreError: 47641:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 13 previous similar messages [ 996.321755] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 996.324958] Lustre: Skipped 10 previous similar messages [ 998.191278] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 1002.271751] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1004.394412] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 1005.808864] Lustre: 48792:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 1005.814277] Lustre: 48792:0:(mgs_llog.c:1450:mgs_modify_param()) Skipped 1 previous similar message [ 1009.313623] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1012.519221] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 1017.071774] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1020.349434] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 1024.840076] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1027.378978] Lustre: Setting parameter general.llite.*.xattr_cache=0 in log params [ 1036.771537] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1036.781846] Lustre: Skipped 12 previous similar messages [ 1039.962368] Lustre: server umount lustre-MDT0000 complete [ 1041.826315] LustreError: 50782:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788904064 with bad export cookie 14181915815811326456 [ 1041.827086] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1041.833837] LustreError: 50782:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 1041.997318] Lustre: server umount lustre-MDT0001 complete [ 1050.081271] Lustre: server umount lustre-OST0000 complete [ 1052.098385] Lustre: server umount lustre-OST0001 complete [ 1057.123894] Lustre: DEBUG MARKER: == conf-sanity test 77: comma-separated MGS NIDs and failover node NIDs ========================================================== 17:47:59 (1788904079) [ 1058.401828] Lustre: DEBUG MARKER: SKIP: conf-sanity test_77 mixed loopback and real device not working [ 1059.300699] Lustre: DEBUG MARKER: == conf-sanity test 78: run resize2fs on MDT and OST filesystems ========================================================== 17:48:01 (1788904081) [ 1065.075034] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_hostid [ 1069.602626] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 1081.338735] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1081.458907] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1081.502213] Lustre: lustre-MDT0000: new disk, initializing [ 1081.556051] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1083.650348] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 1088.388925] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1091.774931] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1091.927819] Lustre: 54856:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1093.035446] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 1093.058462] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 1095.122683] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 1100.432796] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1101.647142] Lustre: DEBUG MARKER: create test files [ 1118.693978] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1123.228073] Lustre: server umount lustre-OST0000 complete [ 1125.097474] Lustre: server umount lustre-MDT0000 complete [ 1130.749865] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing unload_modules_local [ 1132.816258] Key type lgssc unregistered [ 1133.029683] LNet: 56481:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1133.037746] LNetError: 56481:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1133.054972] LNet: Removed LNI 192.168.203.143@tcp [ 1133.734176] Key type .llcrypt unregistered [ 1133.736451] Key type ._llcrypt unregistered [ 1160.362157] Key type ._llcrypt registered [ 1160.366418] Key type .llcrypt registered [ 1160.531658] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 1162.086229] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1162.109650] alg: No test for adler32 (adler32-zlib) [ 1163.405983] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 1163.932955] LNet: Added LNI 192.168.203.143@tcp [8/256/0/180] [ 1165.615251] Key type lgssc registered [ 1166.579796] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1173.978647] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1173.998439] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1175.290180] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1178.793592] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 1184.084679] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1188.283469] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1188.480937] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1192.235762] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 1197.986568] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1200.758160] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:96 to 0x240000400:129) [ 1200.857339] Lustre: 59214:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 510 < left 544, rollback = 9 [ 1200.861634] Lustre: 59214:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 32/128/5, destroy: 0/0/0 [ 1200.865586] Lustre: 59214:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 1200.870762] Lustre: 59214:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/18/1, punch: 0/0/0, quota 1/3/0 [ 1200.877682] Lustre: 59214:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 1200.883370] Lustre: 59214:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 1211.750304] Lustre: DEBUG MARKER: check files after expanding the MDT and OST filesystems [ 1219.780585] Lustre: DEBUG MARKER: create more files after expanding the MDT and OST filesystems [ 1231.844763] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1231.887124] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1234.971688] Lustre: server umount lustre-OST0000 complete [ 1240.790592] Lustre: server umount lustre-MDT0000 complete [ 1254.941317] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing unload_modules_local [ 1257.860597] Key type lgssc unregistered [ 1258.300701] LNet: 60850:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1258.308515] LNetError: 60850:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1258.349150] LNet: Removed LNI 192.168.203.143@tcp [ 1259.354104] Key type .llcrypt unregistered [ 1259.358910] Key type ._llcrypt unregistered [ 1290.578696] Key type ._llcrypt registered [ 1290.581372] Key type .llcrypt registered [ 1290.684526] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 1291.662450] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1291.743594] alg: No test for adler32 (adler32-zlib) [ 1292.793297] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 1293.155689] LNet: Added LNI 192.168.203.143@tcp [8/256/0/180] [ 1294.855207] Key type lgssc registered [ 1296.004488] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1303.766103] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1303.788119] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1305.141329] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1309.555856] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 1316.356705] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1323.446630] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1323.757978] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1329.449100] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 1330.942474] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:140 to 0x240000400:161) [ 1331.055135] Lustre: 63689:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 509 < left 544, rollback = 9 [ 1331.071572] Lustre: 63689:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 32/128/6, destroy: 0/0/0 [ 1331.084068] Lustre: 63689:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 1331.094607] Lustre: 63689:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/18/1, punch: 0/0/0, quota 1/3/0 [ 1331.102378] Lustre: 63689:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 1331.111154] Lustre: 63689:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 1336.626805] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1342.649927] Lustre: DEBUG MARKER: check files after shrinking the MDT and OST filesystems [ 1382.372031] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1382.382150] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1382.398879] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1386.751608] Lustre: server umount lustre-OST0000 complete [ 1390.369933] Lustre: server umount lustre-MDT0000 complete [ 1400.441930] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing unload_modules_local [ 1403.132979] Key type lgssc unregistered [ 1403.458672] LNet: 65270:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1403.472244] LNetError: 65270:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1403.502576] LNet: Removed LNI 192.168.203.143@tcp [ 1404.292399] Key type .llcrypt unregistered [ 1404.294519] Key type ._llcrypt unregistered [ 1422.232303] Key type ._llcrypt registered [ 1422.236153] Key type .llcrypt registered [ 1422.372534] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_hostid [ 1437.027185] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 1438.040929] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1438.116739] alg: No test for adler32 (adler32-zlib) [ 1439.209497] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 1439.435075] LNet: Added LNI 192.168.203.143@tcp [8/256/0/180] [ 1441.095383] Key type lgssc registered [ 1442.000255] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1477.358200] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1477.383738] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1478.683767] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1478.720226] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1478.826337] Lustre: lustre-MDT0000: new disk, initializing [ 1478.938589] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1478.968623] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1483.252617] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 1494.319849] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1494.513707] Lustre: 68425:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1494.599031] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 1494.605096] Lustre: Skipped 1 previous similar message [ 1494.689802] Lustre: lustre-MDT0001: new disk, initializing [ 1494.784238] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1494.824851] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 1494.837263] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1499.377497] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 1509.259747] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1515.759172] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 1522.791139] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1523.049941] Lustre: lustre-OST0000: new disk, initializing [ 1523.053217] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1523.061711] Lustre: 70394:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1523.133345] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1528.906467] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 1528.933498] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1529.092392] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1530.710542] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 1541.766796] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1547.293822] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1547.550913] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1552.449665] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1552.753952] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1554.914708] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1554.917736] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1554.923675] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1554.935464] Lustre: Skipped 1 previous similar message [ 1560.041216] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1560.047202] Lustre: Skipped 2 previous similar messages [ 1565.156859] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1565.180932] Lustre: Skipped 1 previous similar message [ 1569.247583] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 1569.406880] Lustre: server umount lustre-OST0000 complete [ 1575.393717] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1575.407274] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1575.412810] Lustre: Skipped 1 previous similar message [ 1575.430034] Lustre: Skipped 1 previous similar message [ 1578.842525] Lustre: server umount lustre-MDT0000 complete [ 1582.982793] LustreError: 68461:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788904605 with bad export cookie 12870510226537723638 [ 1582.989790] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1582.992023] LustreError: 68461:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 1583.260828] Lustre: server umount lustre-MDT0001 complete [ 1593.345948] Lustre: DEBUG MARKER: == conf-sanity test 79: format MDT/OST without mgs option (should return errors) ========================================================== 17:56:54 (1788904614) [ 1605.330577] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 1654.134916] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_hostid [ 1663.847767] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 1707.516479] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1707.765797] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1707.823596] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1707.974290] Lustre: lustre-MDT0000: new disk, initializing [ 1708.118219] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1708.151265] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1712.251658] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 1721.376072] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1721.496759] Lustre: 76416:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1721.550534] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 1721.555531] Lustre: Skipped 1 previous similar message [ 1721.635784] Lustre: lustre-MDT0001: new disk, initializing [ 1721.723109] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1721.751993] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 1721.770173] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1725.825933] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 1734.106169] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1738.519787] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 1743.998738] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1744.241888] Lustre: lustre-OST0000: new disk, initializing [ 1744.244867] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1744.249938] Lustre: 78383:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1744.325891] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1749.622632] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 1752.656331] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 1752.678991] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1752.784824] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1757.762524] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1761.848593] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1762.025205] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1766.018346] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1766.255843] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1768.419821] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1768.421181] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1768.427838] LustreError: Skipped 2 previous similar messages [ 1768.430784] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1768.439399] Lustre: Skipped 1 previous similar message [ 1778.659344] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1778.664982] Lustre: Skipped 4 previous similar messages [ 1782.239144] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 1782.345296] Lustre: server umount lustre-OST0000 complete [ 1788.384322] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1788.396485] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1799.135207] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 1799.137412] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1799.151733] Lustre: Skipped 5 previous similar messages [ 1799.257418] Lustre: server umount lustre-MDT0000 complete [ 1802.342517] LustreError: 79724:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788904825 with bad export cookie 12870510226537724513 [ 1802.349657] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1802.360546] LustreError: 79724:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 1802.680835] Lustre: server umount lustre-MDT0001 complete [ 1809.610514] Lustre: DEBUG MARKER: == conf-sanity test 80: mgc import reconnect race ======== 18:00:31 (1788904831) [ 1814.612633] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1814.978294] LustreError: 80798:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1814.988793] LustreError: 80798:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [ 1815.029305] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1818.661631] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 1820.129277] LustreError: 80799:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1820.154290] LustreError: 80799:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 1824.243327] LustreError: 80798:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1825.681280] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1829.798618] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 1835.959113] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1840.853782] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 1846.137462] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1851.785631] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 1857.575478] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1860.158869] Lustre: 83483:0:(genops.c:1803:obd_export_evict_by_uuid()) MGS: evicting 83a040a6-dae0-471e-8b89-f7a5c338c535 at adminstrative request [ 1865.188672] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1865.201272] Lustre: *** cfs_fail_loc=906, val=2147483648*** [ 1875.430830] Lustre: MGS: Client 83a040a6-dae0-471e-8b89-f7a5c338c535 (at 0@lo) reconnecting [ 1875.440380] Lustre: Evicted from MGS (at 0@lo) after server handle changed from 0xb29d3cdc32d03dda to 0xb29d3cdc32d0407a [ 1875.450439] Lustre: MGC192.168.203.143@tcp: Connection restored to 0@lo (at 0@lo) [ 1894.945191] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1895.060693] Lustre: lustre-OST0001: new disk, initializing [ 1895.063529] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 1895.068285] Lustre: 83874:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1895.135173] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 1895.142824] Lustre: Skipped 2 previous similar messages [ 1899.860212] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 1904.701194] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 1904.710307] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 1904.800722] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 1907.162988] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1910.246820] LustreError: lustre-OST0001-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1910.250092] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1910.256406] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 1910.265690] Lustre: Skipped 2 previous similar messages [ 1911.068676] Lustre: server umount lustre-OST0001 complete [ 1915.373880] LustreError: 82633:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1915.385708] LustreError: 82633:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 1919.835477] Lustre: server umount lustre-OST0000 complete [ 1923.553187] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1923.559029] LustreError: Skipped 1 previous similar message [ 1923.564344] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1923.574538] Lustre: Skipped 2 previous similar messages [ 1928.629241] Lustre: server umount lustre-MDT0000 complete [ 1930.725215] LustreError: 80794:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1930.746355] LustreError: 80794:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 1931.629347] LustreError: 80779:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788904954 with bad export cookie 12870510226537726074 [ 1931.634487] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1931.635841] LustreError: 80779:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 1931.861252] Lustre: server umount lustre-MDT0001 complete [ 1937.731850] Lustre: DEBUG MARKER: == conf-sanity test 81: sparse OST indexing ============== 18:02:39 (1788904959) [ 1938.668404] Lustre: DEBUG MARKER: SKIP: conf-sanity test_81 needs >= 3 OSTs [ 1940.048246] Lustre: DEBUG MARKER: == conf-sanity test 82a: specify OSTs for file (succeed) or directory (succeed) ========================================================== 18:02:42 (1788904962) [ 1941.148793] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82a needs >= 3 OSTs [ 1942.385169] Lustre: DEBUG MARKER: == conf-sanity test 82b: specify OSTs for file with --pool and --ost-list options ========================================================== 18:02:44 (1788904964) [ 1943.435854] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82b needs >= 4 OSTs [ 1944.604853] Lustre: DEBUG MARKER: == conf-sanity test 82c: specify sparse OSTs for setstripe (should not crash) ========================================================== 18:02:46 (1788904966) [ 1945.675164] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82c needs >= 4 OSTs [ 1946.901874] Lustre: DEBUG MARKER: == conf-sanity test 83: ENOSPACE on OST doesn't cause message VFS: Busy inodes after unmount ... ========================================================== 18:02:49 (1788904969) [ 1947.975905] Lustre: DEBUG MARKER: mount the OST /dev/mapper/ost1_flakey as a ldiskfs filesystem [ 1951.946433] loop: module loaded [ 1951.956124] loop0: detected capacity change from 0 to 4294967296 [ 1952.005199] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 1953.175406] Lustre: DEBUG MARKER: run llverfs in partial mode on the OST ldiskfs /mnt/lustre-ost1 [ 1955.726858] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing run_llverfs /mnt/lustre-ost1 -vpl no [ 1958.441164] Lustre: DEBUG MARKER: unmount the OST /dev/mapper/ost1_flakey [ 1974.673783] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1974.706740] LustreError: 87990:0:(obd_config.c:845:class_setup()) setup lustre-OST0000-osd failed (-28) [ 1974.714044] LustreError: 87990:0:(obd_mount.c:259:lustre_start_simple()) lustre-OST0000-osd setup error -28 [ 1974.721395] LustreError: 87990:0:(tgt_mount.c:2671:server_fill_super()) Unable to start osd on /dev/mapper/ost1_flakey: -28 [ 1974.728132] LustreError: 87990:0:(super25.c:178:lustre_fill_super()) llite: Unable to mount : rc = -28 [ 1987.026600] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_hostid [ 1993.358455] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 2015.208152] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2015.368339] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2015.395364] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2015.452433] Lustre: lustre-MDT0000: new disk, initializing [ 2015.507318] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2015.526065] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2018.103794] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 2024.830479] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2024.894629] Lustre: 90853:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2025.068725] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2028.015842] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 2033.946790] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2037.765061] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2042.228282] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2042.419364] Lustre: 92821:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2046.096743] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 2051.603381] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2051.685690] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2052.291094] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2055.129987] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2055.266556] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2058.111198] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2058.228385] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2061.793737] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2061.798653] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2061.804969] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2061.813824] Lustre: Skipped 2 previous similar messages [ 2061.821509] Lustre: Skipped 7 previous similar messages [ 2065.475496] Lustre: server umount lustre-OST0000 complete [ 2082.271158] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2082.373846] Lustre: server umount lustre-MDT0000 complete [ 2084.677147] LustreError: 90843:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788905107 with bad export cookie 12870510226537726690 [ 2084.680395] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2084.686643] LustreError: 90843:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2084.857701] Lustre: server umount lustre-MDT0001 complete [ 2090.464373] Lustre: DEBUG MARKER: == conf-sanity test 84: check recovery_hard_time ========= 18:05:12 (1788905112) [ 2094.622144] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2094.876676] LustreError: 95231:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2097.438306] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 2102.097886] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2104.431150] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 2108.345500] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2111.187394] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2114.888684] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2118.294412] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 2122.106951] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2124.495380] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2124.609212] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2126.781946] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2127.923379] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 1 sec [ 2131.454541] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2131.535320] Lustre: lustre-OST0001: new disk, initializing [ 2131.537261] Lustre: Skipped 2 previous similar messages [ 2131.540467] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 2131.542811] Lustre: Skipped 3 previous similar messages [ 2131.546221] Lustre: 98605:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2134.617197] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 2140.152961] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2140.179196] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 2140.184465] Lustre: Skipped 2 previous similar messages [ 2140.188133] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 2140.236649] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 2142.387519] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid 50 [ 2142.513471] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2144.680433] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [ 2144.803561] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2157.654884] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 2168.863716] Lustre: Failing over lustre-MDT0000 [ 2169.182544] Lustre: server umount lustre-MDT0000 complete [ 2170.850457] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2170.853029] LustreError: 95227:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2170.856020] Lustre: Skipped 5 previous similar messages [ 2170.864487] LustreError: 95227:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [ 2185.520937] LDISKFS-fs (dm-0): 4 truncates cleaned up [ 2185.522771] LDISKFS-fs (dm-0): recovery complete [ 2185.526720] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2185.591400] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2185.723509] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-60 [ 2185.728286] Lustre: Skipped 6 previous similar messages [ 2185.763318] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 2187.567430] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 2188.315743] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 2188.321754] Lustre: 98613:0:(ldlm_lib.c:2084:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 2190.825626] Lustre: 95232:0:(ldlm_lib.c:2084:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 2190.832434] Lustre: 95232:0:(ldlm_lib.c:2084:extend_recovery_timer()) Skipped 1 previous similar message [ 2190.839773] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 2190.875726] LustreError: 101426:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2191.191113] LustreError: 101426:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2191.513557] LustreError: 101426:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2191.520815] LustreError: 101426:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 1 previous similar message [ 2191.839268] LustreError: 101426:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2191.843627] LustreError: 101426:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 1 previous similar message [ 2191.848267] Lustre: 101426:0:(ldlm_lib.c:2084:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2191.853600] Lustre: 101426:0:(ldlm_lib.c:2084:extend_recovery_timer()) Skipped 7 previous similar messages [ 2192.795612] LustreError: 101426:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2192.802016] LustreError: 101426:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 3 previous similar messages [ 2193.119252] LustreError: 101426:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2193.123099] LustreError: 101426:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 3 previous similar messages [ 2194.073346] Lustre: 101426:0:(ldlm_lib.c:2084:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2194.079442] Lustre: 101426:0:(ldlm_lib.c:2084:extend_recovery_timer()) Skipped 6 previous similar messages [ 2195.031857] LustreError: 101426:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2195.036455] LustreError: 101426:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 6 previous similar messages [ 2195.352601] LustreError: 101426:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2195.356517] LustreError: 101426:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 6 previous similar messages [ 2198.175981] Lustre: 101426:0:(ldlm_lib.c:2084:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2198.182055] Lustre: 101426:0:(ldlm_lib.c:2084:extend_recovery_timer()) Skipped 12 previous similar messages [ 2199.137372] LustreError: 101426:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2199.141853] LustreError: 101426:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 12 previous similar messages [ 2199.455335] LustreError: 101426:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2199.460028] LustreError: 101426:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 12 previous similar messages [ 2206.327896] Lustre: 101426:0:(ldlm_lib.c:2084:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2206.334078] Lustre: 101426:0:(ldlm_lib.c:2084:extend_recovery_timer()) Skipped 25 previous similar messages [ 2207.273650] LustreError: 101426:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2207.280466] LustreError: 101426:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 25 previous similar messages [ 2207.599102] LustreError: 101426:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2207.603115] LustreError: 101426:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 25 previous similar messages [ 2222.601753] Lustre: 101426:0:(ldlm_lib.c:2084:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2222.612019] Lustre: 101426:0:(ldlm_lib.c:2084:extend_recovery_timer()) Skipped 51 previous similar messages [ 2223.552902] LustreError: 101426:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2223.556468] LustreError: 101426:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 51 previous similar messages [ 2223.871126] LustreError: 101426:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2223.874916] LustreError: 101426:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 51 previous similar messages [ 2248.223188] Lustre: 101426:0:(ldlm_lib.c:2393:target_recovery_overseer()) lustre-MDT0000 recovery is aborted by hard timeout [ 2248.227553] Lustre: 101426:0:(ldlm_lib.c:2403:target_recovery_overseer()) recovery is aborted, evict exports in recovery [ 2248.230975] Lustre: 101426:0:(genops.c:1630:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client ad29d81d-580e-4bba-a6d4-c3151d2d1235@192.168.203.43@tcp [ 2248.235210] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 2248.238070] Lustre: 101426:0:(ldlm_lib.c:1913:abort_req_replay_queue()) @@@ aborted: req@00000000542b2373 x1875802270535808/t0(8589934780) o35->ad29d81d-580e-4bba-a6d4-c3151d2d1235@192.168.203.43@tcp:731/0 lens 392/0 e 0 to 0 dl 1788905281 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:0 [ 2248.247895] Lustre: lustre-MDT0000-osd: cancel update llog [0x200000400:0x1:0x0] [ 2248.252321] Lustre: lustre-MDT0000: Denying connection for new client ad29d81d-580e-4bba-a6d4-c3151d2d1235 (at 192.168.203.43@tcp), waiting for 3 known clients (2 recovered, 0 in progress, and 1 evicted) to recover in 0:00 [ 2248.255437] Lustre: lustre-MDT0001-osp-MDT0000: cancel update llog [0x240000401:0x1:0x0] [ 2248.276365] Lustre: lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 2248.279044] Lustre: Skipped 2 previous similar messages [ 2248.280610] Lustre: lustre-MDT0000: Recovery over after 1:00, of 3 clients 2 recovered and 1 was evicted. [ 2248.296437] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:48 to 0x2c0000401:545) [ 2248.296743] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:80 to 0x280000401:577) [ 2255.327698] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2255.330852] LustreError: Skipped 2 previous similar messages [ 2255.332841] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2255.337465] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2255.339041] Lustre: Skipped 7 previous similar messages [ 2261.246750] Lustre: server umount lustre-OST0000 complete [ 2262.498173] LustreError: 97052:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2262.507843] LustreError: 97052:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 16 previous similar messages [ 2276.831159] Lustre: lustre-OST0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2276.895806] Lustre: server umount lustre-OST0001 complete [ 2284.375536] Lustre: server umount lustre-MDT0000 complete [ 2285.625482] LustreError: 95966:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788905308 with bad export cookie 12870510226537777902 [ 2285.628515] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2285.629834] LustreError: 95966:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2285.745241] Lustre: server umount lustre-MDT0001 complete [ 2288.687745] Lustre: DEBUG MARKER: == conf-sanity test 85: osd_ost init: fail ea_fid_set ==== 18:08:31 (1788905311) [ 2291.240572] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2291.244453] Lustre: *** cfs_fail_loc=197, val=0*** [ 2306.719587] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 2311.839308] LustreError: 103403:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.203.143@tcp: failed processing log, type 4: rc = -110 [ 2316.965369] Lustre: *** cfs_fail_loc=197, val=0*** [ 2316.966838] Lustre: Skipped 65 previous similar messages [ 2339.262035] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 2341.546289] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2342.225708] Lustre: server umount lustre-OST0000 complete [ 2345.099856] Lustre: DEBUG MARKER: == conf-sanity test 86: Replacing mkfs.lustre -G option == 18:09:27 (1788905367) [ 2358.341620] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2358.467634] LustreError: 105019:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2358.474779] LustreError: 105019:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 4 previous similar messages [ 2359.657740] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 2363.258267] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2365.236829] LustreError: 105051:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x200000009:0x1:0x0]: rc = -5 [ 2365.240911] LustreError: 105051:0:(lod_sub_object.c:917:lod_sub_prep_llog()) lustre-MDT0000-mdtlov: can't get id from catalogs: rc = -5 [ 2365.244558] LustreError: 105051:0:(lod_dev.c:511:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 7, retries 0, failed: rc = -5 [ 2365.373355] Lustre: server umount lustre-MDT0000 complete [ 2375.752718] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_hostid [ 2378.966497] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 2390.709166] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2390.792450] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2390.802024] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2390.835931] Lustre: lustre-MDT0000: new disk, initializing [ 2390.857896] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2392.089376] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 2396.091493] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2396.133709] Lustre: 109221:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2396.233805] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2397.524306] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 2401.096726] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2402.904496] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2405.093343] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2405.195297] Lustre: 111186:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2407.154650] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 2407.897698] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2410.892740] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2412.312513] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2412.398086] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2413.765122] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2413.847627] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2418.149954] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2418.150041] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2418.152602] LustreError: Skipped 3 previous similar messages [ 2418.158364] Lustre: Skipped 6 previous similar messages [ 2420.555189] Lustre: server umount lustre-OST0000 complete [ 2436.063177] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2436.131120] Lustre: server umount lustre-MDT0000 complete [ 2437.284149] LustreError: 109213:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788905460 with bad export cookie 12870510226537788605 [ 2437.286917] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2437.287081] LustreError: 109213:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 2437.387911] Lustre: server umount lustre-MDT0001 complete [ 2440.051141] Lustre: DEBUG MARKER: == conf-sanity test 87: check if MDT inode can hold EAs with N stripes properly ========================================================== 18:11:02 (1788905462) [ 2443.013023] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing unload_modules_local [ 2443.990233] Key type lgssc unregistered [ 2444.127251] LNet: 113669:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2444.129845] LNetError: 113669:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2444.137303] LNet: Removed LNI 192.168.203.143@tcp [ 2444.453358] Key type .llcrypt unregistered [ 2444.454341] Key type ._llcrypt unregistered [ 2450.149408] Key type ._llcrypt registered [ 2450.150703] Key type .llcrypt registered [ 2450.180779] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_hostid [ 2456.447820] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 2456.728106] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2456.745715] alg: No test for adler32 (adler32-zlib) [ 2457.593971] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 2457.677607] LNet: Added LNI 192.168.203.143@tcp [8/256/0/180] [ 2459.255116] Key type lgssc registered [ 2459.582971] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2472.410266] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2472.417854] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2473.507757] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2473.519670] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2473.554986] Lustre: lustre-MDT0000: new disk, initializing [ 2473.577481] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2473.583054] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2474.929069] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 2478.894245] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2478.990861] Lustre: lustre-OST0000: new disk, initializing [ 2478.992802] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 2478.994220] Lustre: Skipped 1 previous similar message [ 2478.995996] Lustre: 117814:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2479.022347] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2480.832141] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 2482.171283] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 2482.174153] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 2482.182425] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 2484.951952] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2485.009785] Lustre: lustre-OST0001: new disk, initializing [ 2485.012290] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 2485.014575] Lustre: 118676:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2485.039089] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 2486.905597] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 2489.027809] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost [ 2489.030746] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] [ 2489.042516] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 [ 2494.432404] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2494.433497] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2494.435879] Lustre: Skipped 1 previous similar message [ 2496.998113] Lustre: server umount lustre-MDT0000 complete [ 2499.174368] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null) [ 2500.708249] LustreError: 117000:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788905523 with bad export cookie 11827411718127231417 [ 2500.710154] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2500.713320] LustreError: 117000:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 2500.744944] Lustre: server umount lustre-OST0000 complete [ 2502.001085] Lustre: server umount lustre-OST0001 complete [ 2504.851695] Lustre: DEBUG MARKER: == conf-sanity test 88a: tunefs.lustre persists a --mountfsoptions-only change ========================================================== 18:12:07 (1788905527) [ 2512.282629] Lustre: DEBUG MARKER: == conf-sanity test 88b: check the default mount options can be overridden ========================================================== 18:12:14 (1788905534) [ 2515.481268] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 2522.803329] Lustre: DEBUG MARKER: == conf-sanity test 89: check tunefs --param and --erase-param{s} options ========================================================== 18:12:25 (1788905545) [ 2535.072791] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_hostid [ 2538.006486] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 2556.211381] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2556.364077] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2556.382961] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2556.431911] Lustre: lustre-MDT0000: new disk, initializing [ 2556.474051] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2556.488833] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2559.339017] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 2567.796966] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2567.922149] Lustre: 126411:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2567.963359] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 2567.966580] Lustre: Skipped 1 previous similar message [ 2568.089282] Lustre: lustre-MDT0001: new disk, initializing [ 2568.179348] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2568.220052] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 2568.233468] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2572.150232] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 2581.930646] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2587.536880] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2593.341349] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2593.517810] Lustre: lustre-OST0000: new disk, initializing [ 2593.521800] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 2593.526675] Lustre: 128378:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2593.568316] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2597.866540] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 2602.058665] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 2602.064434] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2602.147147] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2604.159386] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount (FULL|IDLE) failover.node=192.0.2.254@tcp0,osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2606.713953] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2606.818396] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2608.942762] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2609.080691] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2612.709925] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2612.710353] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2612.711088] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2612.711092] Lustre: Skipped 1 previous similar message [ 2612.713779] LustreError: Skipped 1 previous similar message [ 2612.719101] Lustre: Skipped 1 previous similar message [ 2616.157386] Lustre: server umount lustre-OST0000 complete [ 2617.824926] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2617.825940] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2617.830468] Lustre: Skipped 1 previous similar message [ 2617.833662] Lustre: Skipped 1 previous similar message [ 2622.945960] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2622.950864] Lustre: Skipped 1 previous similar message [ 2628.070771] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2628.074418] Lustre: Skipped 1 previous similar message [ 2632.162358] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2632.279577] Lustre: server umount lustre-MDT0000 complete [ 2634.234752] LustreError: 126404:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788905657 with bad export cookie 11827411718127232621 [ 2634.238854] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2634.242109] LustreError: 126404:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 2634.437408] Lustre: server umount lustre-MDT0001 complete [ 2638.519904] Lustre: DEBUG MARKER: == conf-sanity test 90a: check max_mod_rpcs_in_flight is enforced ========================================================== 18:14:20 (1788905660) [ 2641.798329] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2642.070321] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2644.272388] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 2647.522716] LustreError: 130791:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2647.532475] LustreError: 130791:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 2648.727373] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2651.208080] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 2655.264984] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2658.546852] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2661.863417] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2664.829220] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 2668.335652] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2674.653774] Lustre: *** cfs_fail_loc=159, val=0*** [ 2690.078279] Lustre: lustre-MDT0000: Client 348b4fed-7653-4775-8e92-99dcfe70cac4 (at 192.168.203.43@tcp) reconnecting [ 2691.011214] Lustre: *** cfs_fail_loc=159, val=0*** [ 2691.014659] Lustre: Skipped 5 previous similar messages [ 2707.514939] Lustre: lustre-MDT0000: Client 348b4fed-7653-4775-8e92-99dcfe70cac4 (at 192.168.203.43@tcp) reconnecting [ 2713.568219] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2713.571606] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2713.579705] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2713.582957] Lustre: Skipped 2 previous similar messages [ 2714.592860] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2715.629859] Lustre: server umount lustre-OST0000 complete [ 2719.712834] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2719.722018] Lustre: Skipped 1 previous similar message [ 2723.743414] Lustre: server umount lustre-MDT0000 complete [ 2724.832458] LustreError: 130790:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2724.843306] LustreError: 130790:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 2725.798534] LustreError: 130770:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788905748 with bad export cookie 11827411718127233503 [ 2725.802259] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2725.805727] LustreError: 130770:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2725.970985] Lustre: server umount lustre-MDT0001 complete [ 2731.676255] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing unload_modules_local [ 2733.033282] Key type lgssc unregistered [ 2733.183431] LNet: 134569:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2733.188456] LNetError: 134569:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2733.199252] LNet: Removed LNI 192.168.203.143@tcp [ 2733.644243] Key type .llcrypt unregistered [ 2733.647663] Key type ._llcrypt unregistered [ 2745.661550] Key type ._llcrypt registered [ 2745.662790] Key type .llcrypt registered [ 2745.726394] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 2746.214136] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2746.228584] alg: No test for adler32 (adler32-zlib) [ 2747.127784] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 2747.261185] LNet: Added LNI 192.168.203.143@tcp [8/256/0/180] [ 2748.863233] Key type lgssc registered [ 2749.406776] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2753.198262] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2753.208259] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2754.411697] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2756.219909] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 2760.239434] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2760.425422] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2762.555199] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 2766.574861] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2769.976621] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2773.911450] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2774.178215] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2777.570675] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 2779.302414] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:42 to 0x280000401:65) [ 2782.086879] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2794.049106] Lustre: *** cfs_fail_loc=159, val=0*** [ 2810.423289] Lustre: lustre-MDT0000: Client d75d0447-0fca-415f-a605-3d4da1754cf9 (at 192.168.203.43@tcp) reconnecting [ 2811.904536] Lustre: *** cfs_fail_loc=159, val=0*** [ 2811.904536] Lustre: *** cfs_fail_loc=159, val=0*** [ 2828.360769] Lustre: lustre-MDT0001: Client d75d0447-0fca-415f-a605-3d4da1754cf9 (at 192.168.203.43@tcp) reconnecting [ 2829.212421] Lustre: *** cfs_fail_loc=159, val=0*** [ 2829.216242] Lustre: Skipped 3 previous similar messages [ 2845.770388] Lustre: lustre-MDT0001: Client d75d0447-0fca-415f-a605-3d4da1754cf9 (at 192.168.203.43@tcp) reconnecting [ 2848.906272] Lustre: 138999:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 2851.445237] Lustre: *** cfs_fail_loc=159, val=0*** [ 2851.446889] Lustre: Skipped 3 previous similar messages [ 2867.782211] Lustre: lustre-MDT0000: Client d935e144-5e38-46d1-b5f0-25749fbafe0b (at 192.168.203.43@tcp) reconnecting [ 2869.214305] Lustre: *** cfs_fail_loc=159, val=0*** [ 2869.219841] Lustre: Skipped 15 previous similar messages [ 2885.712827] Lustre: lustre-MDT0000: Client d935e144-5e38-46d1-b5f0-25749fbafe0b (at 192.168.203.43@tcp) reconnecting [ 2887.610101] Lustre: 139292:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 2907.618687] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2907.622698] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2907.633768] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2908.642853] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2908.643813] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2908.651262] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2913.774236] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2913.780480] Lustre: Skipped 2 previous similar messages [ 2918.367233] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2918.569984] Lustre: server umount lustre-OST0000 complete [ 2924.003629] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2924.017518] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2924.023373] Lustre: Skipped 1 previous similar message [ 2932.193070] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2932.202063] Lustre: Skipped 3 previous similar messages [ 2936.287810] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2936.420409] Lustre: server umount lustre-MDT0000 complete [ 2937.314085] LustreError: 135962:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2937.335444] LustreError: 135962:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [ 2938.336824] LustreError: 136700:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2938.361555] LustreError: 136700:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 2939.475951] LustreError: 135943:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788905962 with bad export cookie 17118818735150653828 [ 2939.479536] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2939.485513] LustreError: 135943:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2939.681645] Lustre: server umount lustre-MDT0001 complete [ 2947.059358] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing unload_modules_local [ 2948.823575] Key type lgssc unregistered [ 2949.025485] LNet: 140370:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2949.030675] LNetError: 140370:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2950.055745] LNet: Removed LNI 192.168.203.143@tcp [ 2950.688342] Key type .llcrypt unregistered [ 2950.691505] Key type ._llcrypt unregistered [ 2969.414383] Key type ._llcrypt registered [ 2969.416142] Key type .llcrypt registered [ 2969.483331] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 2970.351073] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2970.384052] alg: No test for adler32 (adler32-zlib) [ 2971.373897] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 2971.554766] LNet: Added LNI 192.168.203.143@tcp [8/256/0/180] [ 2973.200419] Key type lgssc registered [ 2974.006219] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2979.698530] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2979.718271] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2980.973085] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2983.754698] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 2989.506775] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2989.730725] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2992.283349] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 2997.286233] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3001.067204] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3005.784441] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3006.060827] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3010.425505] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 3014.249701] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:97) [ 3015.536764] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3025.525881] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:129) [ 3030.948654] Lustre: 144363:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3032.988821] Lustre: 144411:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3034.120121] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 in log params [ 3034.745841] Lustre: Setting parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=8 in log params [ 3036.831218] Lustre: 144558:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre/mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 (mode = 0) failed: rc = -17 [ 3037.378940] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=7 in log params [ 3037.889554] Lustre: 144656:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3040.224159] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3040.230183] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3040.242523] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3041.253568] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3041.254111] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3041.256869] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3046.200176] Lustre: server umount lustre-OST0000 complete [ 3051.489516] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3051.490293] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3051.491128] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3051.503343] Lustre: Skipped 1 previous similar message [ 3051.514426] Lustre: Skipped 1 previous similar message [ 3056.610114] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3056.614698] Lustre: Skipped 2 previous similar messages [ 3061.730543] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3061.735766] Lustre: Skipped 1 previous similar message [ 3063.263149] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 3063.333508] LustreError: 144962:0:(ldlm_resource.c:1207:ldlm_resource_complain()) MGS: namespace resource [0x65727473756c:0x0:0x0].0x0 (00000000761e5e49) refcount nonzero (1) after lock cleanup; forcing cleanup. [ 3063.373015] Lustre: server umount lustre-MDT0000 complete [ 3065.898171] LustreError: 144460:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788906088 with bad export cookie 1751714996965160105 [ 3065.900730] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3065.906651] LustreError: 144460:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3066.083766] Lustre: server umount lustre-MDT0001 complete [ 3072.684302] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing unload_modules_local [ 3074.209880] Key type lgssc unregistered [ 3074.407597] LNet: 145713:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3074.412513] LNetError: 145713:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3074.423467] LNet: Removed LNI 192.168.203.143@tcp [ 3074.891471] Key type .llcrypt unregistered [ 3074.893551] Key type ._llcrypt unregistered [ 3090.169500] Key type ._llcrypt registered [ 3090.171132] Key type .llcrypt registered [ 3090.219981] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 3090.740581] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3090.819047] alg: No test for adler32 (adler32-zlib) [ 3091.741996] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 3091.920645] LNet: Added LNI 192.168.203.143@tcp [8/256/0/180] [ 3093.543211] Key type lgssc registered [ 3094.306380] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3099.343489] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3099.354823] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3100.646949] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3103.051317] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 3108.133440] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3108.369515] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3110.981536] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 3115.875209] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3119.028386] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3122.745149] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3122.954656] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3125.031960] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:161) [ 3126.247396] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 3130.609983] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3133.240064] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:129) [ 3139.276134] Lustre: *** cfs_fail_loc=159, val=0*** [ 3155.531555] Lustre: lustre-MDT0000: Client fb425c6b-bf32-4088-944e-877d58ea7931 (at 192.168.203.43@tcp) reconnecting [ 3174.369881] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3174.370798] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3174.380150] Lustre: Skipped 1 previous similar message [ 3177.786868] Lustre: server umount lustre-OST0000 complete [ 3184.609554] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3184.612225] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3184.617258] Lustre: Skipped 1 previous similar message [ 3184.624918] Lustre: Skipped 2 previous similar messages [ 3186.339975] Lustre: server umount lustre-MDT0000 complete [ 3188.532049] LustreError: 147085:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788906211 with bad export cookie 10491956259770891240 [ 3188.532473] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3188.540206] LustreError: 147085:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3188.718104] Lustre: server umount lustre-MDT0001 complete [ 3194.715732] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing unload_modules_local [ 3196.243390] Key type lgssc unregistered [ 3196.410563] LNet: 150768:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3196.416355] LNetError: 150768:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3196.428661] LNet: Removed LNI 192.168.203.143@tcp [ 3196.889682] Key type .llcrypt unregistered [ 3196.891341] Key type ._llcrypt unregistered [ 3211.140207] Key type ._llcrypt registered [ 3211.142491] Key type .llcrypt registered [ 3211.213918] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 3211.861474] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3211.880181] alg: No test for adler32 (adler32-zlib) [ 3212.820788] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 3212.970229] LNet: Added LNI 192.168.203.143@tcp [8/256/0/180] [ 3214.583347] Key type lgssc registered [ 3215.245056] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3219.594097] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3219.609243] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3220.869578] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3223.444557] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 3228.665040] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3228.895482] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3231.654764] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 3236.392651] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3239.803598] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3243.847454] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3244.091668] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3245.101591] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:170 to 0x280000401:193) [ 3247.604322] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 3251.897261] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3253.300075] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:161) [ 3268.606926] Lustre: lustre-OST0000: evicting 709bcefa-20c1-4993-b11f-59f54e47c497 (at 192.168.203.43@tcp) by administrative request [ 3268.612081] Lustre: Skipped 1 previous similar message [ 3294.178723] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3294.185227] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3294.185874] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3299.298154] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3299.308926] Lustre: Skipped 2 previous similar messages [ 3304.418802] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3304.424456] Lustre: Skipped 1 previous similar message [ 3307.999178] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 3308.104941] Lustre: server umount lustre-OST0000 complete [ 3311.072503] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3311.078831] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3311.087834] Lustre: Skipped 1 previous similar message [ 3311.091628] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3314.659633] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3316.470911] Lustre: server umount lustre-MDT0000 complete [ 3318.576665] LustreError: 152144:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788906341 with bad export cookie 8324817484298717223 [ 3318.578480] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3318.588134] LustreError: 152144:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3318.782107] Lustre: server umount lustre-MDT0001 complete [ 3324.341446] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing unload_modules_local [ 3326.019300] Key type lgssc unregistered [ 3326.209198] LNet: 156229:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3326.213835] LNetError: 156229:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3326.225059] LNet: Removed LNI 192.168.203.143@tcp [ 3326.741955] Key type .llcrypt unregistered [ 3326.745080] Key type ._llcrypt unregistered [ 3370.292849] Key type ._llcrypt registered [ 3370.294457] Key type .llcrypt registered [ 3370.354411] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 3370.921146] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3370.947060] alg: No test for adler32 (adler32-zlib) [ 3371.885598] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 3372.056174] LNet: Added LNI 192.168.203.143@tcp [8/256/0/180] [ 3373.695146] Key type lgssc registered [ 3374.376574] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3378.554085] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3378.563728] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3379.830511] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3382.121936] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 3386.874623] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3387.068694] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3389.378870] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 3393.679680] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3397.178638] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3403.308825] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3403.726632] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3404.810419] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:195 to 0x280000401:225) [ 3411.830439] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 3412.089597] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:193) [ 3421.763188] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3438.050468] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3438.057741] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3438.099293] Lustre: Skipped 1 previous similar message [ 3438.170819] Lustre: Skipped 1 previous similar message [ 3439.650391] Lustre: server umount lustre-OST0000 complete [ 3448.293482] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3448.346036] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3448.363665] Lustre: Skipped 1 previous similar message [ 3453.424793] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3453.442574] Lustre: Skipped 1 previous similar message [ 3454.661102] Lustre: server umount lustre-MDT0000 complete [ 3458.529630] LustreError: 158690:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3458.547930] LustreError: 158690:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [ 3460.162899] LustreError: 158674:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788906483 with bad export cookie 12933028508491426973 [ 3460.163849] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3460.171352] LustreError: 158674:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 3460.604947] Lustre: server umount lustre-MDT0001 complete [ 3472.627037] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing unload_modules_local [ 3475.621465] Key type lgssc unregistered [ 3475.913742] LNet: 162256:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3475.919893] LNetError: 162256:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3475.946720] LNet: Removed LNI 192.168.203.143@tcp [ 3476.760551] Key type .llcrypt unregistered [ 3476.762894] Key type ._llcrypt unregistered [ 3502.080641] Key type ._llcrypt registered [ 3502.082505] Key type .llcrypt registered [ 3502.357976] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 3503.698599] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3503.745924] alg: No test for adler32 (adler32-zlib) [ 3505.081737] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 3505.480759] LNet: Added LNI 192.168.203.143@tcp [8/256/0/180] [ 3507.163173] Key type lgssc registered [ 3509.737739] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3530.977851] Lustre: DEBUG MARKER: == conf-sanity test 100: check lshowmount lists MGS, MDT, OST and 0@lo ========================================================== 18:29:12 (1788906552) [ 3545.354848] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_hostid [ 3553.972264] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 3589.271409] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3589.310471] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3590.648321] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3590.700531] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3590.813197] Lustre: lustre-MDT0000: new disk, initializing [ 3590.894348] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3590.911395] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3595.498666] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 3605.323642] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3605.458573] Lustre: 166523:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 3605.525569] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 3605.531658] Lustre: Skipped 1 previous similar message [ 3605.587649] Lustre: lustre-MDT0001: new disk, initializing [ 3605.664484] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3605.707066] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 3605.719857] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 3610.008505] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 3619.166041] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3624.502759] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3630.981812] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3631.301891] Lustre: lustre-OST0000: new disk, initializing [ 3631.310875] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3631.321311] Lustre: 168492:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3631.431177] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3637.001696] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 3640.375418] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 3640.388133] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 3640.505243] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 3646.978398] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3661.280678] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3661.283656] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3661.294251] LustreError: Skipped 1 previous similar message [ 3661.313642] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3661.326707] Lustre: Skipped 1 previous similar message [ 3662.726988] Lustre: server umount lustre-OST0000 complete [ 3667.424825] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3667.431402] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3667.439414] Lustre: Skipped 1 previous similar message [ 3667.444124] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3671.522563] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3671.523809] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3672.894363] Lustre: server umount lustre-MDT0000 complete [ 3676.640690] LustreError: 166530:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3676.655578] LustreError: 166530:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [ 3676.894863] LustreError: 166515:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788906699 with bad export cookie 1709871032421043604 [ 3676.900084] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3676.907765] LustreError: 166515:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3677.198597] Lustre: server umount lustre-MDT0001 complete [ 3688.098553] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing unload_modules_local [ 3690.851149] Key type lgssc unregistered [ 3691.165683] LNet: 170398:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3691.173659] LNetError: 170398:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3691.191639] LNet: Removed LNI 192.168.203.143@tcp [ 3692.072196] Key type .llcrypt unregistered [ 3692.076281] Key type ._llcrypt unregistered [ 3716.741172] Key type ._llcrypt registered [ 3716.743392] Key type .llcrypt registered [ 3716.881089] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 3717.825529] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3717.846629] alg: No test for adler32 (adler32-zlib) [ 3719.087749] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 3719.406562] LNet: Added LNI 192.168.203.143@tcp [8/256/0/180] [ 3721.143315] Key type lgssc registered [ 3722.202736] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3729.289166] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3729.329747] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3730.785519] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3734.688433] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 3740.130069] LustreError: 171817:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3740.139297] LustreError: 171817:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 3741.768210] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3742.040650] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3746.935485] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 3753.631134] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3758.626715] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3764.254393] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3764.576400] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3770.001686] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 3775.860123] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:33) [ 3776.059712] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3781.926176] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3781.950496] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3781.967158] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3781.973582] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3781.988946] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3782.816947] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3782.833151] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3782.842186] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3782.857473] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3782.876848] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3783.620300] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3784.327920] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3784.331087] Lustre: Skipped 1 previous similar message [ 3784.341827] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3784.353790] Lustre: Skipped 1 previous similar message [ 3784.358090] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3784.361854] Lustre: Skipped 1 previous similar message [ 3784.364934] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3784.372089] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3784.375113] Lustre: Skipped 1 previous similar message [ 3785.065175] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3785.806186] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3786.536328] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3786.542150] Lustre: Skipped 2 previous similar messages [ 3786.557712] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3786.565683] Lustre: Skipped 2 previous similar messages [ 3786.569364] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3786.578755] Lustre: Skipped 2 previous similar messages [ 3786.582860] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3786.592390] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3786.596109] Lustre: Skipped 2 previous similar messages [ 3787.342950] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3788.004825] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3788.632756] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3789.417585] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3790.127245] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3790.817490] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3790.824463] Lustre: Skipped 5 previous similar messages [ 3790.839693] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3790.848777] Lustre: Skipped 5 previous similar messages [ 3790.852356] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3790.856161] Lustre: Skipped 5 previous similar messages [ 3790.859705] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3790.867978] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3790.871091] Lustre: Skipped 5 previous similar messages [ 3791.580642] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3792.299993] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3792.949715] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3793.679963] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3794.308851] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3795.147703] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3795.924216] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3796.751608] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3797.455968] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3798.175484] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3798.874244] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3798.879836] Lustre: Skipped 10 previous similar messages [ 3798.897903] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3798.909356] Lustre: Skipped 10 previous similar messages [ 3798.913331] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3798.917806] Lustre: Skipped 10 previous similar messages [ 3798.921457] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3798.929663] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3798.937807] Lustre: Skipped 10 previous similar messages [ 3799.697217] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3800.447574] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3801.230692] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3801.958579] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3802.737519] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3803.511072] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3804.312244] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3805.076621] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3805.743519] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3806.580966] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3807.267100] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3808.180766] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3808.806137] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3809.565808] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3810.285995] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3811.076269] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3811.801488] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3812.523360] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3813.122599] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3813.956373] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3814.668195] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3815.493279] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3815.498151] Lustre: Skipped 21 previous similar messages [ 3815.517874] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3815.525870] Lustre: Skipped 21 previous similar messages [ 3815.529442] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3815.532441] Lustre: Skipped 21 previous similar messages [ 3815.535566] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3815.542406] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3815.544959] Lustre: Skipped 21 previous similar messages [ 3816.206715] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3816.824502] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3817.515728] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3818.198636] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3818.944459] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3819.746384] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3820.425575] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3821.027069] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3821.662686] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3822.368671] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3822.938404] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3823.523299] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3824.098900] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3824.729703] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3825.295939] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3825.828570] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3826.347745] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3826.909385] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3827.500202] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3828.025867] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3828.687829] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3829.237758] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3829.759748] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3830.320178] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3831.045303] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3831.570929] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3832.179936] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3832.690348] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3833.188338] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3833.710449] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3834.257169] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3834.805347] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3835.349740] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3835.902421] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3836.544222] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3837.196613] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3837.749476] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3838.358440] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3838.890095] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3839.437495] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3839.954922] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3840.465645] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3840.972513] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3841.458674] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3841.940411] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3842.433441] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3842.951738] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3843.458196] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3844.027718] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3844.713155] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3845.232166] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3845.738480] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3846.276100] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3846.772578] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3847.244850] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3847.713752] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3847.716919] Lustre: Skipped 55 previous similar messages [ 3847.724457] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3847.730124] Lustre: Skipped 55 previous similar messages [ 3847.734742] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3847.737846] Lustre: Skipped 55 previous similar messages [ 3847.740078] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3847.744171] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3847.748265] Lustre: Skipped 55 previous similar messages [ 3848.221290] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3848.760178] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3849.360492] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3849.921865] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3850.512661] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3851.037628] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3851.508719] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3852.084904] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3852.589928] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3853.147574] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3853.668085] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3854.185441] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3854.734438] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3855.308188] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3855.809834] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3856.294471] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3856.906297] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3857.418577] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3857.983341] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3858.475631] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3858.935208] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3859.513586] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3860.050500] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3860.625788] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3861.184848] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3861.646171] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3862.123579] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3862.574074] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3863.054908] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3863.506262] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3863.939421] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3864.423834] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3864.911337] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3865.370491] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3865.827559] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3866.354975] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3866.769710] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3867.273925] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3867.841505] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3868.293167] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3868.779568] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3869.373821] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3869.877325] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3870.350352] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3870.815946] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3871.244700] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3871.651587] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3872.104093] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3872.567618] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3873.074694] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3873.579697] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3874.080783] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3874.562223] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3875.105437] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3875.527303] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3875.965559] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3876.427332] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3876.936051] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3877.396510] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3877.859979] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3878.310443] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3878.837720] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3879.316163] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3879.773743] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3880.262620] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3880.724657] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3881.169039] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3881.575697] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3881.999524] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3882.416211] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3882.835383] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3883.238602] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3883.705775] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3884.117709] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3884.547833] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3884.933855] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3885.340252] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3885.736712] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3886.163816] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3886.563357] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3886.995985] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3887.404058] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3887.833754] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3888.272191] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3888.752970] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3889.214702] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3889.638688] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3890.035359] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3890.504294] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3891.010467] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3891.474028] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3891.893403] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3892.312970] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3892.747448] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3893.220797] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3893.690382] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3894.140945] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3894.549767] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3894.983339] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3895.423444] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3895.881658] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3896.343693] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3896.792554] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3897.290165] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3897.773195] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3898.220478] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3898.664883] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3899.141740] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3899.585663] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3900.014662] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3900.448840] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3900.857419] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3901.281480] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3901.693074] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3902.066444] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3902.556228] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3903.015667] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3903.431703] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3903.924195] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3904.369961] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3904.793544] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3905.237488] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3905.720840] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3906.157931] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3906.625601] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3907.140329] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3907.643515] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3908.103686] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3908.565665] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3908.963596] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3909.395370] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3909.855631] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3910.303552] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3910.839982] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3911.369908] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3911.854698] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3911.858178] Lustre: Skipped 135 previous similar messages [ 3911.866947] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3911.872591] Lustre: Skipped 135 previous similar messages [ 3911.875532] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3911.878987] Lustre: Skipped 135 previous similar messages [ 3911.881306] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3911.891385] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3911.895611] Lustre: Skipped 135 previous similar messages [ 3912.362348] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3912.812193] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3913.293890] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3913.781767] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3914.325930] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3914.887926] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3915.424149] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3915.936793] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3916.403829] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3916.861504] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3917.264960] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3917.706944] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3918.165209] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3918.684094] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3919.182936] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3919.733050] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3920.209992] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3920.690863] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3921.242188] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3921.787202] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3922.377148] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3922.952681] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3923.457269] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3924.021643] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3924.530023] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3925.030061] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3925.523692] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3926.024530] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3926.518502] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3927.003848] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3927.472886] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3927.913676] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3928.381401] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3928.881605] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3929.379348] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3929.855186] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3930.325253] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3930.771913] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3931.294309] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3931.794996] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3932.251718] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3932.742565] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3933.359775] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3933.881624] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3934.381308] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3934.861663] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3935.333760] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3935.802515] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3936.325270] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3936.836847] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3937.344152] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3937.810302] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3938.299577] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3938.833330] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3939.302486] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3939.779596] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3940.263560] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3940.745333] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3941.259764] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3941.760899] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3942.277757] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3942.781359] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3943.314100] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3943.881215] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3944.570925] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3945.168822] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3945.707016] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3946.209892] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3946.773447] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3947.351813] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3947.942262] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3948.508039] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3949.107408] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3949.643470] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3950.221716] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3950.695034] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3951.201489] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3951.733046] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3952.185763] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3952.779932] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3953.353980] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3953.849523] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3954.336665] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3954.853128] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3955.371519] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3955.933571] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3956.438840] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3957.018371] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3957.560931] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3958.045391] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3958.514623] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3959.033620] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3959.573574] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3960.055462] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3960.601262] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3961.085052] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3961.533373] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3962.077243] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3962.574917] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3963.037628] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3963.564121] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3963.980774] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3964.446492] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3964.889947] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3965.339855] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3965.807544] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3966.294734] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3966.769440] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3967.269706] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3967.723437] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3968.185525] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3968.633466] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3969.078585] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3969.500368] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3969.982562] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3970.480474] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3971.050746] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3971.505022] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3971.944888] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3972.386638] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3972.773876] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3973.160808] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3973.611832] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3974.009096] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3974.432047] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3974.806758] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3975.201909] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3975.572189] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3975.953088] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3976.323104] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3976.726563] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3977.143563] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3977.573928] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3977.962691] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3978.328136] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3978.745658] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3979.148494] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3979.517800] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3979.940349] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3980.353363] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3980.770059] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3981.196552] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3981.631398] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3982.063444] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3982.511333] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3982.957755] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3983.420530] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3983.851565] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3984.282417] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3984.739110] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3985.279925] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3985.791405] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3986.282623] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3986.778432] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3987.189810] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3987.632329] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3988.076695] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3988.512159] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3988.941476] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3989.397202] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3989.837027] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3990.250707] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3990.672790] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3991.093535] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3991.527110] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3991.975237] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3992.383671] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3992.809586] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3993.309872] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3993.803160] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3994.318632] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3994.792559] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3995.279607] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3995.715103] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3996.139384] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3996.552570] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3996.962395] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3997.389433] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3997.875698] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3998.349170] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3998.799952] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3999.251783] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3999.746283] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4000.207157] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4000.646636] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4001.125794] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4001.601864] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4002.046832] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4002.517332] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4003.001047] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4003.474310] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4003.926077] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4004.392812] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4004.819491] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4005.287740] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4005.788385] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4006.299490] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4006.818857] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4007.349918] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4007.815477] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4008.263259] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4008.756131] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4009.273450] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4009.696982] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4010.152474] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4010.594521] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4011.071190] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4011.571939] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4012.011245] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4012.509761] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4012.964901] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4013.463713] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4013.983229] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4014.404558] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4014.902293] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4015.318247] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4015.741715] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4016.203174] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4016.660514] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4017.069567] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4017.472988] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4017.849852] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4018.221266] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4018.610578] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4018.950961] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4019.369672] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4019.770143] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4020.167668] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4020.552495] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4020.927695] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4021.300419] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4021.710501] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4022.104651] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4022.506187] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4022.912226] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4023.342202] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4023.756801] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4024.142326] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4024.581603] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4024.978461] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4025.405475] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4025.846095] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4026.305559] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4026.760419] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4027.218391] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4027.643802] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4028.106793] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4028.588177] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4029.024648] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4029.440581] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4029.908233] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4030.358132] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4030.891839] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4031.398573] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4031.911117] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4032.414167] LustreError: 171837:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 4032.422696] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4032.423154] LustreError: 171837:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 4032.965996] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4033.478471] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4033.948227] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4034.443233] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4034.943444] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4035.479523] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4035.982405] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4036.424216] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4036.907411] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4037.360530] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4037.897699] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4038.395175] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4038.839450] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4039.280801] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4039.739574] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4040.216927] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4040.221310] Lustre: Skipped 271 previous similar messages [ 4040.230946] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4040.237440] Lustre: Skipped 271 previous similar messages [ 4040.239961] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4040.243655] Lustre: Skipped 271 previous similar messages [ 4040.246798] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4040.252527] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4040.255707] Lustre: Skipped 271 previous similar messages [ 4040.742841] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4041.308871] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4041.866624] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4042.350494] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4042.887714] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4043.407065] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4043.914189] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4044.506412] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4045.001360] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4045.436462] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4045.917827] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4046.399464] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4046.818364] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4047.272264] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4047.676484] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4048.095971] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4048.557921] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4048.994199] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4049.500763] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4049.976264] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4050.471226] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4050.962332] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4051.472805] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4051.958546] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4052.463292] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4053.011294] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4053.456610] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4053.938901] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4054.559872] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4055.064436] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4055.573961] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4056.151697] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4056.661527] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4057.178486] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4057.707312] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4058.212695] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4058.636408] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4059.044293] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4059.469148] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4059.884431] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4060.317174] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4060.783666] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4061.230753] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4061.660416] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4062.060645] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4062.481411] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4062.881671] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4063.287567] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4063.705868] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4064.139846] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4064.621284] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4065.068364] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4065.596110] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4066.168696] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4066.646399] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4067.094716] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4067.553666] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4067.981866] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4068.408698] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4068.888834] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4069.329153] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4069.781789] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4070.211282] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4070.709142] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4071.166071] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4071.699331] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4072.220899] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4072.704307] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4073.171630] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4073.642173] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4074.097430] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4074.599059] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4075.034980] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4075.457026] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4075.913678] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4076.327248] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4076.758245] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4077.176703] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4077.614251] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4078.029601] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4078.504268] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4078.941593] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4079.386889] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4079.832292] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4080.287904] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4080.699692] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4081.110067] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4081.522107] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4081.927458] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4082.335162] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4082.807756] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4083.240876] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4083.737896] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4084.184120] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4084.606368] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4085.056087] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4085.460416] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4085.927799] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4086.382217] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4086.830607] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4087.262067] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4087.668166] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4088.116293] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4088.542743] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4088.965283] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4089.366767] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4089.776409] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4090.222780] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4090.657873] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4091.113478] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4091.536648] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4091.930349] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4092.301829] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4092.693588] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4093.045272] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4093.410092] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4093.822348] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4094.190800] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4094.568975] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4094.965589] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4095.350495] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4095.729239] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4096.130359] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4096.520409] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4096.890932] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4097.326437] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4097.768353] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4098.201578] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4098.653251] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4099.117210] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4099.594992] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4100.038770] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4100.472644] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4100.922575] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4101.401924] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4101.872855] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4102.374441] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4102.889981] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4103.330162] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4103.766457] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4104.281133] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4104.748320] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4105.214595] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4105.678830] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4106.081615] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4106.513793] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4106.984489] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4107.498911] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4107.918678] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4108.367775] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4108.817994] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4109.338773] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4109.795627] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4110.274638] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4110.735045] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4111.238119] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4111.783070] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4112.267966] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4112.776800] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4113.283084] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4113.771324] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4114.298170] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4114.868976] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4115.378389] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4115.953995] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4116.470522] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4116.953664] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4117.407245] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4117.865285] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4118.387452] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4118.956375] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4119.453058] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4119.949585] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4120.491715] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4121.027400] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4121.567818] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4122.175425] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4122.719626] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4123.293309] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4123.830437] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4124.377289] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4124.893471] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4125.411331] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4125.860314] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4126.318114] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4126.846552] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4127.379547] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4127.891328] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4128.381166] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4128.891428] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4129.343933] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4129.896944] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4130.386346] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4130.837246] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4131.305465] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4131.829931] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4132.346662] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4132.824280] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4133.333274] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4133.800867] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4134.305438] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4134.818276] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4135.291460] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4135.737583] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4136.217207] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4136.759530] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4137.304621] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4137.873931] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4138.406898] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4138.920600] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4139.502857] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4140.013676] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4140.513624] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4141.023723] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4141.549950] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4142.059140] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4142.529143] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4142.993905] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4143.471558] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4143.971593] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4144.545652] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4145.072338] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4145.575330] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4146.101438] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4146.586309] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4147.055475] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4147.554199] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4148.045101] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4148.453406] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4148.895059] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4149.390977] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4149.828841] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4150.284401] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4150.813924] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4151.240583] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4151.667216] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4152.143165] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4152.588324] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4153.007335] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4153.407311] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4153.821917] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4154.237223] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4154.658741] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4155.079797] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4155.521317] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4155.942209] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4156.375596] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4156.814273] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4157.219796] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4157.656857] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4158.058341] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4158.486528] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4158.946182] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4159.396451] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4159.778841] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4160.175283] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4160.577703] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4160.959890] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4161.367413] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4161.772373] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4162.170235] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4162.586735] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4163.009064] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4163.405810] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4163.818074] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4164.218847] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4164.627434] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4165.060232] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4165.485523] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4165.875333] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4166.292680] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4166.695670] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4167.083735] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4167.480340] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4167.920970] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4168.345846] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4168.784652] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4169.179981] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4169.569369] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4169.961958] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4170.358592] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4170.782535] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4171.205342] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4171.661373] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4172.067492] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4172.506976] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4172.983693] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4173.426584] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4173.870068] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4174.320366] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4174.711098] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4175.076155] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4175.471415] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4175.865595] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4176.236151] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4176.681525] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4177.076747] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4177.488091] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4177.918544] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4178.341287] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4178.742223] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4179.150250] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4179.553569] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4179.950273] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4180.373338] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4180.826351] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4181.239567] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4181.652559] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4182.043882] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4182.429583] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4182.834979] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4183.259366] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4183.677724] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4184.063157] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4184.428717] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4184.844866] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4185.251684] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4185.655104] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4186.080608] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4186.525711] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4186.966409] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4187.361051] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4187.753815] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4188.115915] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4188.499990] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4188.892848] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4189.351603] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4189.827206] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4190.270898] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4190.682984] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4191.136981] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4191.574206] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4192.010889] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4192.440364] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4192.859464] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4193.313754] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4193.775056] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4194.201441] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4194.628403] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4195.029609] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4195.471254] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4195.869196] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4196.302432] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4196.755673] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4197.184050] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4197.569486] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4197.976892] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4198.365516] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4198.753218] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4199.124785] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4199.510822] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4199.892269] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4200.319627] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4200.774434] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4201.182389] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4201.605621] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4202.017508] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4202.428693] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4202.845426] LustreError: 171837:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 4202.850673] LustreError: 171837:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 4202.852156] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4203.274966] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4203.706896] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4204.113189] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4204.502762] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4204.918682] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4205.406023] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4205.849697] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4206.305086] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4206.792058] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4207.237490] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4207.695658] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4208.201463] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4208.712397] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4209.247776] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4209.694066] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4210.192706] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4210.732498] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4211.296964] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4211.851392] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4212.397553] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4212.912537] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4213.441880] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4213.951695] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4214.422816] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4214.899821] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4215.363084] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4215.816609] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4216.233206] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4216.697368] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4217.113179] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4217.541848] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4217.982075] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4218.420060] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4218.828302] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4219.264146] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4219.696029] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4220.124856] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4220.540066] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4220.957392] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4221.393231] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4221.824397] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4222.322181] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4222.796141] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4223.246323] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4223.735738] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4224.162647] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4224.600877] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4225.051307] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4225.502454] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4226.009948] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4226.530695] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4227.050387] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4227.546807] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4227.983517] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4228.414412] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4228.888965] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4229.333190] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4229.780231] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4230.212436] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4230.640734] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4231.101628] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4231.538688] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4231.938950] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4232.395669] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4232.834963] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4233.293844] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4233.728133] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4234.149155] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4234.623979] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4235.093706] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4235.531422] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4235.985486] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4236.461944] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4236.938094] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4237.394151] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4237.804133] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4238.251581] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4238.699991] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4239.129554] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4239.567942] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4239.988514] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4240.435760] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4240.887672] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4241.331371] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4241.735209] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4242.156150] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4242.594609] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4242.999950] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4243.461231] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4243.946804] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4244.375512] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4244.999176] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4245.611189] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4246.162664] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4246.675481] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4247.082512] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4247.638479] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4248.191617] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4248.789511] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4249.386715] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4249.980844] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4250.607062] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4251.197279] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4251.794063] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4252.578281] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4253.180507] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4254.060492] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4254.794608] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4255.540795] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4256.225799] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4257.261140] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4259.013952] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4260.069528] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4261.582824] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4263.236907] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4265.033290] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4266.475745] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4268.690556] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4270.480486] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4271.904606] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4273.157367] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4274.158581] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4275.620538] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4276.607313] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4278.088536] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4279.653354] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4280.811395] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4281.780738] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4283.551653] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4285.087555] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4286.894608] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4662.471145] LustreError: 179605:0:(ofd_dev.c:1780:ofd_create_hdl()) lustre-OST0000: unable to precreate: rc = -28 [ 4662.476959] LustreError: 171837:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -28 [ 4815.332431] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4815.333501] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4815.338753] Lustre: Skipped 491 previous similar messages [ 4815.347768] Lustre: Skipped 1 previous similar message [ 4816.734672] Lustre: server umount lustre-OST0000 complete [ 4820.451155] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4820.454375] Lustre: Skipped 1 previous similar message [ 4824.711128] Lustre: server umount lustre-MDT0000 complete [ 4825.568648] LustreError: 172544:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4825.574418] LustreError: 172544:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 4826.425553] LustreError: 171798:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788907849 with bad export cookie 9468711709327517567 [ 4826.428420] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4826.431115] LustreError: 171798:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4826.616726] Lustre: server umount lustre-MDT0001 complete [ 4831.488403] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing unload_modules_local [ 4832.755308] Key type lgssc unregistered [ 4832.898633] LNet: 226918:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4832.901859] LNetError: 226918:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4832.910799] LNet: Removed LNI 192.168.203.143@tcp [ 4833.302196] Key type .llcrypt unregistered [ 4833.303769] Key type ._llcrypt unregistered [ 4843.991380] Key type ._llcrypt registered [ 4843.992816] Key type .llcrypt registered [ 4844.038807] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 4844.405329] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4844.438099] alg: No test for adler32 (adler32-zlib) [ 4845.303990] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 4845.407228] LNet: Added LNI 192.168.203.143@tcp [8/256/0/180] [ 4846.999174] Key type lgssc registered [ 4847.416778] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4850.479771] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4850.489300] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4851.679535] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4853.248873] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 4856.878867] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4857.074180] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4858.852395] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 4861.988487] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 4864.214644] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 4867.084593] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4867.286042] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4869.837341] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 4872.772226] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 4876.523149] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49665 to 0x280000401:49696) [ 4880.189147] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4880.851052] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4880.855957] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4880.859371] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4880.864474] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4880.864490] LustreError: 228329:0:(osp_precreate.c:1268:osp_precreate_thread()) cfs_fail_timeout id 2107 sleeping for 20000ms [ 4881.890167] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4881.892170] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4881.897412] Lustre: Skipped 1 previous similar message [ 4883.492749] Lustre: lustre-OST0000: Not available for connect from 192.168.203.43@tcp (stopping) [ 4883.495802] Lustre: Skipped 1 previous similar message [ 4883.678750] Lustre: server umount lustre-OST0000 complete [ 4900.943113] LustreError: 228329:0:(osp_precreate.c:1268:osp_precreate_thread()) cfs_fail_timeout id 2107 awake [ 4912.404678] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4912.553969] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4914.912679] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 4917.968678] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 4921.767164] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4921.772967] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4921.772970] LustreError: lustre-OST0000-osc-MDT0001: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4921.781494] Lustre: Skipped 1 previous similar message [ 4924.749941] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 6 sec [ 4926.964352] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff89c843413000.ost_server_uuid 50 [ 4927.541031] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff89c843413000.ost_server_uuid in FULL state after 0 sec [ 4932.066542] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4932.067460] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4932.068344] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4932.071799] Lustre: Skipped 1 previous similar message [ 4934.806582] Lustre: server umount lustre-OST0000 complete [ 4937.184764] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4937.185600] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4937.190207] Lustre: Skipped 1 previous similar message [ 4937.192541] Lustre: Skipped 1 previous similar message [ 4942.304688] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4942.307250] Lustre: Skipped 2 previous similar messages [ 4942.502138] Lustre: server umount lustre-MDT0000 complete [ 4944.162348] LustreError: 228290:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788907967 with bad export cookie 9540974166955912703 [ 4944.166634] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4944.167413] LustreError: 228290:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4944.316133] Lustre: server umount lustre-MDT0001 complete [ 4948.792744] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing unload_modules_local [ 4950.049035] Key type lgssc unregistered [ 4950.210485] LNet: 233511:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4950.215199] LNetError: 233511:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4950.224776] LNet: Removed LNI 192.168.203.143@tcp [ 4950.615886] Key type .llcrypt unregistered [ 4950.617266] Key type ._llcrypt unregistered [ 4964.301530] Key type ._llcrypt registered [ 4964.302702] Key type .llcrypt registered [ 4964.345148] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 4964.701551] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4964.760097] alg: No test for adler32 (adler32-zlib) [ 4965.637917] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 4965.741938] LNet: Added LNI 192.168.203.143@tcp [8/256/0/180] [ 4967.335154] Key type lgssc registered [ 4967.814100] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4971.496670] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4971.508988] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4972.719270] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4974.359546] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 4977.774092] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4977.930526] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4979.571786] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 4980.744482] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 4983.271555] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4983.412655] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4985.538958] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 4988.904048] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4988.976785] Lustre: lustre-OST0001: new disk, initializing [ 4988.979257] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 4988.982768] Lustre: 237524:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 4989.021083] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 4991.339910] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 4992.075125] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 4992.079238] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 4992.110930] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 4996.860410] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 4997.226635] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49728) [ 5000.733839] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 5007.845314] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5007.847245] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5007.850138] Lustre: Skipped 3 previous similar messages [ 5007.852218] Lustre: Skipped 2 previous similar messages [ 5012.590579] Lustre: server umount lustre-MDT0000 complete [ 5012.961101] LustreError: 235945:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5012.969468] LustreError: 235945:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 5 previous similar messages [ 5013.999643] LustreError: 238298:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788908036 with bad export cookie 9649140738894048791 [ 5014.003346] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5014.004577] LustreError: 238298:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 5014.133426] Lustre: server umount lustre-MDT0001 complete [ 5025.288117] Lustre: server umount lustre-OST0000 complete [ 5037.032377] Lustre: server umount lustre-OST0001 complete [ 5045.475771] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 5049.556017] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5049.755119] LustreError: 240628:0:(ldlm_lib.c:1192:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5049.777353] Lustre: mylustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5051.434932] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 5054.821234] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5056.604959] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 5057.769164] Lustre: 241770:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 5060.259969] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5060.407938] Lustre: mylustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5060.410673] Lustre: Skipped 1 previous similar message [ 5062.505426] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 5064.483831] LustreError: 242122:0:(ldlm_lib.c:1192:target_handle_connect()) mylustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5065.477263] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5067.575512] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 5074.925945] Lustre: mylustre-OST0000: new connection from mylustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49731 to 0x280000401:49760) [ 5081.497698] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 5083.073325] Lustre: 243662:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 5089.949860] Lustre: server umount mylustre-MDT0000 complete [ 5090.275842] Lustre: mylustre-MDT0000-lwp-OST0000: Connection to mylustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5090.277351] LustreError: 240623:0:(ldlm_lib.c:1192:target_handle_connect()) mylustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5090.280484] Lustre: Skipped 3 previous similar messages [ 5090.286953] LustreError: 240623:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 5091.393675] LustreError: 240605:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788908114 with bad export cookie 9649140738894051458 [ 5091.396861] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5091.397876] LustreError: 240605:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 5093.577930] Lustre: server umount mylustre-MDT0001 complete [ 5105.674191] Lustre: server umount mylustre-OST0000 complete [ 5117.425790] Lustre: server umount mylustre-OST0001 complete [ 5126.081678] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 5130.474772] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5130.666425] LustreError: 245966:0:(ldlm_lib.c:1192:target_handle_connect()) tfs-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5130.678769] LustreError: 245966:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 5130.712775] Lustre: tfs-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5130.715943] Lustre: Skipped 1 previous similar message [ 5132.354515] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 5135.783790] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5135.840263] Lustre: tfs-MDT0001: Not available for connect from 0@lo (not set up) [ 5135.843982] Lustre: Skipped 1 previous similar message [ 5137.461950] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 5138.633761] Lustre: 247108:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 5141.353976] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5143.825716] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 5145.635832] LustreError: 247461:0:(ldlm_lib.c:1192:target_handle_connect()) tfs-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5147.497633] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5149.887706] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 5155.818511] Lustre: tfs-OST0000: new connection from tfs-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49762 to 0x280000401:49792) [ 5159.191363] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 5160.677317] Lustre: 248978:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 5166.051955] Lustre: tfs-MDT0000-lwp-MDT0001: Connection to tfs-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5166.052654] Lustre: tfs-MDT0000: Not available for connect from 0@lo (stopping) [ 5166.056807] Lustre: Skipped 3 previous similar messages [ 5166.062327] Lustre: Skipped 3 previous similar messages [ 5169.195231] Lustre: server umount tfs-MDT0000 complete [ 5170.714220] LustreError: 248980:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788908193 with bad export cookie 9649140738894053124 [ 5170.721729] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5170.840105] Lustre: server umount tfs-MDT0001 complete [ 5182.535256] Lustre: server umount tfs-OST0000 complete [ 5193.126278] Lustre: server umount tfs-OST0001 complete [ 5201.266550] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 5205.262816] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5205.454326] LustreError: 251224:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5205.479366] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5205.482198] Lustre: Skipped 3 previous similar messages [ 5207.035989] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 5210.458842] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5212.188592] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 5213.383711] Lustre: 252365:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 5215.977240] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5217.127813] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49762 to 0x280000401:49824) [ 5218.270565] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 5221.376071] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5223.374644] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 5226.409376] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 5227.583558] Lustre: 254232:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 5229.809596] Lustre: DEBUG MARKER: == conf-sanity test 104a: Make sure user defined options are reflected in mount ========================================================== 18:57:32 (1788908252) [ 5241.825745] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5241.826948] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5241.829981] Lustre: Skipped 2 previous similar messages [ 5241.833553] Lustre: Skipped 2 previous similar messages [ 5246.431942] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5246.435250] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5246.440884] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5247.837500] Lustre: server umount lustre-MDT0000 complete [ 5249.067141] LustreError: 251200:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788908272 with bad export cookie 9649140738894054566 [ 5249.069576] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5249.073650] LustreError: 251200:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 6 previous similar messages [ 5252.064402] LustreError: 251219:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5252.070981] LustreError: 251219:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 4 previous similar messages [ 5259.232546] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 5259.234897] Lustre: Skipped 8 previous similar messages [ 5263.327100] Lustre: lustre-MDT0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 5263.413193] Lustre: server umount lustre-MDT0001 complete [ 5279.199136] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 5279.235626] Lustre: server umount lustre-OST0000 complete [ 5286.618740] Lustre: server umount lustre-OST0001 complete [ 5289.119489] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_hostid [ 5292.919062] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 5306.813393] LDISKFS-fs (dm-0): Mount option "noacl" will be removed by 3.5 [ 5306.813393] Contact linux-ldiskfs@vger.kernel.org if you think we should keep it. [ 5306.813393] [ 5306.822276] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: acl,user_xattr,errors=remount-ro,noacl,no_mbcache,nodelalloc [ 5306.905740] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 5306.917384] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 5306.956262] Lustre: lustre-MDT0000: new disk, initializing [ 5306.980610] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5306.983476] Lustre: Skipped 3 previous similar messages [ 5306.988693] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 5308.425898] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 5312.943726] LDISKFS-fs (dm-1): Mount option "noacl" will be removed by 3.5 [ 5312.943726] Contact linux-ldiskfs@vger.kernel.org if you think we should keep it. [ 5312.943726] [ 5312.955106] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: acl,user_xattr,errors=remount-ro,noacl,no_mbcache,nodelalloc [ 5312.996634] Lustre: 257409:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 5313.021705] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 5313.023726] Lustre: Skipped 1 previous similar message [ 5313.059405] Lustre: lustre-MDT0001: new disk, initializing [ 5313.110362] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 5313.115869] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 5314.618436] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 5319.123557] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5319.247942] Lustre: lustre-OST0000: new disk, initializing [ 5319.250572] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 5319.254642] Lustre: 258997:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 5321.154427] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 5321.159178] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 5321.209258] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 5321.799581] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 5326.460362] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5326.529368] Lustre: lustre-OST0001: new disk, initializing [ 5326.532097] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 5326.535569] Lustre: 259867:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 5328.137199] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 5328.141732] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 5328.179083] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 5328.729646] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 5333.075406] Lustre: DEBUG MARKER: == conf-sanity test 104b: Mount uses last flock argument ========================================================== 18:59:15 (1788908355) [ 5336.846482] Lustre: DEBUG MARKER: == conf-sanity test 105: check file creation for ro and rw bind mnt pt ========================================================== 18:59:19 (1788908359) [ 5348.836289] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5348.837176] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5348.843954] Lustre: Skipped 3 previous similar messages [ 5348.849820] Lustre: Skipped 1 previous similar message [ 5354.432401] Lustre: server umount lustre-OST0000 complete [ 5359.076051] LustreError: 260394:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5359.078198] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5359.086193] LustreError: 260394:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 4 previous similar messages [ 5370.335147] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 5370.405921] Lustre: server umount lustre-MDT0000 complete [ 5371.806397] LustreError: 260737:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788908394 with bad export cookie 9649140738894055896 [ 5371.810949] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5371.811536] LustreError: 260737:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 5374.432425] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5374.436299] Lustre: Skipped 3 previous similar messages [ 5381.600385] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 5381.602708] Lustre: Skipped 13 previous similar messages [ 5386.207138] Lustre: lustre-MDT0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 5386.308186] Lustre: server umount lustre-MDT0001 complete [ 5389.897180] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing unload_modules_local [ 5399.699660] Lustre: server umount lustre-OST0001 complete [ 5401.737262] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_hostid [ 5408.378582] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 5420.180049] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5420.257357] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 5420.266151] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 5420.302148] Lustre: lustre-MDT0000: new disk, initializing [ 5420.326278] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 5421.686850] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 5425.942780] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5425.994862] Lustre: 264394:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 5426.099291] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 5427.512951] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 5431.377913] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 5433.230357] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 5435.679055] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5435.790028] Lustre: 266362:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 5435.824360] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5435.828156] Lustre: Skipped 5 previous similar messages [ 5437.242219] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 5437.246800] Lustre: Skipped 1 previous similar message [ 5437.249604] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 5437.285221] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 5437.863808] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 5441.632396] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 5447.648944] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 5447.649792] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5447.651458] LustreError: Skipped 1 previous similar message [ 5447.656784] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5447.660204] Lustre: Skipped 1 previous similar message [ 5450.067769] Lustre: server umount lustre-OST0000 complete [ 5451.744163] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5457.568451] Lustre: server umount lustre-MDT0000 complete [ 5458.987236] LustreError: 266361:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788908481 with bad export cookie 9649140738894057366 [ 5458.989680] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5458.992602] LustreError: 266361:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 5459.125584] Lustre: server umount lustre-MDT0001 complete [ 5463.067185] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing unload_modules_local [ 5464.185045] Key type lgssc unregistered [ 5464.322512] LNet: 268131:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5464.326798] LNetError: 268131:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5464.336414] LNet: Removed LNI 192.168.203.143@tcp [ 5464.683123] Key type .llcrypt unregistered [ 5464.684727] Key type ._llcrypt unregistered [ 5475.267285] Key type ._llcrypt registered [ 5475.268862] Key type .llcrypt registered [ 5475.303290] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 5475.624690] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5475.636469] alg: No test for adler32 (adler32-zlib) [ 5476.504407] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 5476.598680] LNet: Added LNI 192.168.203.143@tcp [8/256/0/180] [ 5478.175163] Key type lgssc registered [ 5478.563431] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5481.373567] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5481.381224] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5482.535721] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5483.938947] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 5486.795821] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5486.922557] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5488.384123] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 5490.958209] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 5493.049583] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 5495.654084] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5495.808321] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5498.025118] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 5500.932340] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 5501.322412] Lustre: Setting parameter lustre-OST0000.ost.unknown_param=50 in log lustre-OST0000 [ 5502.124551] Lustre: server umount lustre-OST0000 complete [ 5507.041336] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5507.043448] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5507.047666] Lustre: Skipped 1 previous similar message [ 5507.052823] Lustre: Skipped 1 previous similar message [ 5509.733402] Lustre: server umount lustre-MDT0000 complete [ 5511.191273] LustreError: 269551:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788908534 with bad export cookie 9298155950553209777 [ 5511.193853] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5511.197892] LustreError: 269551:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 5521.445579] Lustre: server umount lustre-MDT0001 complete [ 5525.800502] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing unload_modules_local [ 5527.048254] Key type lgssc unregistered [ 5527.192995] LNet: 273155:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5527.198792] LNetError: 273155:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5527.211772] LNet: Removed LNI 192.168.203.143@tcp [ 5527.573552] Key type .llcrypt unregistered [ 5527.576336] Key type ._llcrypt unregistered [ 5535.108296] Key type ._llcrypt registered [ 5535.109743] Key type .llcrypt registered [ 5535.155636] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 5535.602828] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5535.665288] alg: No test for adler32 (adler32-zlib) [ 5536.560731] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 5536.670247] LNet: Added LNI 192.168.203.143@tcp [8/256/0/180] [ 5538.287697] Key type lgssc registered [ 5539.032540] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5543.792714] Lustre: lustre-OST0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5543.825308] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5559.520433] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 5564.639591] LustreError: 274325:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.203.143@tcp: failed processing log, type 4: rc = -110 [ 5591.332952] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5598.839993] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 5605.362199] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 5607.053575] Lustre: server umount lustre-OST0000 complete [ 5616.746805] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing unload_modules_local [ 5618.432768] Key type lgssc unregistered [ 5618.652655] LNet: 275955:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5618.661498] LNetError: 275955:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5618.683746] LNet: Removed LNI 192.168.203.143@tcp [ 5619.222113] Key type .llcrypt unregistered [ 5619.225223] Key type ._llcrypt unregistered [ 5641.686108] Key type ._llcrypt registered [ 5641.687512] Key type .llcrypt registered [ 5641.737177] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 5642.149324] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5642.193881] alg: No test for adler32 (adler32-zlib) [ 5643.078480] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 5643.188689] LNet: Added LNI 192.168.203.143@tcp [8/256/0/180] [ 5644.783223] Key type lgssc registered [ 5645.339995] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5652.546940] loop0: detected capacity change from 0 to 204800000 [ 5652.705579] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 5652.711578] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 5652.907350] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 5653.464414] loop0: detected capacity change from 0 to 204800000 [ 5653.568910] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 5653.576711] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 5653.805643] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 5654.478558] loop0: detected capacity change from 0 to 204800000 [ 5654.576334] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 5654.586895] blk_update_request: operation not supported error, dev loop0, sector 8224 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 5654.666879] blk_update_request: operation not supported error, dev loop0, sector 58264 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 5655.290569] loop0: detected capacity change from 0 to 204800000 [ 5655.381587] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 5656.022704] loop0: detected capacity change from 0 to 204800000 [ 5656.038655] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 5658.630602] loop0: detected capacity change from 0 to 204800000 [ 5658.661902] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 5660.994688] loop0: detected capacity change from 0 to 204800000 [ 5661.013404] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 5663.097484] loop0: detected capacity change from 0 to 204800000 [ 5663.115426] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 5665.423506] loop0: detected capacity change from 0 to 204800000 [ 5665.481982] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5665.502834] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5665.553947] Lustre: 279348:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 5665.561537] Lustre: 279348:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000003:0xa:0x0]: rc = 0 [ 5665.567141] Lustre: 279348:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000-MDT0000' with [0x200000005:0x2:0x0]: rc = 0 [ 5665.572706] Lustre: 279348:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000003:0xc:0x0]: rc = 0 [ 5665.578091] Lustre: 279348:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000003:0xb:0x0]: rc = 0 [ 5665.585825] Lustre: 279348:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000-MDT0000' with [0x200000005:0x3:0x0]: rc = 0 [ 5665.591662] Lustre: 279348:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000-MDT0000' with [0x200000005:0x1:0x0]: rc = 0 [ 5665.598352] Lustre: 279348:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index 'nodemap' with [0x200000003:0x3:0x0]: rc = 0 [ 5665.604616] Lustre: 279348:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000006:0x10000:0x0]: rc = 0 [ 5665.609876] Lustre: 279348:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000006:0x2010000:0x0]: rc = 0 [ 5665.619112] Lustre: 279348:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000006:0x1010000:0x0]: rc = 0 [ 5665.625443] Lustre: 279348:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x20000' with [0x200000006:0x20000:0x0]: rc = 0 [ 5665.631649] Lustre: 279348:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2020000' with [0x200000006:0x2020000:0x0]: rc = 0 [ 5665.637553] Lustre: 279348:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1020000' with [0x200000006:0x1020000:0x0]: rc = 0 [ 5669.410416] Lustre: server umount MGS complete [ 5669.905651] loop0: detected capacity change from 0 to 204800000 [ 5669.966253] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5670.217950] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5670.243595] Lustre: lustre-MDT0000: Aborting client recovery [ 5670.806337] loop1: detected capacity change from 0 to 204800000 [ 5670.896334] LDISKFS-fs (loop1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5670.961526] Lustre: 279778:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 5670.972414] Lustre: 279778:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x2010000' with [0x200000003:0x6:0x0]: rc = 0 [ 5670.989273] Lustre: 279778:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x10000-MDT0001' with [0x200000005:0x1:0x0]: rc = 0 [ 5670.999470] Lustre: 279778:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x2010000-MDT0001' with [0x200000005:0x3:0x0]: rc = 0 [ 5671.009837] Lustre: 279778:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x1010000' with [0x200000003:0x5:0x0]: rc = 0 [ 5671.019958] Lustre: 279778:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x10000' with [0x200000003:0x4:0x0]: rc = 0 [ 5671.027498] Lustre: 279778:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x1010000-MDT0001' with [0x200000005:0x2:0x0]: rc = 0 [ 5671.040425] Lustre: Found index 1 for lustre-MDT0001, updating log [ 5671.166401] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5671.205958] Lustre: lustre-MDT0001: Aborting client recovery [ 5671.820911] loop2: detected capacity change from 0 to 204800000 [ 5671.888308] LDISKFS-fs (loop2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5671.939297] Lustre: 279857:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 5671.945428] Lustre: 279857:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x1020000-OST0000' with [0x200000005:0x2:0x0]: rc = 0 [ 5671.951773] Lustre: 279857:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x20000-OST0000' with [0x200000005:0x1:0x0]: rc = 0 [ 5671.958754] Lustre: 279857:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 5671.964800] Lustre: 279857:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 5671.971657] Lustre: 279857:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x2020000-OST0000' with [0x200000005:0x3:0x0]: rc = 0 [ 5671.978621] Lustre: 279857:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 5672.053803] Lustre: Found index 0 for lustre-OST0000, updating log [ 5672.073784] Lustre: 279875:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 5672.128489] Lustre: lustre-OST0000: Aborting recovery [ 5672.651068] loop3: detected capacity change from 0 to 204800000 [ 5672.707114] LDISKFS-fs (loop3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5672.752861] Lustre: 279941:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 5672.759962] Lustre: 279941:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 5672.770896] Lustre: 279941:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 5672.778570] Lustre: 279941:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x1020000-OST0001' with [0x200000005:0x2:0x0]: rc = 0 [ 5672.786291] Lustre: 279941:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 5672.792469] Lustre: 279941:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x20000-OST0001' with [0x200000005:0x1:0x0]: rc = 0 [ 5672.797983] Lustre: 279941:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x2020000-OST0001' with [0x200000005:0x3:0x0]: rc = 0 [ 5672.829647] Lustre: 279947:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 5672.856091] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 5672.859963] Lustre: Skipped 1 previous similar message [ 5672.869905] Lustre: lustre-OST0001: Aborting recovery [ 5678.104202] LustreError: 279722:0:(lod_dev.c:511:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 8, retries 0, failed: rc = -108 [ 5680.100744] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 5680.123971] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 5680.134301] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000bd0 [ 5680.154978] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000bd0 [ 5681.121735] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:5 to 0x280000400:33) [ 5681.124547] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:5 to 0x2c0000400:33) [ 5685.299328] LustreError: 279689:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0000: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0000 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0000/identity_upcall, time 6111us: rc = -2 [ 5685.837287] LustreError: 279690:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0001: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0001 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0001/identity_upcall, time 542us: rc = -2 [ 5685.854168] LustreError: 279690:0:(mdt_identity.c:115:mdt_identity_do_upcall()) Skipped 37 previous similar messages [ 5701.600577] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5701.601291] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5701.607206] Lustre: Skipped 2 previous similar messages [ 5701.610437] Lustre: Skipped 1 previous similar message [ 5703.354524] Lustre: server umount lustre-MDT0000 complete [ 5703.828779] LustreError: 279783:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788908726 with bad export cookie 9292841601113128680 [ 5703.830194] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5703.834140] LustreError: 279783:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 5706.725113] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5706.732264] LustreError: 279883:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5706.732870] Lustre: Skipped 2 previous similar messages [ 5706.732945] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 5706.732949] Lustre: Skipped 2 previous similar messages [ 5706.762467] LustreError: 279883:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [ 5708.768101] LustreError: 279687:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5708.768274] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 5708.779589] LustreError: 279687:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 5708.790245] Lustre: Skipped 2 previous similar messages [ 5710.144066] Lustre: server umount lustre-MDT0001 complete [ 5716.714804] Lustre: server umount lustre-OST0000 complete [ 5723.516671] Lustre: server umount lustre-OST0001 complete [ 5728.072198] Lustre: DEBUG MARKER: == conf-sanity test 109a: test lctl clear_conf fsname ==== 19:05:50 (1788908750) [ 5745.219874] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_hostid [ 5751.125957] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 5773.997766] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5774.161130] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 5774.182366] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 5774.258345] Lustre: lustre-MDT0000: new disk, initializing [ 5774.318743] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5774.330169] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 5776.901885] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 5783.752923] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5783.830765] Lustre: 284009:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 5783.884720] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 5783.888633] Lustre: Skipped 1 previous similar message [ 5783.941248] Lustre: lustre-MDT0001: new disk, initializing [ 5784.013591] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5784.044292] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 5784.050644] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 5786.812318] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 5792.906772] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 5796.420787] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 5800.559807] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5800.744302] Lustre: lustre-OST0000: new disk, initializing [ 5800.747452] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 5800.755968] Lustre: 285975:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 5800.813847] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5804.740364] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 5807.146280] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 5807.153339] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 5807.272341] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 5810.951834] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 5814.473171] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 5823.034173] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 5830.414694] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 5836.658806] Lustre: Modifying parameter lustre-client.llite.max_read_ahead_mb=64 in log lustre-client [ 5879.264125] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 5879.266980] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5879.273365] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5879.277586] Lustre: Skipped 1 previous similar message [ 5879.287356] Lustre: Skipped 1 previous similar message [ 5884.386863] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5884.389551] Lustre: Skipped 1 previous similar message [ 5885.370569] Lustre: server umount lustre-OST0000 complete [ 5889.507241] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5893.852655] Lustre: server umount lustre-MDT0000 complete [ 5894.625449] LustreError: 284808:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5894.632710] LustreError: 284808:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 5896.092638] LustreError: 284802:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788908919 with bad export cookie 9292841601113131382 [ 5896.095990] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5896.102665] LustreError: 284802:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 5896.298541] Lustre: server umount lustre-MDT0001 complete [ 5901.736877] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5904.730720] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 5907.714713] Lustre: server umount MGS complete [ 5914.311742] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5914.583109] LustreError: 289934:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5914.597578] LustreError: 289947:0:(qmt_pool.c:1645:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 5914.633210] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5916.817079] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 5919.716783] LustreError: 289935:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5921.822727] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5924.720750] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 5928.947503] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 5932.456046] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 5936.525444] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5940.197113] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 5944.153275] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 5970.912744] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 5970.919126] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5970.929691] Lustre: Skipped 1 previous similar message [ 5970.933709] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5970.936544] Lustre: Skipped 2 previous similar messages [ 5972.964784] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 5974.452537] Lustre: server umount lustre-OST0000 complete [ 5982.942366] Lustre: server umount lustre-MDT0000 complete [ 5983.201494] LustreError: 292772:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5983.213924] LustreError: 292772:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 5985.170475] LustreError: 292659:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788909008 with bad export cookie 9292841601113133230 [ 5985.175105] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5985.177633] LustreError: 292659:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 5985.367200] Lustre: server umount lustre-MDT0001 complete [ 5991.516204] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing unload_modules_local [ 5993.193445] Key type lgssc unregistered [ 5993.431716] LNet: 293877:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5993.442233] LNetError: 293877:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5993.460367] LNet: Removed LNI 192.168.203.143@tcp [ 5994.059560] Key type .llcrypt unregistered [ 5994.061950] Key type ._llcrypt unregistered [ 6015.822927] Key type ._llcrypt registered [ 6015.825141] Key type .llcrypt registered [ 6015.882497] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_hostid [ 6024.051252] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 6024.608438] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6024.637283] alg: No test for adler32 (adler32-zlib) [ 6025.538986] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 6025.661361] LNet: Added LNI 192.168.203.143@tcp [8/256/0/180] [ 6027.271149] Key type lgssc registered [ 6027.820970] Lustre: Echo OBD driver; http://www.lustre.org/ [ 6045.093440] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 6045.115820] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6046.227678] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 6046.244864] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 6046.284470] Lustre: lustre-MDT0000: new disk, initializing [ 6046.352727] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6046.360732] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 6048.017437] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 6053.176126] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6053.233682] Lustre: 297810:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 6053.277503] Lustre: lustre-MDT0001: Not available for connect from 0@lo (not set up) [ 6053.278948] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 6053.284386] Lustre: Skipped 1 previous similar message [ 6053.330479] Lustre: lustre-MDT0001: new disk, initializing [ 6053.382503] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6053.404584] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 6053.409439] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 6055.142319] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 6059.793520] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 6062.455141] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 6065.647966] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6065.786548] Lustre: lustre-OST0000: new disk, initializing [ 6065.789061] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 6065.791992] Lustre: 299781:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 6065.840956] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6068.509349] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 6069.057424] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 6069.062358] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 6069.122987] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 6073.381583] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 6077.327256] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 6087.736703] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 6094.440377] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 6100.199489] Lustre: Modifying parameter lustre-client.llite.max_read_ahead_mb=64 in log lustre-client [ 6140.898322] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6140.898726] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 6140.899951] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6140.904345] Lustre: Skipped 1 previous similar message [ 6140.908533] LustreError: Skipped 1 previous similar message [ 6146.017764] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6146.024810] Lustre: Skipped 2 previous similar messages [ 6151.137556] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6151.141904] Lustre: Skipped 1 previous similar message [ 6155.231131] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 6155.326662] Lustre: server umount lustre-OST0000 complete [ 6160.864192] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 6160.866562] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6160.871309] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6163.116509] Lustre: server umount lustre-MDT0000 complete [ 6164.725366] LustreError: 297801:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788909187 with bad export cookie 9240844028178486601 [ 6164.725936] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6164.729601] LustreError: 297801:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 6164.880754] Lustre: server umount lustre-MDT0001 complete [ 6168.707589] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6170.485138] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 6172.777963] Lustre: server umount MGS complete [ 6178.152981] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6178.380937] LustreError: 303845:0:(qmt_pool.c:1645:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 6178.417604] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6180.330833] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 6183.904946] LustreError: 303833:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6183.914311] LustreError: 303833:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 6184.814266] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6185.002709] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6186.787857] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 6190.098682] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 6192.749177] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 6195.680174] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6195.867110] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6198.578747] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 6201.816402] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 6223.840536] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 6223.845330] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6223.850952] Lustre: Skipped 1 previous similar message [ 6223.854059] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6223.856327] Lustre: Skipped 2 previous similar messages [ 6226.023757] Lustre: server umount lustre-OST0000 complete [ 6229.985138] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6229.991103] Lustre: Skipped 2 previous similar messages [ 6233.692610] Lustre: server umount lustre-MDT0000 complete [ 6235.105484] LustreError: 303829:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6235.111477] LustreError: 303829:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 6235.164441] LustreError: 303813:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788909258 with bad export cookie 9240844028178488456 [ 6235.167240] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6235.171149] LustreError: 303813:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 6235.307646] Lustre: server umount lustre-MDT0001 complete [ 6239.958915] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing unload_modules_local [ 6241.226347] Key type lgssc unregistered [ 6241.377380] LNet: 307772:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6241.381457] LNetError: 307772:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6241.388330] LNet: Removed LNI 192.168.203.143@tcp [ 6241.768216] Key type .llcrypt unregistered [ 6241.770287] Key type ._llcrypt unregistered [ 6250.845808] Key type ._llcrypt registered [ 6250.847571] Key type .llcrypt registered [ 6250.899529] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_hostid [ 6257.810119] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 6258.401727] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6258.423612] alg: No test for adler32 (adler32-zlib) [ 6259.323343] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 6259.455514] LNet: Added LNI 192.168.203.143@tcp [8/256/0/180] [ 6261.055253] Key type lgssc registered [ 6261.553855] Lustre: Echo OBD driver; http://www.lustre.org/ [ 6272.614734] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 6280.058589] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 6280.077466] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6281.195318] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 6281.217737] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 6281.267518] Lustre: lustre-MDT0000: new disk, initializing [ 6281.314696] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6281.324358] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 6283.353718] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 6289.672500] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6289.816313] Lustre: lustre-OST0000: new disk, initializing [ 6289.819231] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 6289.822944] Lustre: Skipped 1 previous similar message [ 6289.826654] Lustre: 311798:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 6289.863655] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6290.368525] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 6290.373622] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 6290.393196] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 6293.034250] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 6679.911812] Lustre: server umount lustre-MDT0000 complete [ 6681.882427] LustreError: 311797:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788909704 with bad export cookie 16399569054925343327 [ 6681.890494] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6691.387740] Lustre: server umount lustre-OST0000 complete [ 6703.476858] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_hostid [ 6708.267179] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 6724.673333] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6724.789621] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 6724.805795] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 6724.847597] Lustre: lustre-MDT0000: new disk, initializing [ 6724.883165] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6724.891705] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 6726.888517] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 6732.201717] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6732.249417] Lustre: 316052:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 6732.278199] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 6732.280334] Lustre: Skipped 1 previous similar message [ 6732.321608] Lustre: lustre-MDT0001: new disk, initializing [ 6732.362457] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6732.380374] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 6732.386832] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 6734.200579] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 6738.626855] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 6740.940195] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 6743.991542] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6744.142551] Lustre: lustre-OST0000: new disk, initializing [ 6744.145801] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 6744.149217] Lustre: 318019:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 6744.210432] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6746.822419] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 6746.829485] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 6746.880617] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 6746.888274] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 6751.512186] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 6753.332881] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 6753.415338] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 6755.046210] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 6755.140116] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 6757.345342] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 6757.346449] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6757.349126] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6757.352150] Lustre: Skipped 1 previous similar message [ 6762.466219] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6762.469194] Lustre: Skipped 2 previous similar messages [ 6767.585398] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6767.587982] Lustre: Skipped 1 previous similar message [ 6770.143664] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 6770.213385] Lustre: server umount lustre-OST0000 complete [ 6772.705263] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6772.706417] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6772.709887] Lustre: Skipped 1 previous similar message [ 6777.829344] Lustre: server umount lustre-MDT0000 complete [ 6779.584202] LustreError: 316044:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788909802 with bad export cookie 16399569054928284104 [ 6779.587725] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6779.588967] LustreError: 316044:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 6779.733508] Lustre: server umount lustre-MDT0001 complete [ 6781.261789] Lustre: DEBUG MARKER: SKIP: conf-sanity test_111 skipping SLOW test 111 [ 6781.990457] Lustre: DEBUG MARKER: == conf-sanity test 112a: mount OST with no_create option ========================================================== 19:23:24 (1788909804) [ 6784.912756] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6785.119778] LustreError: 320331:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6785.128675] LustreError: 320331:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [ 6785.158376] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6786.988860] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 6790.624400] LustreError: 320332:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6790.839171] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6792.821916] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 6796.081465] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 6798.595504] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 6801.737464] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6801.917435] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6801.921653] Lustre: Skipped 1 previous similar message [ 6804.498884] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 6807.758767] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 6810.880574] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6810.968836] Lustre: lustre-OST0001: new disk, initializing [ 6810.971569] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 6810.976140] Lustre: 323164:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 6813.977508] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 6819.695886] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 6819.841390] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 6820.379512] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 6820.385780] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 6820.407080] LustreError: 324009:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 6821.474484] LustreError: 324009:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 6821.479824] LustreError: 324009:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 2 previous similar messages [ 6822.498534] LustreError: 324009:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 6822.502572] LustreError: 324009:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 1 previous similar message [ 6822.759920] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff89c848731000.ost_server_uuid 50 [ 6823.598054] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff89c848731000.ost_server_uuid in FULL state after 0 sec [ 6824.546673] LustreError: 324013:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [ 6824.551038] LustreError: 324013:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 3 previous similar messages [ 6826.341742] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff89c848731000.ost_server_uuid 50 [ 6827.189620] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-ffff89c848731000.ost_server_uuid in FULL state after 0 sec [ 6828.651471] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 6840.809630] Lustre: lustre-OST0001-osc-MDT0001: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6840.813756] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 6840.816691] Lustre: Skipped 1 previous similar message [ 6840.821046] Lustre: Skipped 2 previous similar messages [ 6845.630385] Lustre: server umount lustre-OST0001 complete [ 6845.923198] LustreError: 322145:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6845.930417] LustreError: 322145:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 6851.043593] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6851.046451] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 6851.047954] LustreError: 322148:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6851.048584] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6851.048588] Lustre: Skipped 1 previous similar message [ 6851.051256] Lustre: Skipped 1 previous similar message [ 6851.055088] LustreError: Skipped 2 previous similar messages [ 6853.785807] Lustre: server umount lustre-OST0000 complete [ 6856.161979] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6856.167800] Lustre: Skipped 1 previous similar message [ 6861.544672] Lustre: server umount lustre-MDT0000 complete [ 6863.079256] LustreError: 320313:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788909886 with bad export cookie 16399569054928284986 [ 6863.081844] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6863.084590] LustreError: 320313:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 6863.220715] Lustre: server umount lustre-MDT0001 complete [ 6867.568607] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing unload_modules_local [ 6868.769817] Key type lgssc unregistered [ 6868.915659] LNet: 325846:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6868.919693] LNetError: 325846:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6868.926351] LNet: Removed LNI 192.168.203.143@tcp [ 6869.293710] Key type .llcrypt unregistered [ 6869.295545] Key type ._llcrypt unregistered [ 6880.696444] Key type ._llcrypt registered [ 6880.697666] Key type .llcrypt registered [ 6880.762337] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 6881.205751] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6881.238110] alg: No test for adler32 (adler32-zlib) [ 6882.138614] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 6882.249123] LNet: Added LNI 192.168.203.143@tcp [8/256/0/180] [ 6883.840198] Key type lgssc registered [ 6884.360764] Lustre: Echo OBD driver; http://www.lustre.org/ [ 6887.648953] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 6887.660142] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6888.887971] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6890.800371] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 6894.125747] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 6897.179047] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6897.362060] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6899.134247] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 6903.333845] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6903.482211] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6905.901694] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 6907.560206] LustreError: 329462:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6907.567966] LustreError: 329462:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 6909.079413] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 6911.849587] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6911.946881] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 6914.033392] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:65) [ 6914.034888] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:33) [ 6914.399804] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 6917.326047] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 6920.314373] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing wait_import_state (FULL|IDLE) os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [ 6920.410852] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 7001.057963] LustreError: lustre-OST0001-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 7001.060900] Lustre: lustre-OST0001-osc-MDT0001: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7001.065358] Lustre: Skipped 1 previous similar message [ 7001.066249] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 7001.068518] Lustre: Skipped 1 previous similar message [ 7005.694569] Lustre: server umount lustre-OST0001 complete [ 7006.177442] LustreError: 328921:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7006.184478] LustreError: 328921:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 7010.272403] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 7010.275799] LustreError: Skipped 1 previous similar message [ 7010.277891] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7010.283934] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7011.298690] LustreError: 328921:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7011.298811] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 7011.299256] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7011.302466] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7011.310381] LustreError: 328921:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 7013.458952] Lustre: server umount lustre-OST0000 complete [ 7015.392108] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7015.395486] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7015.400603] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7015.402941] Lustre: Skipped 1 previous similar message [ 7021.536580] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7021.538839] Lustre: Skipped 3 previous similar messages [ 7029.215111] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 7029.269878] LustreError: 331427:0:(ldlm_resource.c:1207:ldlm_resource_complain()) MGS: namespace resource [0x65727473756c:0x0:0x0].0x0 (00000000691ccfdb) refcount nonzero (1) after lock cleanup; forcing cleanup. [ 7031.352172] Lustre: server umount lustre-MDT0000 complete [ 7031.776415] LustreError: 328165:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7031.783765] LustreError: 328165:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 7032.908474] LustreError: 327223:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788910055 with bad export cookie 13343541627901219439 [ 7032.911739] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7032.913898] LustreError: 327223:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 7033.060742] Lustre: server umount lustre-MDT0001 complete [ 7037.103663] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing unload_modules_local [ 7038.331257] Key type lgssc unregistered [ 7038.472593] LNet: 332179:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7038.476201] LNetError: 332179:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7038.485652] LNet: Removed LNI 192.168.203.143@tcp [ 7038.835444] Key type .llcrypt unregistered [ 7038.836723] Key type ._llcrypt unregistered [ 7059.412512] Key type ._llcrypt registered [ 7059.413847] Key type .llcrypt registered [ 7059.466228] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 7059.908850] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7059.929258] alg: No test for adler32 (adler32-zlib) [ 7060.808718] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 7060.923984] LNet: Added LNI 192.168.203.143@tcp [8/256/0/180] [ 7062.511161] Key type lgssc registered [ 7062.904687] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7066.322679] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7066.330207] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7067.490363] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7068.941555] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 7071.922915] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7072.079482] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7073.680298] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 7074.728545] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 7077.029724] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7077.179849] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7078.180895] LustreError: 335931:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7078.184936] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:97) [ 7078.188809] LustreError: 335931:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 7079.399716] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 7082.278065] LustreError: 335930:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7082.286587] LustreError: 335930:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 7083.085912] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7083.177100] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 7085.405118] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 7088.616355] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:65) [ 7089.879578] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 7095.953713] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 7102.944828] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7102.948549] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7102.953895] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7103.970811] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7103.971312] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7103.973412] Lustre: Skipped 1 previous similar message [ 7103.980925] Lustre: Skipped 2 previous similar messages [ 7106.023790] Lustre: server umount lustre-MDT0000 complete [ 7107.573311] LustreError: 334426:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788910130 with bad export cookie 1415054804558842320 [ 7107.576651] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7107.577564] LustreError: 334426:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 7107.731737] Lustre: server umount lustre-MDT0001 complete [ 7119.557310] Lustre: server umount lustre-OST0000 complete [ 7130.147972] Lustre: server umount lustre-OST0001 complete [ 7136.006974] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 7139.580301] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7139.723090] LustreError: 339699:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7139.743139] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7141.154973] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 7144.186186] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7145.795055] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 7146.801463] Lustre: 340840:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 7149.234034] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7149.372875] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7149.375330] Lustre: Skipped 1 previous similar message [ 7150.372171] LustreError: 341195:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7150.374772] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:129) [ 7151.463557] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 7154.469288] LustreError: 341372:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7154.477142] LustreError: 341372:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 7154.492705] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7157.023164] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 7159.793241] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:97) [ 7160.859517] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 7162.223429] Lustre: 342707:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 7164.897360] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7164.900697] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7164.901118] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7164.901124] Lustre: Skipped 3 previous similar messages [ 7164.901914] Lustre: Skipped 2 previous similar messages [ 7169.440145] Lustre: server umount lustre-MDT0000 complete [ 7170.017504] LustreError: 339700:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7170.023938] LustreError: 339700:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [ 7170.873909] LustreError: 339680:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788910193 with bad export cookie 1415054804558843979 [ 7170.877358] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7170.878530] LustreError: 339680:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 7171.003291] Lustre: server umount lustre-MDT0001 complete [ 7182.339651] Lustre: server umount lustre-OST0000 complete [ 7193.939692] Lustre: server umount lustre-OST0001 complete [ 7195.066580] Lustre: DEBUG MARKER: SKIP: conf-sanity test_114 skipping SLOW test 114 [ 7195.532986] Lustre: DEBUG MARKER: SKIP: conf-sanity test_115 skipping excluded test 115 [ 7196.054108] Lustre: DEBUG MARKER: == conf-sanity test 116: big size MDT support ============ 19:30:18 (1788910218) [ 7203.351436] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 7206.450569] loop0: detected capacity change from 0 to 1099511627776 [ 7206.596313] SGI XFS with ACLs, security attributes, quota, no debug enabled [ 7206.599534] *** VALIDATE xfs *** [ 7206.605094] XFS (loop0): Mounting V5 Filesystem [ 7206.614888] XFS (loop0): Ending clean mount [ 7207.050677] loop1: detected capacity change from 0 to 18691697672192 [ 7228.701384] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_hostid [ 7232.550583] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 7245.528205] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7245.613201] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 7245.624584] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 7245.663140] Lustre: lustre-MDT0000: new disk, initializing [ 7245.685359] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7245.688635] Lustre: Skipped 1 previous similar message [ 7245.694573] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 7247.361446] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 7251.804090] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7251.854322] Lustre: 347816:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 7251.881088] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 7251.883336] Lustre: Skipped 1 previous similar message [ 7251.924601] Lustre: lustre-MDT0001: new disk, initializing [ 7251.983636] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 7251.988551] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 7253.561076] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 7257.722065] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 7259.689990] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 7262.113102] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7262.224783] Lustre: lustre-OST0000: new disk, initializing [ 7262.227377] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 7262.231206] Lustre: 349784:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 7264.191561] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 7264.196825] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 7264.238241] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 7264.349329] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 7268.326094] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 7270.005198] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 7270.086609] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 7271.726096] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 7271.806989] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 7274.468568] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7274.468877] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 7274.469603] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7274.469608] Lustre: Skipped 2 previous similar messages [ 7274.474123] Lustre: Skipped 2 previous similar messages [ 7274.476473] LustreError: Skipped 1 previous similar message [ 7278.629441] Lustre: server umount lustre-OST0000 complete [ 7282.655965] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7282.659683] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7282.664516] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7282.667021] Lustre: Skipped 1 previous similar message [ 7286.243848] Lustre: server umount lustre-MDT0000 complete [ 7287.637368] LustreError: 349783:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788910310 with bad export cookie 1415054804558845512 [ 7287.639486] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7287.641838] LustreError: 349783:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 7287.765874] Lustre: server umount lustre-MDT0001 complete [ 7290.992910] XFS (loop0): Unmounting Filesystem [ 7292.812192] Lustre: DEBUG MARKER: == conf-sanity test 117: lctl get_param return errors properly ========================================================== 19:31:55 (1788910315) [ 7295.238660] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7295.434619] LustreError: 352341:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7295.466194] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7295.468977] Lustre: Skipped 2 previous similar messages [ 7297.104314] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 7300.444277] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7302.174837] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 7305.086342] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 7307.110391] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 7309.630221] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7311.938485] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 7314.560369] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 7325.153787] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 7325.154270] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7325.161454] Lustre: Skipped 1 previous similar message [ 7325.163318] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7325.165863] Lustre: Skipped 3 previous similar messages [ 7329.563112] Lustre: server umount lustre-OST0000 complete [ 7337.113600] Lustre: server umount lustre-MDT0000 complete [ 7338.426299] LustreError: 353077:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788910361 with bad export cookie 1415054804558846387 [ 7338.429050] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7338.432565] LustreError: 353077:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 7338.552661] Lustre: server umount lustre-MDT0001 complete [ 7342.623385] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing unload_modules_local [ 7343.771395] Key type lgssc unregistered [ 7343.920613] LNet: 355967:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7343.924692] LNetError: 355967:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7343.931449] LNet: Removed LNI 192.168.203.143@tcp [ 7344.267102] Key type .llcrypt unregistered [ 7344.268145] Key type ._llcrypt unregistered [ 7355.951140] Key type ._llcrypt registered [ 7355.952183] Key type .llcrypt registered [ 7355.997363] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 7356.339883] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7356.377021] alg: No test for adler32 (adler32-zlib) [ 7357.263321] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 7357.370111] LNet: Added LNI 192.168.203.143@tcp [8/256/0/180] [ 7358.967138] Key type lgssc registered [ 7359.392072] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7362.120391] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7362.128648] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7363.307352] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7364.787540] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 7368.188122] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7368.334675] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7370.001663] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 7372.911704] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 7375.126842] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 7377.495955] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7377.605883] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7379.616932] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 7382.194431] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 7397.928066] Lustre: lustre-MDT0001: Not available for connect from 192.168.203.43@tcp (stopping) [ 7399.396109] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [ 7399.396280] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7399.399116] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 7399.401575] Lustre: Skipped 1 previous similar message [ 7399.405605] Lustre: Skipped 1 previous similar message [ 7401.689485] Lustre: server umount lustre-MDT0001 complete [ 7403.035780] LustreError: 357505:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.203.43@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7403.042690] LustreError: 357505:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 7404.513676] LustreError: 357508:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7404.522559] LustreError: 357508:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 7405.759079] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7405.814115] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [ 7405.816582] Lustre: Found index 1 for lustre-MDT0001, updating log [ 7405.840802] Lustre: 357499:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 7405.968109] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7407.599038] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 7411.173470] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 7411.179058] LustreError: 361188:0:(obd_mount.c:234:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [ 7411.182017] LustreError: 361188:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [ 7411.186163] LustreError: 357501:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [ 7411.203561] LustreError: 361191:0:(obd_config.c:2103:class_config_llog_handler()) MGC192.168.203.143@tcp: cfg command failed: rc = -17 [ 7411.207066] Lustre: cmd=cf001 0:lustre-MDT0001-osp-MDT0000 1:osp 2:lustre-MDT0000-mdtlov_UUID [ 7411.207066] [ 7713.251879] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [ 7713.253990] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7713.257479] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 7713.265723] Lustre: Skipped 1 previous similar message [ 7713.276387] Lustre: Skipped 1 previous similar message [ 7715.518662] Lustre: lustre-MDT0001: Not available for connect from 192.168.203.43@tcp (stopping) [ 7717.830649] Lustre: server umount lustre-MDT0001 complete [ 7718.371942] LustreError: 358249:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7718.392989] LustreError: 358249:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 7720.480668] LustreError: 358242:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.203.43@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7725.576548] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7725.608674] LustreError: 364458:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.203.43@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7725.628934] LustreError: 364458:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 7725.703757] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [ 7725.714590] Lustre: Found index 1 for lustre-MDT0001, updating log [ 7725.748220] Lustre: 357497:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 7726.109682] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7730.233175] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 7731.182588] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 7735.294740] LustreError: 373232:0:(obd_mount.c:234:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [ 7735.301232] LustreError: 373232:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [ 7735.308329] LustreError: 357501:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [ 7735.313583] LustreError: 357501:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [ 7735.364370] LustreError: 373240:0:(obd_config.c:761:class_setup()) osp: device 8 already setup: rc = -17 [ 7735.368254] LustreError: 373240:0:(obd_config.c:866:class_detach()) OBD device 8 still set up [ 7735.371244] LustreError: 373240:0:(obd_config.c:2103:class_config_llog_handler()) MGC192.168.203.143@tcp: cfg command failed: rc = -17 [ 7735.375665] Lustre: cmd=cf003 0:lustre-MDT0001-osp-MDT0000 1:lustre-MDT0001_UUID 2:192.168.203.143@tcp [ 7735.375665] [ 8037.932150] Lustre: lustre-MDT0001: Not available for connect from 192.168.203.43@tcp (stopping) [ 8038.371333] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [ 8038.371924] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8038.385068] Lustre: Skipped 1 previous similar message [ 8040.371972] Lustre: server umount lustre-MDT0001 complete [ 8043.040894] LustreError: 359509:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.203.43@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8045.496741] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8045.551394] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [ 8045.554415] Lustre: Found index 1 for lustre-MDT0001, updating log [ 8045.572975] Lustre: 357496:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8045.724724] Lustre: lustre-MDT0001: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [ 8047.484781] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 8051.180476] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 8055.271113] LustreError: 383736:0:(obd_mount.c:234:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [ 8055.274326] LustreError: 383736:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [ 8055.278629] LustreError: 357501:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [ 8055.281322] LustreError: 357501:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [ 8055.312272] LustreError: 383739:0:(lod_lov.c:210:lod_add_device()) lustre-MDT0001-osp-MDT0000: cannot connect to next dev lustre-MDT0001_UUID (-114) [ 8055.319330] LustreError: 383739:0:(obd_config.c:2103:class_config_llog_handler()) MGC192.168.203.143@tcp: cfg command failed: rc = -114 [ 8055.323874] Lustre: cmd=cf014 0:lustre-MDT0000-mdtlov 1:lustre-MDT0001_UUID 2:1 3:1 [ 8055.323874] [ 8363.489815] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8363.489843] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8363.491580] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8363.501290] Lustre: Skipped 4 previous similar messages [ 8367.470340] Lustre: server umount lustre-MDT0000 complete [ 8368.610412] LustreError: 357504:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8368.617708] LustreError: 357504:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 4 previous similar messages [ 8368.887355] LustreError: 360713:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788911391 with bad export cookie 18183756781797374411 [ 8368.892526] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8373.728379] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8373.732200] Lustre: Skipped 2 previous similar messages [ 8375.104304] Lustre: server umount lustre-MDT0001 complete [ 8376.501524] Lustre: server umount lustre-OST0000 complete [ 8379.574983] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_hostid [ 8382.936687] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 8394.885300] Lustre: DEBUG MARKER: == conf-sanity test 120: cross-target rename should not create bad symlinks ========================================================== 19:50:17 (1788911417) [ 8397.062339] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8397.149981] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 8397.161961] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 8397.197855] Lustre: lustre-MDT0000: new disk, initializing [ 8397.219751] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8397.226140] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 8398.601890] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 8402.921634] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8402.966414] Lustre: 397897:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8402.991306] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 8402.993657] Lustre: Skipped 1 previous similar message [ 8403.032351] Lustre: lustre-MDT0001: new disk, initializing [ 8403.069682] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8403.081645] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 8403.085319] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 8404.426987] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 8408.050890] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 8409.805087] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 8411.995096] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8412.096544] LustreError: 399847:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8412.102046] LustreError: 399847:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 8412.102790] Lustre: lustre-OST0000: new disk, initializing [ 8412.107099] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 8412.109656] Lustre: 399870:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8412.135957] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8413.881783] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug -1 all [ 8417.268296] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 8417.271485] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 8417.281565] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000400 [ 8417.438242] Lustre: DEBUG MARKER: oleg343-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 8426.465263] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8426.466732] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8426.471080] Lustre: Skipped 2 previous similar messages [ 8426.473093] Lustre: Skipped 2 previous similar messages [ 8430.168243] Lustre: server umount lustre-MDT0000 complete [ 8431.380141] LustreError: 397891:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788911454 with bad export cookie 18183756781797376350 [ 8431.383395] LustreError: MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8431.383675] LustreError: 398703:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0000-osp-MDT0001: osp_attr_get update error [0x200000401:0x2:0x0]: rc = -5 [ 8431.383883] LustreError: 397891:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 8 previous similar messages [ 8431.503214] Lustre: server umount lustre-MDT0001 complete [ 8443.046781] Lustre: server umount lustre-OST0000 complete [ 8452.771716] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing set_hostid [ 8455.935227] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local [ 8466.443030] Lustre: DEBUG MARKER: == conf-sanity test complete, duration 8195 sec ========== 19:51:29 (1788911489) [ 8467.072171] Lustre: DEBUG MARKER: === conf-sanity: start cleanup 19:51:29 (1788911489) === [ 8468.316863] Lustre: DEBUG MARKER: === conf-sanity: finish cleanup 19:51:30 (1788911490) === [ 8482.707917] Lustre: DEBUG MARKER: oleg343-server.virtnet: executing unload_modules_local [ 8483.850718] Key type lgssc unregistered [ 8483.982329] LNet: 406222:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8483.984911] LNetError: 406222:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8483.994275] LNet: Removed LNI 192.168.203.143@tcp [ 8484.305281] Key type .llcrypt unregistered [ 8484.306259] Key type ._llcrypt unregistered