[ 0.000000] Linux version 4.18.0rh8.10-debug (green@maintenance) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-26) (GCC)) #2 SMP Mon Jul 14 01:24:22 EDT 2025 [ 0.000000] Command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffcdfff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffce000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x0000000146dfffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.8 present. [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 [ 0.000000] Hypervisor detected: KVM [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 555728093 cycles [ 0.000000] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns [ 0.000000] tsc: Detected 2399.998 MHz processor [ 0.000000] last_pfn = 0x146e00 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0xbffce max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000f54b0-0x000f54bf] [ 0.000000] RAMDISK: [mem 0xbcc54000-0xbffbffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F52D0 000014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 0x00000000BFFE247C 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 0x00000000BFFE2318 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 0x00000000BFFE0040 0022D8 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 0x00000000BFFE0000 000040 [ 0.000000] ACPI: APIC 0x00000000BFFE238C 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: HPET 0x00000000BFFE241C 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: WAET 0x00000000BFFE2454 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0xbffe2318-0xbffe238b] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe2317] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0xbffe238c-0xbffe241b] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0xbffe241c-0xbffe2453] [ 0.000000] ACPI: Reserving WAET table memory at [mem 0xbffe2454-0xbffe247b] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x0000000146dfffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x1465a3000-0x1465cdfff] [ 0.000000] Reserving 256MB of memory at 2752MB for crashkernel (System RAM: 4205MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009efff] [ 0.000000] node 0: [mem 0x0000000000100000-0x00000000bffcdfff] [ 0.000000] node 0: [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Zeroed struct page in unavailable ranges: 4756 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x0000000146dfffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] TSC deadline timer available [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] kvm-guest: KVM setup pv remote TLB flush [ 0.000000] kvm-guest: setup PV sched yield [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbffce000-0xbfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.000000] [mem 0xc0000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u524288 [ 0.000000] kvm-guest: PV spinlocks enabled [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1059606 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] audit: disabled (until reboot) [ 0.000000] software IO TLB: area num 4. [ 0.000000] Memory: 2829652K/4306352K available (18435K kernel code, 11221K rwdata, 7248K rodata, 2908K init, 18040K bss, 524584K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] ftrace: allocating 41240 entries in 162 pages [ 0.000000] ftrace: allocated 162 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU event tracing is enabled. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=4. [ 0.000000] rcu: RCU callback double-/use-after-free debug enabled. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 [ 0.000000] NR_IRQS: 524544, nr_irqs: 456, preallocated irqs: 16 [ 0.000000] random: get_random_bytes called from start_kernel+0x622/0x9a8 with crng_init=0 [ 0.001000] Console: colour *CGA 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns [ 0.001011] APIC: Switch to symmetric I/O mode setup [ 0.002398] x2apic enabled [ 0.003007] Switched APIC routing to physical x2apic. [ 0.004013] kvm-guest: setup PV IPIs [ 0.007594] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.008000] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 0.008020] Calibrating delay loop (skipped) preset value.. 4799.99 BogoMIPS (lpj=2399998) [ 0.009009] pid_max: default: 32768 minimum: 301 [ 0.010134] LSM: Security Framework initializing [ 0.011036] Yama: becoming mindful. [ 0.012029] SELinux: Initializing. [ 0.013109] *** VALIDATE selinux *** [ 0.021459] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, vmalloc) [ 0.026372] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc) [ 0.027136] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.028111] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.029113] *** VALIDATE tmpfs *** [ 0.030422] *** VALIDATE proc *** [ 0.031205] *** VALIDATE cgroup *** [ 0.032006] *** VALIDATE cgroup2 *** [ 0.033215] x86/cpu: User Mode Instruction Prevention (UMIP) activated [ 0.034000] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.034007] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 [ 0.035027] Spectre V2 : User space: Vulnerable [ 0.036007] Speculative Store Bypass: Vulnerable [ 0.039116] debug: unmapping init [mem 0xffffffff91a59000-0xffffffff91a60fff] [ 0.041164] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (family: 0x6, model: 0x3e, stepping: 0x4) [ 0.042623] Performance Events: IvyBridge events, full-width counters, Intel PMU driver. [ 0.043018] ... version: 2 [ 0.044009] ... bit width: 48 [ 0.045009] ... generic registers: 4 [ 0.045975] ... value mask: 0000ffffffffffff [ 0.046015] ... max period: 00007fffffffffff [ 0.047011] ... fixed-purpose events: 3 [ 0.048008] ... event mask: 000000070000000f [ 0.049207] rcu: Hierarchical SRCU implementation. [ 0.051398] smp: Bringing up secondary CPUs ... [ 0.052590] x86: Booting SMP configuration: [ 0.053017] .... node #0, CPUs: #1 #2 #3 [ 0.067143] smp: Brought up 1 node, 4 CPUs [ 0.069023] smpboot: Max logical packages: 1 [ 0.070013] smpboot: Total of 4 processors activated (19199.98 BogoMIPS) [ 0.146640] node 0 deferred pages initialised in 76ms [ 0.152551] devtmpfs: initialized [ 0.154260] x86/mm: Memory block size: 128MB [ 0.156682] gcov: version magic: 0x41383552 [ 0.161386] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.163096] futex hash table entries: 1024 (order: 4, 65536 bytes, vmalloc) [ 0.165287] pinctrl core: initialized pinctrl subsystem [ 0.167117] [ 0.167602] ************************************************************* [ 0.169010] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.172021] ** ** [ 0.174011] ** IOMMU DebugFS SUPPORT HAS BEEN ENABLED IN THIS KERNEL ** [ 0.177013] ** ** [ 0.180013] ** This means that this kernel is built to expose internal ** [ 0.182009] ** IOMMU data structures, which may compromise security on ** [ 0.184010] ** your system. ** [ 0.187012] ** ** [ 0.189010] ** If you see this message and you are not debugging the ** [ 0.191011] ** kernel, report this immediately to your vendor! ** [ 0.193011] ** ** [ 0.195012] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.197010] ************************************************************* [ 0.201000] NET: Registered protocol family 16 [ 0.202497] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations [ 0.205051] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.208054] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.210391] cpuidle: using governor menu [ 0.211721] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.214453] PCI: Using configuration type 1 for base access [ 0.216126] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.227100] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.228024] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.230049] cryptd: max_cpu_qlen set to 1000 [ 0.234946] ACPI: Added _OSI(Module Device) [ 0.240015] ACPI: Added _OSI(Processor Device) [ 0.244015] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.248014] ACPI: Added _OSI(Processor Aggregator Device) [ 0.258368] ACPI: 1 ACPI AML tables successfully acquired and loaded [ 0.271587] ACPI: Interpreter enabled [ 0.274092] ACPI: PM: (supports S0 S3 S4 S5) [ 0.276017] ACPI: Using IOAPIC for interrupt routing [ 0.280111] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.286548] ACPI: Enabled 2 GPEs in block 00 to 0F [ 0.314857] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.319200] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3] [ 0.326066] acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI] [ 0.333190] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.349000] acpiphp: Slot [2] registered [ 0.351173] acpiphp: Slot [5] registered [ 0.352099] acpiphp: Slot [6] registered [ 0.354083] acpiphp: Slot [7] registered [ 0.355068] acpiphp: Slot [8] registered [ 0.356064] acpiphp: Slot [9] registered [ 0.357102] acpiphp: Slot [10] registered [ 0.360113] acpiphp: Slot [3] registered [ 0.362103] acpiphp: Slot [4] registered [ 0.363096] acpiphp: Slot [11] registered [ 0.365115] acpiphp: Slot [12] registered [ 0.367124] acpiphp: Slot [13] registered [ 0.369337] acpiphp: Slot [14] registered [ 0.371098] acpiphp: Slot [15] registered [ 0.373130] acpiphp: Slot [16] registered [ 0.375103] acpiphp: Slot [17] registered [ 0.377085] acpiphp: Slot [18] registered [ 0.379148] acpiphp: Slot [19] registered [ 0.381103] acpiphp: Slot [20] registered [ 0.383078] acpiphp: Slot [21] registered [ 0.385083] acpiphp: Slot [22] registered [ 0.386082] acpiphp: Slot [23] registered [ 0.388081] acpiphp: Slot [24] registered [ 0.390092] acpiphp: Slot [25] registered [ 0.391199] acpiphp: Slot [26] registered [ 0.394118] acpiphp: Slot [27] registered [ 0.395100] acpiphp: Slot [28] registered [ 0.397250] acpiphp: Slot [29] registered [ 0.398163] acpiphp: Slot [30] registered [ 0.400146] acpiphp: Slot [31] registered [ 0.403086] PCI host bridge to bus 0000:00 [ 0.404011] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.407021] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.409023] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.413025] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 0.415026] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] [ 0.418026] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.420135] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.423203] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.426483] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 0.436778] pci 0000:00:01.1: reg 0x20: [io 0xc320-0xc32f] [ 0.443010] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.446014] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.449021] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.454020] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.457397] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 0.466070] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 0.477237] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 0.485309] pci 0000:00:01.3: quirk_piix4_acpi+0x0/0x1e0 took 18554 usecs [ 0.490615] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 [ 0.498012] pci 0000:00:02.0: reg 0x10: [io 0xc300-0xc31f] [ 0.517014] pci 0000:00:02.0: reg 0x20: [mem 0xe0000000000-0xe0000003fff 64bit pref] [ 0.524013] pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 0.534227] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 [ 0.548016] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] [ 0.566019] pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] [ 0.589017] pci 0000:00:05.0: reg 0x20: [mem 0xe0000004000-0xe0000007fff 64bit pref] [ 0.603323] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 [ 0.613016] pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] [ 0.623024] pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 0.652014] pci 0000:00:06.0: reg 0x20: [mem 0xe0000008000-0xe000000bfff 64bit pref] [ 0.667354] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 [ 0.677012] pci 0000:00:07.0: reg 0x10: [io 0xc100-0xc17f] [ 0.683013] pci 0000:00:07.0: reg 0x14: [mem 0xfebc2000-0xfebc2fff] [ 0.707016] pci 0000:00:07.0: reg 0x20: [mem 0xe000000c000-0xe000000ffff 64bit pref] [ 0.726415] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 [ 0.736017] pci 0000:00:08.0: reg 0x10: [io 0xc180-0xc1ff] [ 0.747016] pci 0000:00:08.0: reg 0x14: [mem 0xfebc3000-0xfebc3fff] [ 0.779014] pci 0000:00:08.0: reg 0x20: [mem 0xe0000010000-0xe0000013fff 64bit pref] [ 0.796325] pci 0000:00:09.0: [1af4:1001] type 00 class 0x010000 [ 0.805014] pci 0000:00:09.0: reg 0x10: [io 0xc200-0xc27f] [ 0.812017] pci 0000:00:09.0: reg 0x14: [mem 0xfebc4000-0xfebc4fff] [ 0.848097] pci 0000:00:09.0: reg 0x20: [mem 0xe0000014000-0xe0000017fff 64bit pref] [ 0.859247] pci 0000:00:0a.0: [1af4:1001] type 00 class 0x010000 [ 0.871027] pci 0000:00:0a.0: reg 0x10: [io 0xc280-0xc2ff] [ 0.876020] pci 0000:00:0a.0: reg 0x14: [mem 0xfebc5000-0xfebc5fff] [ 0.909021] pci 0000:00:0a.0: reg 0x20: [mem 0xe0000018000-0xe000001bfff 64bit pref] [ 0.928722] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 [ 0.930368] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 0.933401] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 [ 0.935332] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 0.937231] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 [ 0.942272] iommu: Default domain type: Passthrough [ 0.943000] SCSI subsystem initialized [ 0.944098] ACPI: bus type USB registered [ 0.945075] usbcore: registered new interface driver usbfs [ 0.947072] usbcore: registered new interface driver hub [ 0.949060] usbcore: registered new device driver usb [ 0.951238] pps_core: LinuxPPS API ver. 1 registered [ 0.954017] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 0.957076] PTP clock support registered [ 0.959422] EDAC MC: Ver: 3.0.0 [ 0.961130] PCI: Using ACPI for IRQ routing [ 0.962588] NetLabel: Initializing [ 0.963000] NetLabel: domain hash size = 128 [ 0.963000] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 0.966081] NetLabel: unlabeled traffic allowed by default [ 0.969364] vgaarb: loaded [ 0.971139] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 0.973011] hpet0: 3 comparators, 64-bit 100.000000 MHz counter [ 0.982333] clocksource: Switched to clocksource kvm-clock [ 1.121500] VFS: Disk quotas dquot_6.6.0 [ 1.124578] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 1.129204] *** VALIDATE ramfs *** [ 1.131957] *** VALIDATE hugetlbfs *** [ 1.134850] pnp: PnP ACPI init [ 1.137733] pnp: PnP ACPI: found 6 devices [ 1.157707] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 1.161449] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 1.164328] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 1.167441] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 1.170524] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 1.174310] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] [ 1.178119] NET: Registered protocol family 2 [ 1.181133] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, vmalloc) [ 1.186027] tcp_listen_portaddr_hash hash table entries: 4096 (order: 5, 163840 bytes, vmalloc) [ 1.190245] TCP established hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 1.196398] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc) [ 1.200695] TCP: Hash tables configured (established 65536 bind 65536) [ 1.203404] MPTCP token hash table entries: 8192 (order: 6, 393216 bytes, vmalloc) [ 1.206973] UDP hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 1.210546] UDP-Lite hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 1.213199] NET: Registered protocol family 1 [ 1.214981] RPC: Registered named UNIX socket transport module. [ 1.217068] RPC: Registered udp transport module. [ 1.218646] RPC: Registered tcp transport module. [ 1.220066] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 1.222318] NET: Registered protocol family 44 [ 1.223783] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 1.225466] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 1.230632] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 1.233555] PCI: CLS 0 bytes, default 64 [ 1.235800] Unpacking initramfs... [ 2.805181] debug: unmapping init [mem 0xffff8ec73cc54000-0xffff8ec73ffbffff] [ 2.809397] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 2.811894] software IO TLB: mapped [mem 0x00000000a8000000-0x00000000ac000000] (64MB) [ 2.815244] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 3.425683] Initialise system trusted keyrings [ 3.428817] Key type blacklist registered [ 3.432970] workingset: timestamp_bits=36 max_order=20 bucket_order=0 [ 3.446595] zbud: loaded [ 3.449813] *** VALIDATE nfs *** [ 3.451098] *** VALIDATE nfs4 *** [ 3.452641] pstore: using deflate compression [ 3.456634] Platform Keyring initialized [ 3.568305] NET: Registered protocol family 38 [ 3.570471] Key type asymmetric registered [ 3.572476] Asymmetric key parser 'x509' registered [ 3.574667] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 3.578563] io scheduler mq-deadline registered [ 3.582162] io scheduler kyber registered [ 3.584379] io scheduler bfq registered [ 3.587166] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 3.590515] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.594365] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 3.597908] ACPI: Power Button [PWRF] [ 3.608252] ACPI: \_SB_.LNKB: Enabled at IRQ 10 [ 3.615876] ACPI: \_SB_.LNKA: Enabled at IRQ 11 [ 3.637605] ACPI: \_SB_.LNKC: Enabled at IRQ 11 [ 3.654663] ACPI: \_SB_.LNKD: Enabled at IRQ 10 [ 3.684640] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 3.718043] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.752069] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.760489] Non-volatile memory driver v1.3 [ 3.763225] Linux agpgart interface v0.103 [ 3.803421] virtio_blk virtio1: [vda] 149768 512-byte logical blocks (76.7 MB/73.1 MiB) [ 3.807765] vda: detected capacity change from 0 to 76681216 [ 3.841486] virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) [ 3.944764] vdb: detected capacity change from 0 to 1073741824 [ 4.086541] virtio_blk virtio3: [vdc] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 4.091027] vdc: detected capacity change from 0 to 2621440000 [ 4.113323] virtio_blk virtio4: [vdd] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 4.117796] vdd: detected capacity change from 0 to 2621440000 [ 4.137357] virtio_blk virtio5: [vde] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 4.142126] vde: detected capacity change from 0 to 4294967296 [ 4.197520] virtio_blk virtio6: [vdf] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 4.208235] vdf: detected capacity change from 0 to 4294967296 [ 4.229247] libphy: Fixed MDIO Bus: probed [ 4.236179] usbcore: registered new interface driver usbserial_generic [ 4.238917] usbserial: USB Serial support registered for generic [ 4.242348] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 4.248189] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 4.250705] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 4.253503] mousedev: PS/2 mouse device common for all mice [ 4.259424] rtc_cmos 00:05: RTC can wake from S4 [ 4.262445] rtc_cmos 00:05: registered as rtc0 [ 4.265308] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 4.268832] intel_pstate: CPU model not supported [ 4.271524] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 4.276421] hid: raw HID events driver (C) Jiri Kosina [ 4.279658] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 [ 4.280949] usbcore: registered new interface driver usbhid [ 4.280953] usbhid: USB HID core driver [ 4.281080] drop_monitor: Initializing network drop monitor service [ 4.281200] Initializing XFRM netlink socket [ 4.281787] NET: Registered protocol family 10 [ 4.290656] Segment Routing with IPv6 [ 4.293081] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 [ 4.296589] NET: Registered protocol family 17 [ 4.309476] mpls_gso: MPLS GSO support [ 4.314908] RAS: Correctable Errors collector initialized. [ 4.316538] AVX version of gcm_enc/dec engaged. [ 4.317949] AES CTR mode by8 optimization enabled [ 4.404329] sched_clock: Marking stable (4404251893, 0)->(5397257208, -993005315) [ 4.408458] registered taskstats version 1 [ 4.410779] Loading compiled-in X.509 certificates [ 4.412896] zswap: loaded using pool lzo/zbud [ 4.442132] Key type big_key registered [ 4.454356] Key type encrypted registered [ 4.455933] ima: No TPM chip found, activating TPM-bypass! [ 4.457936] ima: Allocated hash algorithm: sha1 [ 4.459293] ima: No architecture policies found [ 4.460614] evm: Initialising EVM extended attributes: [ 4.464455] evm: security.selinux [ 4.465599] evm: security.ima [ 4.466532] evm: security.capability [ 4.467792] evm: HMAC attrs: 0x1 [ 4.469936] rtc_cmos 00:05: setting system clock to 2026-09-09 01:45:03 UTC (1788918303) [ 4.477600] debug: unmapping init [mem 0xffffffff92a03000-0xffffffff92bfffff] [ 4.480204] debug: unmapping init [mem 0xffffffff91782000-0xffffffff91a58fff] [ 4.491160] Write protecting the kernel read-only data: 28672k [ 4.496694] debug: unmapping init [mem 0xffffffff8fe03000-0xffffffff8fffffff] [ 4.498927] debug: unmapping init [mem 0xffffffff90714000-0xffffffff907fffff] [ 4.533411] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 4.544379] systemd[1]: Detected virtualization kvm. [ 4.547629] systemd[1]: Detected architecture x86-64. [ 4.549508] systemd[1]: Running in initial RAM disk. Welcome to Rocky Linux 8.10 (Green Obsidian) dracut-049-233.git20240115.el8 (Initramfs)! [ 4.573270] systemd[1]: No hostname configured. [ 4.574605] systemd[1]: Set hostname to . [ 4.576551] random: systemd: uninitialized urandom read (16 bytes read) [ 4.579104] systemd[1]: Initializing machine ID from random generator. [ 4.781060] random: systemd: uninitialized urandom read (16 bytes read) [ 4.783643] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 4.793288] random: systemd: uninitialized urandom read (16 bytes read) [ 4.800453] systemd[1]: Starting Create list of required static device nodes for the current kernel... Starting Create list of required st…ce nodes for the current kernel... [ 4.817893] systemd[1]: Reached target Local File Systems. [ OK ] Reached target Local File Systems. [ OK ] Listening on Journal Socket (/dev/log). Starting Journal Service... [ OK ] Listening on udev Control Socket. [ OK ] Reached target Swap. [ OK ] Reached target Timers. [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Reached target Initrd Root Device. [ OK ] Reached target Slices. Starting Setup Virtual Console... [ OK ] Listening on udev Kernel Socket. [ OK ] Reached target Sockets. Starting Apply Kernel Variables... [ OK ] Started Memstrack Anylazing Service. [ OK ] Reached target Paths. [ OK ] Reached target Local Encrypted Volumes. Starting Create Volatile Files and Directories... [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Setup Virtual Console. [ OK ] Started Apply Kernel Variables. Starting dracut cmdline hook... Starting Create Static Device Nodes in /dev... [ OK ] Started Journal Service. [ OK ] Started Create Volatile Files and Directories. [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ 5.860261] device-mapper: uevent: version 1.0.3 [ 5.862785] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting dracut pre-trigger hook... [ OK ] Started dracut pre-trigger hook. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. Starting dracut initqueue hook... [ OK ] Reached target System Initialization. [ OK ] Reached target Basic System. [ 7.067094] virtio_net virtio0 ens2: renamed from eth0 [ 7.115040] random: fast init done [ OK ] Started Hardware RNG Entropy Gatherer Daemon. [ 7.496663] scsi host0: ata_piix [ 7.622134] scsi host1: ata_piix [ 7.635536] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc320 irq 14 [ 7.650237] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc328 irq 15 [ 11.976089] random: crng init done [ 11.978115] random: 7 urandom warning(s) missed due to ratelimiting [ 13.160539] dracut-initqueue[584]: RTNETLINK answers: File exists Starting nbd nbd0... [ OK ] Started nbd nbd0. [ OK ] Started dracut initqueue hook. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Mounting /sysroot... [ 14.688961] EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Timers. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped dracut initqueue hook. Stopping Hardware RNG Entropy Gatherer Daemon... [ OK ] Stopped Hardware RNG Entropy Gatherer Daemon. [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped target Basic System. [ OK ] Stopped target System Initialization. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped dracut pre-trigger hook. [ OK ] Stopped target Local Encrypted Volumes. [ OK ] Stopped target Swap. Stopping udev Kernel Device Manager... [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped target Local File Systems. [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped target Slices. [ OK ] Stopped target Paths. [ OK ] Stopped Dispatch Password Requests to Console Directory Watch. [ OK ] Stopped target Sockets. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Reached target Switch Root. Starting Switch Root... [ 17.068756] printk: systemd: 23 output lines suppressed due to ratelimiting [ 17.729701] SELinux: Disabled at runtime. [ 17.848649] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 17.866921] systemd[1]: Detected virtualization kvm. [ 17.868931] systemd[1]: Detected architecture x86-64. Welcome to Rocky Linux 8.10 (Green Obsidian)! [ 19.007955] systemd[1]: initrd-switch-root.service: Succeeded. [ 19.014690] systemd[1]: Stopped Switch Root. [ OK ] Stopped Switch Root. [ 19.035404] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. [ 19.046078] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 19.052255] systemd[1]: Stopped Journal Service. [ OK ] Stopped Journal Service. [ 19.072500] systemd[1]: Starting Journal Service... Starting Journal Service... [ 19.081510] systemd[1]: Created slice system-sshd\x2dkeygen.slice. [ OK ] Created slice system-sshd\x2dkeygen.slice. [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Created slice User and Session Slice. [ OK ] Created slice system-getty.slice. [FAILED] Failed to set up automount Arbitrar…rmats File System Automount Point. See 'systemctl status proc-sys-fs-binfmt_misc.automount' for details. Starting Create list of required st…ce nodes for the current kernel... Mounting POSIX Message Queue File System... [ OK ] Reached target rpc_pipefs.target. Activating swap /dev/disk/by-label/SWAP... [ OK ] Created slice system-serial\x2dgetty.slice. [ OK ] Listening on udev Control Socket. Mounting Huge Pages File System... [ 19.260883] Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS Starting Apply Kernel Variables... [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Reached target Slices. Starting Remount Root and Kernel File Systems... [ OK ] Listening on Process Core Dump Socket. [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Paths. Mounting Kernel Debug File System... [ OK ] Listening on udev Kernel Socket. Starting udev Coldplug all Devices... [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd Root File System. [ OK ] Stopped target Initrd File Systems. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Activated swap /dev/disk/by-label/SWAP. [ OK ] Mounted Huge Pages File System. [ OK ] Started Apply Kernel Variables. [FAILED] Failed to start Remount Root and Kernel File Systems. See 'systemctl status systemd-remount-fs.service' for details. [ OK ] Started Journal Service. [ OK ] Mounted Kernel Debug File System. Starting Configure read-only root support... Starting Flush Journal to Persistent Storage... [ OK ] Reached target Swap. Starting Create Static Device Nodes in /dev... [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started udev Coldplug all Devices. [ OK ] Started Create Static Device Nodes in /dev. Starting udev Kernel Device Manager... [ OK ] Reached target Local File Systems (Pre). Mounting /mnt... Mounting /home/green/git/lustre-release... [ OK ] Mounted /mnt. [ 20.462477] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ OK ] Mounted /home/green/git/lustre-release. [ OK ] Started udev Kernel Device Manager. [ 21.381511] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 21.545080] input: PC Speaker as /devices/platform/pcspkr/input/input5 [ 22.114035] RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer [ 22.219052] EDAC sbridge: Ver: 1.1.2 [ 26.084867] Key type dns_resolver registered [* ] A start job is running for Configur…-only root support (7s / no limit)[ 26.888980] NFS: Registering the id_resolver key type [ 26.895094] Key type id_resolver registered [ 26.900198] Key type id_legacy registered [** ] A start job is running for Configur…-only root support (8s / no limit) [*** ] A start job is running for Configur…-only root support (8s / no limit) [ OK ] Started Configure read-only root support. [ OK ] Reached target Local File Systems. Starting Create Volatile Files and Directories... Starting Mark the need to relabel after reboot... Starting Rebuild Dynamic Linker Cache... Starting Load/Save Random Seed... [ OK ] Started Mark the need to relabel after reboot. [ OK ] Started Create Volatile Files and Directories. [ OK ] Started Load/Save Random Seed. Starting RPC Bind... Starting Update UTMP about System Boot/Shutdown... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Started RPC Bind. [ OK ] Started Rebuild Dynamic Linker Cache. Starting Update is Completed... [ OK ] Started Update is Completed. [ OK ] Reached target System Initialization. [ OK ] Started dnf makecache --timer. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Reached target Timers. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. [ OK ] Started irqbalance daemon. [ OK ] Started D-Bus System Message Bus. Starting Restore /run/initramfs on shutdown... Starting Login Service... Starting Network Manager... [ OK ] Reached target sshd-keygen.target. [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Network Manager. Starting Network Manager Wait Online... [ OK ] Reached target Network. Starting GSSAPI Proxy Daemon... Starting OpenSSH server daemon... Starting Dynamic System Tuning Daemon... [ OK ] Started Login Service. Starting Hostname Service... [ OK ] Started OpenSSH server daemon. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Started Permit User Sessions. [ OK ] Started Serial Getty on ttyS1. [ OK ] Started Command Scheduler. [ OK ] Started Serial Getty on ttyS0. [ OK ] Started Getty on tty1. [ OK ] Reached target Login Prompts. [ OK ] Started Hostname Service. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... Starting Notify NFS peers of a restart... Starting System Logging Service... [ OK ] Started Notify NFS peers of a restart. [ OK ] Started System Logging Service. Rocky Linux 8.10 (Green Obsidian) Kernel 4.18.0rh8.10-debug on an x86_64 oleg356-server login: [ 64.709697] libcfs: loading out-of-tree module taints kernel. [ 64.728526] Key type ._llcrypt registered [ 64.729794] Key type .llcrypt registered [ 64.775083] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_hostid [ 73.474371] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local [ 74.108578] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 74.119735] alg: No test for adler32 (adler32-zlib) [ 75.175646] Lustre: Lustre: Build Version: 2.17.58_2_g8df9471 [ 75.516774] LNet: Added LNI 192.168.203.156@tcp [8/256/0/180] [ 77.135159] Key type lgssc registered [ 77.856117] Lustre: Echo OBD driver; http://www.lustre.org/ [ 87.035894] ZFS: Loaded module v2.3.2-1, ZFS pool version 5000, ZFS filesystem version 5 [ 119.930774] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local [ 123.555370] hrtimer: interrupt took 6349056 ns [ 137.738780] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 137.774669] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 139.197407] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 139.280904] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 139.423175] Lustre: lustre-MDT0000: new disk, initializing [ 139.558606] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 139.580554] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 145.266442] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 150.577589] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 160.167461] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 160.397672] Lustre: lustre-OST0000: new disk, initializing [ 160.400350] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 160.403860] Lustre: Skipped 1 previous similar message [ 160.407147] Lustre: 6931:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 160.452553] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 161.150707] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 161.156696] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 161.186481] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 166.651684] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 182.846557] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 182.945393] Lustre: lustre-OST0001: new disk, initializing [ 182.948146] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 182.951458] Lustre: 7996:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 182.986171] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 187.006789] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 190.025002] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost [ 190.043683] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] [ 190.069763] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 [ 196.119831] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 202.998473] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 212.594661] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing check_logdir /tmp/testlogs/ [ 219.882774] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing yml_node [ 226.136273] Lustre: DEBUG MARKER: Client: 2.17.58.2 [ 231.060832] Lustre: DEBUG MARKER: MDS: 2.17.58.2 [ 234.771232] Lustre: DEBUG MARKER: OSS: 2.17.58.2 [ 237.019822] Lustre: DEBUG MARKER: -----============= acceptance-small: conf-sanity ============----- Tue Sep 8 21:48:53 EDT 2026 [ 255.777914] Lustre: DEBUG MARKER: excepting tests: 102 106 115 32newtarball [ 257.464806] Lustre: DEBUG MARKER: skipping tests SLOW=no: 45 69 106 111 114 [ 276.960854] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 276.965707] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 276.984981] Lustre: Skipped 1 previous similar message [ 276.993127] Lustre: Skipped 1 previous similar message [ 279.886892] Lustre: server umount lustre-MDT0000 complete [ 283.360443] LustreError: 5913:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788918582 with bad export cookie 12937924913193858962 [ 283.370313] LustreError: MGC192.168.203.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 283.462787] Lustre: server umount lustre-OST0000 complete [ 286.909409] Lustre: server umount lustre-OST0001 complete [ 293.819378] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_hostid [ 302.369290] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local [ 333.360993] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 333.727935] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 333.756323] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 333.814440] Lustre: lustre-MDT0000: new disk, initializing [ 333.880739] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 333.910836] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 338.645369] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 348.348969] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 355.427446] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 355.621113] Lustre: lustre-OST0000: new disk, initializing [ 355.624131] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 355.628171] Lustre: Skipped 1 previous similar message [ 355.632147] Lustre: 14071:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 355.713662] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 357.018148] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 357.029683] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 357.082408] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 362.072979] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 371.297873] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 376.456342] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 376.709540] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 382.946161] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 382.958281] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 382.986422] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 388.068955] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 393.185493] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 393.186842] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 4. Is it stuck? [ 393.413439] Lustre: server umount lustre-OST0000 complete [ 398.726729] Lustre: server umount lustre-MDT0000 complete [ 404.392062] Lustre: DEBUG MARKER: == conf-sanity test 76a: set permanent params with lctl across mounts ========================================================== 21:51:41 (1788918701) [ 411.139501] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 411.559400] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 417.471385] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 427.095081] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 435.586731] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 435.913180] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 442.351574] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 450.774870] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 454.701497] Lustre: Modifying parameter general.osc.*.max_dirty_mb=452 in log params [ 462.822879] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 462.839778] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 468.420506] Lustre: server umount lustre-MDT0000 complete [ 472.748664] LustreError: 15843:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788918771 with bad export cookie 12937924913193860425 [ 472.756730] LustreError: MGC192.168.203.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 472.758948] LustreError: 15843:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 473.080738] Lustre: server umount lustre-OST0000 complete [ 491.364546] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local [ 501.134965] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 501.653252] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 506.200696] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 508.579478] Lustre: Setting parameter general.debug_raw_pointers=Y in log params [ 513.982771] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 520.732495] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 532.422807] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 532.562442] Lustre: lustre-OST0001: new disk, initializing [ 532.565842] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 532.571381] Lustre: 20666:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 534.793100] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost [ 534.821824] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] [ 534.869855] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 [ 541.291809] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 551.962731] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 555.598764] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 570.339562] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 570.369132] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 570.379948] Lustre: Skipped 2 previous similar messages [ 573.691916] Lustre: server umount lustre-MDT0000 complete [ 579.050665] LustreError: 19056:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788918878 with bad export cookie 12937924913193860936 [ 579.072695] LustreError: MGC192.168.203.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 579.135473] Lustre: server umount lustre-OST0000 complete [ 584.086626] Lustre: server umount lustre-OST0001 complete [ 603.223733] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local [ 617.067624] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 617.603306] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 617.620607] Lustre: Skipped 2 previous similar messages [ 623.467965] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 627.439768] Lustre: 23850:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 635.314411] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 643.385746] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 647.148594] LustreError: 24204:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 647.181093] LustreError: 24204:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 652.260121] LustreError: 24202:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 654.418913] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 661.117127] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 669.394558] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 673.722921] Lustre: 25725:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 680.421606] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 680.434972] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 680.439871] Lustre: Skipped 2 previous similar messages [ 680.468936] Lustre: Skipped 1 previous similar message [ 686.208233] Lustre: server umount lustre-MDT0000 complete [ 689.701407] LustreError: 23404:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788918988 with bad export cookie 12937924913193861790 [ 689.711491] LustreError: MGC192.168.203.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 689.712203] LustreError: 23404:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 689.827563] Lustre: server umount lustre-OST0000 complete [ 695.606532] Lustre: server umount lustre-OST0001 complete [ 708.647296] Lustre: DEBUG MARKER: == conf-sanity test 76b: verify params log setup correctly ========================================================== 21:56:45 (1788919005) [ 735.649506] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local [ 747.565790] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 748.020502] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 748.037130] Lustre: Skipped 2 previous similar messages [ 753.459091] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 757.055463] Lustre: 28547:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 764.700474] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 772.220095] LustreError: 28900:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 772.255788] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 777.721935] LustreError: 28901:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 780.459343] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 786.061627] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 792.895155] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 796.741982] Lustre: 30418:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 806.371455] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 806.386657] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 806.403996] Lustre: Skipped 3 previous similar messages [ 808.303705] Lustre: server umount lustre-MDT0000 complete [ 812.370288] LustreError: 28100:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788919111 with bad export cookie 12937924913193862490 [ 812.379266] LustreError: 28100:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 812.385158] LustreError: MGC192.168.203.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 812.449894] Lustre: server umount lustre-OST0000 complete [ 816.711496] Lustre: server umount lustre-OST0001 complete [ 826.016556] Lustre: DEBUG MARKER: == conf-sanity test 76c: verify changelog_mask is applied with lctl set_param -P ========================================================== 21:58:43 (1788919123) [ 840.460265] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local [ 850.455435] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 854.916359] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 857.544646] Lustre: 32729:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 863.869645] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 870.150299] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 875.495088] LustreError: 33080:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 878.375681] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 884.067333] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 891.581036] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 894.529742] Lustre: 34600:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 895.300855] Lustre: Setting parameter general.mdd.*.changelog_mask=-CLOSE in log params [ 895.308249] Lustre: Skipped 1 previous similar message [ 899.042435] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 899.044658] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 899.057527] Lustre: Skipped 2 previous similar messages [ 899.078907] Lustre: Skipped 1 previous similar message [ 904.130105] Lustre: server umount lustre-MDT0000 complete [ 911.591922] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 911.709962] LustreError: MGC192.168.203.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 915.776858] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 919.532381] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 922.194693] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 923.615665] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 933.719076] Lustre: server umount lustre-MDT0000 complete [ 936.441553] LustreError: 32282:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788919235 with bad export cookie 12937924913193863876 [ 936.446270] LustreError: MGC192.168.203.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 936.451178] LustreError: 32282:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 936.548722] Lustre: server umount lustre-OST0000 complete [ 939.366635] Lustre: server umount lustre-OST0001 complete [ 946.263680] Lustre: DEBUG MARKER: == conf-sanity test 76d: verify llite.*.xattr_cache can be set by 'lctl set_param -P' correctly ========================================================== 22:00:44 (1788919244) [ 957.727563] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local [ 964.636599] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 968.054260] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 969.981108] Lustre: 38222:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 974.523341] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 978.380236] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 983.940799] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 987.721890] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 992.811401] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 995.787788] Lustre: Setting parameter general.llite.*.xattr_cache=0 in log params [ 1004.514229] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1004.523873] Lustre: Skipped 3 previous similar messages [ 1009.876641] Lustre: server umount lustre-MDT0000 complete [ 1012.109451] LustreError: 40207:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788919311 with bad export cookie 12937924913193864373 [ 1012.112173] LustreError: MGC192.168.203.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1012.114392] LustreError: 40207:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 1012.172986] Lustre: server umount lustre-OST0000 complete [ 1014.611378] Lustre: server umount lustre-OST0001 complete [ 1020.787980] Lustre: DEBUG MARKER: == conf-sanity test 77: comma-separated MGS NIDs and failover node NIDs ========================================================== 22:01:58 (1788919318) [ 1022.364942] Lustre: DEBUG MARKER: SKIP: conf-sanity test_77 mixed loopback and real device not working [ 1023.425462] Lustre: DEBUG MARKER: == conf-sanity test 78: run resize2fs on MDT and OST filesystems ========================================================== 22:02:01 (1788919321) [ 1029.585199] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_hostid [ 1034.389183] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local [ 1045.705687] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1045.818843] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1045.864288] Lustre: lustre-MDT0000: new disk, initializing [ 1045.913057] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1045.916513] Lustre: Skipped 9 previous similar messages [ 1045.926738] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1047.827067] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 1052.673210] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1056.013231] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1056.166080] Lustre: 44078:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1058.115547] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 1058.135761] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 1059.361822] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 1064.664528] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1065.746764] Lustre: DEBUG MARKER: create test files [ 1083.874280] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1083.874657] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1083.884137] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1083.889477] Lustre: Skipped 7 previous similar messages [ 1086.719401] Lustre: server umount lustre-OST0000 complete [ 1088.696056] Lustre: server umount lustre-MDT0000 complete [ 1093.775329] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing unload_modules_local [ 1095.246388] Key type lgssc unregistered [ 1095.409234] LNet: 45705:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1095.412787] LNetError: 45705:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1096.487779] LNet: Removed LNI 192.168.203.156@tcp [ 1097.026140] Key type .llcrypt unregistered [ 1097.029422] Key type ._llcrypt unregistered [ 1112.900530] Key type ._llcrypt registered [ 1112.904060] Key type .llcrypt registered [ 1112.957577] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local [ 1113.382402] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1113.421085] alg: No test for adler32 (adler32-zlib) [ 1114.347300] Lustre: Lustre: Build Version: 2.17.58_2_g8df9471 [ 1114.497773] LNet: Added LNI 192.168.203.156@tcp [8/256/0/180] [ 1116.119485] Key type lgssc registered [ 1116.691438] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1120.596278] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1120.607367] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1121.858628] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1123.976810] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 1127.621946] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1130.862406] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1131.026774] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1133.869533] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 1136.108393] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:102 to 0x240000400:129) [ 1136.159696] Lustre: 48416:0:(osd_internal.h:1460:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 511 < left 544, rollback = 9 [ 1136.164728] Lustre: 48416:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 32/128/4, destroy: 0/0/0 [ 1136.169307] Lustre: 48416:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 1136.172976] Lustre: 48416:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/18/1, punch: 0/0/0, quota 1/3/0 [ 1136.178464] Lustre: 48416:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 1136.181420] Lustre: 48416:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 1137.535080] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1141.040842] Lustre: DEBUG MARKER: check files after expanding the MDT and OST filesystems [ 1143.713676] Lustre: DEBUG MARKER: create more files after expanding the MDT and OST filesystems [ 1151.456719] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1151.457158] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1151.474138] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1152.585335] Lustre: server umount lustre-OST0000 complete [ 1154.845848] Lustre: server umount lustre-MDT0000 complete [ 1160.073608] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing unload_modules_local [ 1161.588044] Key type lgssc unregistered [ 1161.746128] LNet: 50008:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1161.751847] LNetError: 50008:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1162.791342] LNet: Removed LNI 192.168.203.156@tcp [ 1163.314491] Key type .llcrypt unregistered [ 1163.317542] Key type ._llcrypt unregistered [ 1180.594607] Key type ._llcrypt registered [ 1180.596647] Key type .llcrypt registered [ 1180.657303] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local [ 1181.222665] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1181.300920] alg: No test for adler32 (adler32-zlib) [ 1182.260985] Lustre: Lustre: Build Version: 2.17.58_2_g8df9471 [ 1182.428400] LNet: Added LNI 192.168.203.156@tcp [8/256/0/180] [ 1184.103194] Key type lgssc registered [ 1184.693468] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1188.729573] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1188.739000] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1189.988378] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1192.231435] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 1196.083363] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1199.936532] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1200.131950] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1201.189328] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:140 to 0x240000400:161) [ 1201.217978] Lustre: 52811:0:(osd_internal.h:1460:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 509 < left 544, rollback = 9 [ 1201.220849] Lustre: 52811:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 32/128/6, destroy: 0/0/0 [ 1201.224445] Lustre: 52811:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 1201.228165] Lustre: 52811:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/18/1, punch: 0/0/0, quota 1/3/0 [ 1201.232489] Lustre: 52811:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 1201.237344] Lustre: 52811:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 1203.055836] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 1207.067872] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1211.539467] Lustre: DEBUG MARKER: check files after shrinking the MDT and OST filesystems [ 1216.481025] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1216.481200] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1216.493429] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1221.400367] Lustre: server umount lustre-OST0000 complete [ 1223.282617] Lustre: server umount lustre-MDT0000 complete [ 1228.037884] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing unload_modules_local [ 1229.330063] Key type lgssc unregistered [ 1229.515675] LNet: 54366:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1229.518320] LNetError: 54366:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1229.527282] LNet: Removed LNI 192.168.203.156@tcp [ 1229.937599] Key type .llcrypt unregistered [ 1229.939546] Key type ._llcrypt unregistered [ 1236.551714] Key type ._llcrypt registered [ 1236.553516] Key type .llcrypt registered [ 1236.603481] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_hostid [ 1244.069794] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local [ 1244.487280] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1244.540603] alg: No test for adler32 (adler32-zlib) [ 1245.433324] Lustre: Lustre: Build Version: 2.17.58_2_g8df9471 [ 1245.562972] LNet: Added LNI 192.168.203.156@tcp [8/256/0/180] [ 1247.175169] Key type lgssc registered [ 1247.690933] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1261.977407] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1261.995681] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1263.117570] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1263.137646] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1263.180941] Lustre: lustre-MDT0000: new disk, initializing [ 1263.221399] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1263.231327] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1265.139705] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 1269.799800] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1272.729508] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1272.850860] Lustre: lustre-OST0000: new disk, initializing [ 1272.853602] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1272.856485] Lustre: Skipped 1 previous similar message [ 1272.860334] Lustre: 58073:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1272.902657] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1274.197738] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 1274.202643] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 1274.220919] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 1275.573477] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 1280.120817] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1281.980192] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1282.069148] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1283.026786] Lustre: server umount lustre-OST0000 complete [ 1294.886857] Lustre: server umount lustre-MDT0000 complete [ 1298.658559] Lustre: DEBUG MARKER: == conf-sanity test 79: format MDT/OST without mgs option (should return errors) ========================================================== 22:06:36 (1788919596) [ 1303.331811] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local [ 1320.036560] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_hostid [ 1323.826770] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local [ 1336.366493] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1336.481859] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1336.497797] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1336.538525] Lustre: lustre-MDT0000: new disk, initializing [ 1336.576525] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1336.584835] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1338.326482] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 1342.724624] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1345.738851] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1345.868329] Lustre: lustre-OST0000: new disk, initializing [ 1345.872108] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1345.875973] Lustre: Skipped 1 previous similar message [ 1345.878928] Lustre: 64190:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1345.918536] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1348.469886] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 1352.923869] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1354.749395] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1354.783603] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 1354.787451] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 1354.801750] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 1354.861751] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1359.841549] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1359.842151] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1359.850352] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1361.820459] Lustre: server umount lustre-OST0000 complete [ 1363.493958] Lustre: server umount lustre-MDT0000 complete [ 1367.042334] Lustre: DEBUG MARKER: == conf-sanity test 80: mgc import reconnect race ======== 22:07:45 (1788919665) [ 1369.867026] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1370.092512] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1371.825279] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 1374.971452] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1378.024272] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1378.196411] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1380.800663] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 1384.134601] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1385.858206] Lustre: 67892:0:(genops.c:1774:obd_export_evict_by_uuid()) MGS: evicting b9cd1e9b-d22d-4a88-b8c4-7ceead36f14b at adminstrative request [ 1390.562224] LustreError: MGC192.168.203.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1390.568582] Lustre: *** cfs_fail_loc=906, val=2147483648*** [ 1400.801457] Lustre: MGS: Client b9cd1e9b-d22d-4a88-b8c4-7ceead36f14b (at 0@lo) reconnecting [ 1400.805202] Lustre: Evicted from MGS (at 0@lo) after server handle changed from 0xb7f4569180a521fc to 0xb7f4569180a52368 [ 1400.812666] Lustre: MGC192.168.203.156@tcp: Connection restored to 0@lo (at 0@lo) [ 1418.876338] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1418.962103] Lustre: lustre-OST0001: new disk, initializing [ 1418.964528] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 1418.968912] Lustre: 68281:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1419.013870] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 1419.436117] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost [ 1419.440281] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] [ 1419.453688] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 [ 1421.533498] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 1426.044796] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1429.989345] LustreError: lustre-OST0001-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1429.989768] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1429.999489] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 1433.342774] Lustre: server umount lustre-OST0001 complete [ 1435.105504] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1435.113310] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1440.224943] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1440.224945] LustreError: 68350:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1440.224958] LustreError: 68350:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 1440.981197] Lustre: server umount lustre-OST0000 complete [ 1442.601459] Lustre: server umount lustre-MDT0000 complete [ 1446.199322] Lustre: DEBUG MARKER: == conf-sanity test 81: sparse OST indexing ============== 22:09:04 (1788919744) [ 1446.829573] Lustre: DEBUG MARKER: SKIP: conf-sanity test_81 needs >= 3 OSTs [ 1447.552272] Lustre: DEBUG MARKER: == conf-sanity test 82a: specify OSTs for file (succeed) or directory (succeed) ========================================================== 22:09:05 (1788919745) [ 1448.222776] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82a needs >= 3 OSTs [ 1448.941676] Lustre: DEBUG MARKER: == conf-sanity test 82b: specify OSTs for file with --pool and --ost-list options ========================================================== 22:09:07 (1788919747) [ 1449.584324] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82b needs >= 4 OSTs [ 1450.392811] Lustre: DEBUG MARKER: == conf-sanity test 82c: specify sparse OSTs for setstripe (should not crash) ========================================================== 22:09:08 (1788919748) [ 1451.111497] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82c needs >= 4 OSTs [ 1451.933296] Lustre: DEBUG MARKER: == conf-sanity test 83: ENOSPACE on OST doesn't cause message VFS: Busy inodes after unmount ... ========================================================== 22:09:10 (1788919750) [ 1452.692913] Lustre: DEBUG MARKER: mount the OST /dev/mapper/ost1_flakey as a ldiskfs filesystem [ 1455.157845] loop: module loaded [ 1455.162282] loop0: detected capacity change from 0 to 4294967296 [ 1455.176453] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 1455.810334] Lustre: DEBUG MARKER: run llverfs in partial mode on the OST ldiskfs /mnt/lustre-ost1 [ 1457.027188] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing run_llverfs /mnt/lustre-ost1 -vpl no [ 1458.750737] Lustre: DEBUG MARKER: unmount the OST /dev/mapper/ost1_flakey [ 1468.060906] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1468.085200] LustreError: 71988:0:(obd_config.c:845:class_setup()) setup lustre-OST0000-osd failed (-28) [ 1468.089324] LustreError: 71988:0:(obd_mount.c:259:lustre_start_simple()) lustre-OST0000-osd setup error -28 [ 1468.093141] LustreError: 71988:0:(tgt_mount.c:2585:server_fill_super()) Unable to start osd on /dev/mapper/ost1_flakey: -28 [ 1468.097800] LustreError: 71988:0:(super25.c:179:lustre_fill_super()) llite: Unable to mount : rc = -28 [ 1474.066904] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_hostid [ 1477.553503] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local [ 1488.430453] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1488.536995] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1488.550301] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1488.590412] Lustre: lustre-MDT0000: new disk, initializing [ 1488.625506] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1488.634890] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1490.350641] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 1494.697388] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1497.400850] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1497.522971] Lustre: 75430:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1500.037272] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 1504.329891] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1504.784545] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 1504.790489] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 1504.804884] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 1506.099921] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1506.200354] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1509.857773] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1509.858033] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1509.869949] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1513.117376] Lustre: server umount lustre-OST0000 complete [ 1514.729243] Lustre: server umount lustre-MDT0000 complete [ 1518.252208] Lustre: DEBUG MARKER: == conf-sanity test 84: check recovery_hard_time ========= 22:10:16 (1788919816) [ 1521.049631] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1522.925932] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 1526.079941] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1528.892350] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1531.444166] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 1534.622264] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1536.432736] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1536.539096] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1539.526064] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1539.604829] Lustre: lustre-OST0001: new disk, initializing [ 1539.610271] Lustre: Skipped 1 previous similar message [ 1539.612746] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 1539.615757] Lustre: Skipped 2 previous similar messages [ 1539.618774] Lustre: 79557:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1542.121528] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 1544.729757] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost [ 1544.733741] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] [ 1544.745994] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 [ 1546.500175] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1548.299165] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid 50 [ 1548.412582] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1559.658194] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 1569.652594] Lustre: Failing over lustre-MDT0000 [ 1569.964751] Lustre: server umount lustre-MDT0000 complete [ 1585.765766] LDISKFS-fs (dm-0): 4 truncates cleaned up [ 1585.768503] LDISKFS-fs (dm-0): recovery complete [ 1585.773950] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1585.872768] LustreError: MGC192.168.203.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1586.012553] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1586.021851] Lustre: Skipped 1 previous similar message [ 1586.047668] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-60 [ 1586.050429] Lustre: Skipped 4 previous similar messages [ 1586.080091] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 1586.894457] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect [ 1586.897502] Lustre: 82088:0:(ldlm_lib.c:2110:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 1586.943894] LustreError: 82119:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1587.039939] Lustre: 55564:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788919869/real 1788919869] req@00000000e5a8d8ce x1875818099863808/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788919885 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 1587.061394] Lustre: 55564:0:(client.c:2504:ptlrpc_expire_one_request()) Skipped 1 previous similar message [ 1587.271356] LustreError: 82119:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1587.594433] Lustre: 82119:0:(ldlm_lib.c:2110:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 1587.598744] Lustre: 82119:0:(ldlm_lib.c:2110:extend_recovery_timer()) Skipped 7 previous similar messages [ 1587.602139] LustreError: 82119:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1587.606566] LustreError: 82119:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 1 previous similar message [ 1587.832723] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 1587.920098] LustreError: 82119:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1587.923408] LustreError: 82119:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 1 previous similar message [ 1588.865207] Lustre: 82119:0:(ldlm_lib.c:2110:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 1588.873521] Lustre: 82119:0:(ldlm_lib.c:2110:extend_recovery_timer()) Skipped 3 previous similar messages [ 1588.877067] LustreError: 82119:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1588.881492] LustreError: 82119:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 3 previous similar messages [ 1589.199130] LustreError: 82119:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1589.202137] LustreError: 82119:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 3 previous similar messages [ 1591.079855] Lustre: 82119:0:(ldlm_lib.c:2110:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 1591.084491] Lustre: 82119:0:(ldlm_lib.c:2110:extend_recovery_timer()) Skipped 6 previous similar messages [ 1591.087371] LustreError: 82119:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1591.090445] LustreError: 82119:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 6 previous similar messages [ 1591.135154] Lustre: 55563:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788919874/real 1788919874] req@0000000005d36b38 x1875818099864320/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788919890 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 1591.267293] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 1591.407140] LustreError: 82119:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1591.411351] LustreError: 82119:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 6 previous similar messages [ 1595.161530] Lustre: 82119:0:(ldlm_lib.c:2110:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 1595.165664] Lustre: 82119:0:(ldlm_lib.c:2110:extend_recovery_timer()) Skipped 12 previous similar messages [ 1595.169111] LustreError: 82119:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1595.172864] LustreError: 82119:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 12 previous similar messages [ 1595.487106] LustreError: 82119:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1595.490303] LustreError: 82119:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 12 previous similar messages [ 1596.383273] Lustre: 55564:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788919879/real 1788919879] req@000000007ad97cd2 x1875818099864704/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788919895 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 1596.397814] Lustre: 55564:0:(client.c:2504:ptlrpc_expire_one_request()) Skipped 2 previous similar messages [ 1601.503143] Lustre: 55562:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788919884/real 1788919884] req@00000000bb4b76c4 x1875818099864960/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788919900 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 1603.297047] Lustre: 82119:0:(ldlm_lib.c:2110:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 1603.305642] Lustre: 82119:0:(ldlm_lib.c:2110:extend_recovery_timer()) Skipped 25 previous similar messages [ 1603.309881] LustreError: 82119:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1603.317633] LustreError: 82119:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 25 previous similar messages [ 1603.631122] LustreError: 82119:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1603.634331] LustreError: 82119:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 25 previous similar messages [ 1619.562102] Lustre: 82119:0:(ldlm_lib.c:2110:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 1619.567410] Lustre: 82119:0:(ldlm_lib.c:2110:extend_recovery_timer()) Skipped 51 previous similar messages [ 1619.571477] LustreError: 82119:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1619.574590] LustreError: 82119:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 51 previous similar messages [ 1619.887099] LustreError: 82119:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1619.889618] LustreError: 82119:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 51 previous similar messages [ 1646.231229] Lustre: 82119:0:(ldlm_lib.c:2419:target_recovery_overseer()) lustre-MDT0000 recovery is aborted by hard timeout [ 1646.242286] Lustre: 82119:0:(ldlm_lib.c:2429:target_recovery_overseer()) recovery is aborted, evict exports in recovery [ 1646.251278] Lustre: 82119:0:(genops.c:1601:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client ec462ff0-6e94-4b47-bdba-fcd8ae0fa119@192.168.203.56@tcp [ 1646.265107] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 1646.274249] Lustre: 82119:0:(ldlm_lib.c:1939:abort_req_replay_queue()) @@@ aborted: req@0000000014a5e681 x1875818092499200/t0(8589934786) o35->ec462ff0-6e94-4b47-bdba-fcd8ae0fa119@192.168.203.56@tcp:311/0 lens 392/0 e 0 to 0 dl 1788919961 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:0 [ 1646.313061] Lustre: lustre-MDT0000-osd: cancel update llog [0x200000400:0x1:0x0] [ 1646.342987] Lustre: lustre-MDT0000: Recovery over after 1:00, of 2 clients 1 recovered and 1 was evicted. [ 1646.391883] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:82 to 0x240000400:577) [ 1646.401866] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:49 to 0x280000400:545) [ 1657.312713] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1657.320272] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1657.327247] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1660.116770] Lustre: server umount lustre-OST0000 complete [ 1662.945913] LustreError: 78277:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1667.553041] LustreError: lustre-OST0001-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1668.071204] LustreError: 78280:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1673.186033] LustreError: 78579:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1677.279128] Lustre: lustre-OST0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 1677.543598] Lustre: server umount lustre-OST0001 complete [ 1681.102880] Lustre: server umount lustre-MDT0000 complete [ 1687.994218] Lustre: DEBUG MARKER: == conf-sanity test 85: osd_ost init: fail ea_fid_set ==== 22:13:05 (1788919985) [ 1694.542557] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1694.548095] Lustre: *** cfs_fail_loc=197, val=0*** [ 1710.048497] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 1715.170618] LustreError: 83890:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.203.156@tcp: failed processing log, type 4: rc = -110 [ 1720.313085] Lustre: *** cfs_fail_loc=197, val=0*** [ 1720.318066] Lustre: Skipped 65 previous similar messages [ 1740.895733] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1746.422658] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 1753.086598] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1754.875679] Lustre: server umount lustre-OST0000 complete [ 1762.174389] Lustre: DEBUG MARKER: == conf-sanity test 86: Replacing mkfs.lustre -G option == 22:14:19 (1788920059) [ 1781.161655] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1784.957685] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 1792.144735] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1795.647361] Lustre: server umount lustre-MDT0000 complete [ 1816.558891] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_hostid [ 1822.658828] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local [ 1841.134268] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1841.293156] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1841.311821] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1841.386966] Lustre: lustre-MDT0000: new disk, initializing [ 1841.466641] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1844.649724] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 1850.906377] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1854.763106] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1854.949150] Lustre: 90135:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1856.804415] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 1856.824608] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 1858.683096] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 1865.508221] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1868.876366] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1869.084710] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1872.353475] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1872.356836] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1872.373122] Lustre: Skipped 1 previous similar message [ 1872.380602] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1872.386977] Lustre: Skipped 3 previous similar messages [ 1876.682659] Lustre: server umount lustre-OST0000 complete [ 1879.550924] Lustre: server umount lustre-MDT0000 complete [ 1885.667523] Lustre: DEBUG MARKER: == conf-sanity test 87: check if MDT inode can hold EAs with N stripes properly ========================================================== 22:16:23 (1788920183) [ 1892.064903] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing unload_modules_local [ 1894.260819] Key type lgssc unregistered [ 1894.497764] LNet: 92144:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1894.505103] LNetError: 92144:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1894.522133] LNet: Removed LNI 192.168.203.156@tcp [ 1895.138567] Key type .llcrypt unregistered [ 1895.144156] Key type ._llcrypt unregistered [ 1906.389332] Key type ._llcrypt registered [ 1906.391556] Key type .llcrypt registered [ 1906.484177] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_hostid [ 1917.284826] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local [ 1917.915632] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1918.028716] alg: No test for adler32 (adler32-zlib) [ 1919.020684] Lustre: Lustre: Build Version: 2.17.58_2_g8df9471 [ 1919.179988] LNet: Added LNI 192.168.203.156@tcp [8/256/0/180] [ 1920.823154] Key type lgssc registered [ 1921.692567] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1942.984868] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1942.996515] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1944.105940] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1944.120022] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1944.159355] Lustre: lustre-MDT0000: new disk, initializing [ 1944.188424] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1944.196934] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1947.224707] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 1954.708269] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1954.948329] Lustre: lustre-OST0000: new disk, initializing [ 1954.951719] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1954.954742] Lustre: Skipped 1 previous similar message [ 1954.959242] Lustre: 95881:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1955.014974] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1957.005237] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 1957.017866] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 1957.046906] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 1959.787160] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 1972.468674] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1972.913110] Lustre: lustre-OST0001: new disk, initializing [ 1972.922357] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 1972.938178] Lustre: 96744:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1973.014163] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 1979.369410] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost [ 1979.377442] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] [ 1979.403192] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 [ 1982.230544] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 1994.801784] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1994.820367] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1994.832470] Lustre: Skipped 1 previous similar message [ 2000.079575] Lustre: server umount lustre-MDT0000 complete [ 2009.648305] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null) [ 2015.209196] Lustre: 93349:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788920298/real 1788920298] req@00000000dc9fa66e x1875818806535808/t0(0) o400->MGC192.168.203.156@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788920314 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 2015.290236] LustreError: MGC192.168.203.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2016.638630] Lustre: server umount lustre-OST0000 complete [ 2022.071857] Lustre: server umount lustre-OST0001 complete [ 2032.654666] Lustre: DEBUG MARKER: == conf-sanity test 88a: tunefs.lustre persists a --mountfsoptions-only change ========================================================== 22:18:49 (1788920329) [ 2054.290846] Lustre: DEBUG MARKER: == conf-sanity test 88b: check the default mount options can be overridden ========================================================== 22:19:11 (1788920351) [ 2064.746122] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local [ 2089.359791] Lustre: DEBUG MARKER: == conf-sanity test 89: check tunefs --param and --erase-param{s} options ========================================================== 22:19:46 (1788920386) [ 2124.406077] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_hostid [ 2133.956466] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local [ 2161.468583] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2161.693271] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2161.730636] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2161.853693] Lustre: lustre-MDT0000: new disk, initializing [ 2161.976088] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2162.017478] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2166.696407] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 2176.173755] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2182.618670] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2183.046407] Lustre: lustre-OST0000: new disk, initializing [ 2183.084578] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 2183.088691] Lustre: Skipped 1 previous similar message [ 2183.094439] Lustre: 104774:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2183.194085] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2189.480928] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 2189.920133] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 2189.928788] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 2189.983449] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 2199.275179] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount (FULL|IDLE) failover.node=192.0.2.254@tcp0,osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2204.085503] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2204.399691] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2210.273896] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2210.289102] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2210.312360] Lustre: Skipped 1 previous similar message [ 2210.318721] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2212.576766] Lustre: server umount lustre-OST0000 complete [ 2217.849506] Lustre: server umount lustre-MDT0000 complete [ 2227.183319] Lustre: DEBUG MARKER: == conf-sanity test 90a: check max_mod_rpcs_in_flight is enforced ========================================================== 22:22:04 (1788920524) [ 2233.929246] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2234.626215] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2238.954449] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 2246.131132] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2252.138211] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2252.464747] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2258.659131] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 2265.585977] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2269.890574] Lustre: *** cfs_fail_loc=159, val=0*** [ 2285.303439] Lustre: lustre-MDT0000: Client bcc288d8-c69e-41b3-a89e-653f6fd19694 (at 192.168.203.56@tcp) reconnecting [ 2286.663419] Lustre: *** cfs_fail_loc=159, val=0*** [ 2286.671592] Lustre: Skipped 6 previous similar messages [ 2302.271185] Lustre: lustre-MDT0000: Client bcc288d8-c69e-41b3-a89e-653f6fd19694 (at 192.168.203.56@tcp) reconnecting [ 2307.605274] Lustre: server umount lustre-OST0000 complete [ 2322.047255] Lustre: server umount lustre-MDT0000 complete [ 2332.454954] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing unload_modules_local [ 2335.180852] Key type lgssc unregistered [ 2335.505602] LNet: 109373:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2335.511595] LNetError: 109373:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2335.533145] LNet: Removed LNI 192.168.203.156@tcp [ 2336.482772] Key type .llcrypt unregistered [ 2336.489932] Key type ._llcrypt unregistered [ 2359.707578] Key type ._llcrypt registered [ 2359.709527] Key type .llcrypt registered [ 2359.820949] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local [ 2361.246062] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2361.276373] alg: No test for adler32 (adler32-zlib) [ 2362.379112] Lustre: Lustre: Build Version: 2.17.58_2_g8df9471 [ 2362.631371] LNet: Added LNI 192.168.203.156@tcp [8/256/0/180] [ 2364.391184] Key type lgssc registered [ 2365.683845] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2372.996563] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2373.018121] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2374.498800] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2379.126954] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 2386.614459] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2393.182706] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2393.526257] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2399.695615] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:42 to 0x240000400:65) [ 2399.987579] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 2406.890094] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2416.426365] Lustre: *** cfs_fail_loc=159, val=0*** [ 2432.746857] Lustre: lustre-MDT0000: Client 026d79bb-c08c-4c03-8164-ec2bf45cfd77 (at 192.168.203.56@tcp) reconnecting [ 2434.859778] Lustre: *** cfs_fail_loc=159, val=0*** [ 2451.217902] Lustre: lustre-MDT0000: Client 026d79bb-c08c-4c03-8164-ec2bf45cfd77 (at 192.168.203.56@tcp) reconnecting [ 2452.602071] Lustre: *** cfs_fail_loc=159, val=0*** [ 2452.605942] Lustre: Skipped 3 previous similar messages [ 2469.210247] Lustre: lustre-MDT0000: Client 026d79bb-c08c-4c03-8164-ec2bf45cfd77 (at 192.168.203.56@tcp) reconnecting [ 2474.731238] Lustre: 112913:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 2478.245793] Lustre: *** cfs_fail_loc=159, val=0*** [ 2478.318896] Lustre: Skipped 10 previous similar messages [ 2494.712742] Lustre: lustre-MDT0000: Client ba7fa1fc-b69d-4ee1-b706-251fb47d4ca8 (at 192.168.203.56@tcp) reconnecting [ 2496.230316] Lustre: *** cfs_fail_loc=159, val=0*** [ 2496.233227] Lustre: Skipped 8 previous similar messages [ 2512.651910] Lustre: lustre-MDT0000: Client ba7fa1fc-b69d-4ee1-b706-251fb47d4ca8 (at 192.168.203.56@tcp) reconnecting [ 2514.205115] Lustre: 113206:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 2522.592979] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2522.601216] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2522.616385] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2525.191573] Lustre: server umount lustre-OST0000 complete [ 2528.953223] Lustre: server umount lustre-MDT0000 complete [ 2537.922855] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing unload_modules_local [ 2540.265477] Key type lgssc unregistered [ 2540.513898] LNet: 114056:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2540.522155] LNetError: 114056:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2540.544613] LNet: Removed LNI 192.168.203.156@tcp [ 2541.298735] Key type .llcrypt unregistered [ 2541.300750] Key type ._llcrypt unregistered [ 2559.893705] Key type ._llcrypt registered [ 2559.896380] Key type .llcrypt registered [ 2559.975801] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local [ 2560.824162] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2560.897116] alg: No test for adler32 (adler32-zlib) [ 2561.969914] Lustre: Lustre: Build Version: 2.17.58_2_g8df9471 [ 2562.142582] LNet: Added LNI 192.168.203.156@tcp [8/256/0/180] [ 2563.791151] Key type lgssc registered [ 2564.723946] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2571.112663] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2571.129223] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2572.525986] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2576.030711] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 2581.269892] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2585.977736] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2586.209727] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2590.943179] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 2595.993533] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2597.485740] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:91 to 0x240000400:129) [ 2606.971886] Lustre: 117120:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 2609.474243] Lustre: 117168:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 2610.695762] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 in log params [ 2611.339844] Lustre: Setting parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=8 in log params [ 2613.620783] Lustre: 117314:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre/mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 (mode = 0) failed: rc = -17 [ 2614.328232] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=7 in log params [ 2614.996594] Lustre: 117412:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 2618.338588] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2618.346117] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2618.356057] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2623.458415] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2628.576312] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2632.159195] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2632.257803] Lustre: server umount lustre-OST0000 complete [ 2635.141722] Lustre: server umount lustre-MDT0000 complete [ 2642.110907] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing unload_modules_local [ 2644.033640] Key type lgssc unregistered [ 2644.266948] LNet: 118267:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2644.276271] LNetError: 118267:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2644.296195] LNet: Removed LNI 192.168.203.156@tcp [ 2644.980181] Key type .llcrypt unregistered [ 2644.982671] Key type ._llcrypt unregistered [ 2661.929302] Key type ._llcrypt registered [ 2661.932211] Key type .llcrypt registered [ 2661.998868] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local [ 2662.742785] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2662.764340] alg: No test for adler32 (adler32-zlib) [ 2663.740719] Lustre: Lustre: Build Version: 2.17.58_2_g8df9471 [ 2663.981807] LNet: Added LNI 192.168.203.156@tcp [8/256/0/180] [ 2665.631172] Key type lgssc registered [ 2666.649970] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2672.786245] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2672.798606] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2674.115307] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2677.397127] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 2682.517708] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2686.937392] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2687.147071] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2691.264097] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 2695.364947] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2699.436371] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:91 to 0x240000400:161) [ 2704.925978] Lustre: *** cfs_fail_loc=159, val=0*** [ 2720.485947] Lustre: lustre-MDT0000: Client ba2a521a-3e74-4281-ae69-e5f03c000a4d (at 192.168.203.56@tcp) reconnecting [ 2740.707165] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2740.707939] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2740.722809] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2743.293250] Lustre: server umount lustre-OST0000 complete [ 2745.862703] Lustre: server umount lustre-MDT0000 complete [ 2752.785829] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing unload_modules_local [ 2754.843371] Key type lgssc unregistered [ 2755.068712] LNet: 122205:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2755.078594] LNetError: 122205:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2755.101267] LNet: Removed LNI 192.168.203.156@tcp [ 2755.789707] Key type .llcrypt unregistered [ 2755.793584] Key type ._llcrypt unregistered [ 2771.039422] Key type ._llcrypt registered [ 2771.040837] Key type .llcrypt registered [ 2771.095663] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local [ 2771.506811] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2771.562539] alg: No test for adler32 (adler32-zlib) [ 2772.529067] Lustre: Lustre: Build Version: 2.17.58_2_g8df9471 [ 2772.676382] LNet: Added LNI 192.168.203.156@tcp [8/256/0/180] [ 2774.279172] Key type lgssc registered [ 2774.973719] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2779.668593] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2779.681711] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2780.971065] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2783.498659] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 2787.938855] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2792.191455] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2792.434314] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2796.165511] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 2800.800418] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2805.678062] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:170 to 0x240000400:193) [ 2821.992721] Lustre: lustre-OST0000: evicting 0013efbc-d8b6-4fa0-9311-2b918edd7bd5 (at 192.168.203.56@tcp) by administrative request [ 2851.811795] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2851.818557] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2851.832882] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2854.267548] Lustre: server umount lustre-OST0000 complete [ 2856.824651] Lustre: server umount lustre-MDT0000 complete [ 2862.999589] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing unload_modules_local [ 2864.810856] Key type lgssc unregistered [ 2865.026164] LNet: 126545:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2865.033665] LNetError: 126545:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2865.053876] LNet: Removed LNI 192.168.203.156@tcp [ 2865.643173] Key type .llcrypt unregistered [ 2865.645703] Key type ._llcrypt unregistered [ 2901.412487] Key type ._llcrypt registered [ 2901.413966] Key type .llcrypt registered [ 2901.477766] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local [ 2901.876964] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2901.889610] alg: No test for adler32 (adler32-zlib) [ 2902.793082] Lustre: Lustre: Build Version: 2.17.58_2_g8df9471 [ 2902.937130] LNet: Added LNI 192.168.203.156@tcp [8/256/0/180] [ 2904.551176] Key type lgssc registered [ 2905.134646] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2909.200454] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2909.216327] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2910.474118] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2913.029554] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 2917.650955] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2921.905828] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2922.144126] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2926.565077] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 2930.752657] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2935.397924] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:195 to 0x240000400:225) [ 2946.018398] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2946.020064] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2946.033984] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2947.565914] Lustre: server umount lustre-OST0000 complete [ 2949.888447] Lustre: server umount lustre-MDT0000 complete [ 2955.840681] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing unload_modules_local [ 2957.453645] Key type lgssc unregistered [ 2957.628823] LNet: 131425:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2957.634167] LNetError: 131425:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2957.642871] LNet: Removed LNI 192.168.203.156@tcp [ 2958.280831] Key type .llcrypt unregistered [ 2958.282672] Key type ._llcrypt unregistered [ 2971.251981] Key type ._llcrypt registered [ 2971.253520] Key type .llcrypt registered [ 2971.306639] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local [ 2971.845367] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2971.875222] alg: No test for adler32 (adler32-zlib) [ 2972.819138] Lustre: Lustre: Build Version: 2.17.58_2_g8df9471 [ 2972.940667] LNet: Added LNI 192.168.203.156@tcp [8/256/0/180] [ 2974.551151] Key type lgssc registered [ 2975.170836] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2986.626046] Lustre: DEBUG MARKER: == conf-sanity test 100: check lshowmount lists MGS, MDT, OST and 0@lo ========================================================== 22:34:44 (1788921284) [ 2994.205423] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_hostid [ 2999.454198] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local [ 3014.694831] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3014.709974] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3015.858502] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3015.879570] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3015.928694] Lustre: lustre-MDT0000: new disk, initializing [ 3015.979130] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3015.991147] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3018.249292] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 3023.915753] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3027.940287] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3028.102504] Lustre: lustre-OST0000: new disk, initializing [ 3028.107872] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3028.111895] Lustre: Skipped 1 previous similar message [ 3028.115736] Lustre: 136237:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3028.173923] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3031.747486] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 3032.284715] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 3032.292832] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 3032.315245] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 3037.182982] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3045.503941] Lustre: server umount lustre-OST0000 complete [ 3057.211577] Lustre: server umount lustre-MDT0000 complete [ 3062.831595] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing unload_modules_local [ 3064.282070] Key type lgssc unregistered [ 3064.469748] LNet: 137932:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3064.475389] LNetError: 137932:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3065.509413] LNet: Removed LNI 192.168.203.156@tcp [ 3065.963872] Key type .llcrypt unregistered [ 3065.965633] Key type ._llcrypt unregistered [ 3078.498946] Key type ._llcrypt registered [ 3078.500854] Key type .llcrypt registered [ 3078.569822] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local [ 3079.052830] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3079.066515] alg: No test for adler32 (adler32-zlib) [ 3080.019762] Lustre: Lustre: Build Version: 2.17.58_2_g8df9471 [ 3080.157815] LNet: Added LNI 192.168.203.156@tcp [8/256/0/180] [ 3081.791378] Key type lgssc registered [ 3082.462991] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3086.960682] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3086.984524] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3088.248101] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3090.732439] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 3095.019608] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3098.537343] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3098.713882] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3101.866207] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 3103.732929] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:3 to 0x240000400:33) [ 3105.597262] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3110.789270] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3110.808891] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3110.816237] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3110.819621] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3110.826981] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3111.373037] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3111.387879] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3111.402524] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3111.416191] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3111.430234] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3111.979406] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3112.448085] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3112.457667] Lustre: Skipped 1 previous similar message [ 3112.470570] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3112.479653] Lustre: Skipped 1 previous similar message [ 3112.483614] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3112.489477] Lustre: Skipped 1 previous similar message [ 3112.493449] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3112.501471] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3112.506479] Lustre: Skipped 1 previous similar message [ 3112.989888] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3113.547872] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3114.096479] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3114.635479] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3114.641269] Lustre: Skipped 3 previous similar messages [ 3114.652502] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3114.657768] Lustre: Skipped 3 previous similar messages [ 3114.660192] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3114.662433] Lustre: Skipped 3 previous similar messages [ 3114.664136] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3114.671546] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3114.674959] Lustre: Skipped 3 previous similar messages [ 3115.151716] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3115.618498] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3116.167942] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3116.663563] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3117.146392] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3117.663087] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3118.188207] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3118.715874] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3118.729318] Lustre: Skipped 7 previous similar messages [ 3118.744383] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3118.752571] Lustre: Skipped 7 previous similar messages [ 3118.755708] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3118.760719] Lustre: Skipped 7 previous similar messages [ 3118.766062] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3118.771411] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3118.775336] Lustre: Skipped 7 previous similar messages [ 3119.245623] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3119.717960] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3120.281659] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3120.805063] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3121.305970] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3121.814859] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3122.371621] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3122.899613] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3123.392515] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3123.875127] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3124.390204] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3124.899639] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3125.438854] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3125.904188] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3126.377067] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3126.909256] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3126.912451] Lustre: Skipped 15 previous similar messages [ 3126.922291] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3126.929480] Lustre: Skipped 15 previous similar messages [ 3126.932440] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3126.935121] Lustre: Skipped 15 previous similar messages [ 3126.937767] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3126.942914] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3126.945020] Lustre: Skipped 15 previous similar messages [ 3127.425990] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3127.902133] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3128.381328] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3128.826249] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3129.320110] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3129.761325] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3130.199728] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3130.666059] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3131.131166] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3131.627130] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3132.037343] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3132.460968] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3132.913377] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3133.366590] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3133.829847] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3134.278238] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3134.742222] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3135.160194] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3135.595712] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3136.031669] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3136.433466] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3136.857565] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3137.301810] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3137.753434] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3138.224680] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3138.690377] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3139.130720] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3139.610313] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3140.141383] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3140.630345] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3141.088711] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3141.583393] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3142.064105] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3142.544596] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3143.018352] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3143.023413] Lustre: Skipped 34 previous similar messages [ 3143.034099] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3143.039607] Lustre: Skipped 34 previous similar messages [ 3143.041361] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3143.043949] Lustre: Skipped 34 previous similar messages [ 3143.045982] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3143.052976] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3143.057057] Lustre: Skipped 34 previous similar messages [ 3143.511471] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3143.996413] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3144.546490] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3145.064214] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3145.561687] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3146.148691] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3146.692515] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3147.205808] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3147.728189] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3148.215694] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3148.658479] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3149.170581] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3149.686455] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3150.218723] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3150.795811] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3151.330888] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3151.872103] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3152.333681] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3152.845478] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3153.353376] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3153.829563] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3154.305897] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3154.872324] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3155.369467] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3155.827118] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3156.387393] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3156.950533] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3157.557304] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3158.088336] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3158.683136] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3159.241252] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3159.892701] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3160.557825] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3161.221390] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3161.689320] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3162.255909] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3162.780346] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3163.276942] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3163.753556] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3164.229772] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3164.752362] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3165.223643] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3165.723155] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3166.328162] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3166.856113] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3167.375375] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3167.936705] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3168.400900] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3168.959993] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3169.500424] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3169.985528] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3170.501858] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3171.032359] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3171.590177] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3172.155356] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3172.651692] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3173.169661] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3173.754634] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3174.313552] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3175.091930] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3175.097758] Lustre: Skipped 59 previous similar messages [ 3175.112396] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3175.122296] Lustre: Skipped 59 previous similar messages [ 3175.125233] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3175.130228] Lustre: Skipped 59 previous similar messages [ 3175.134233] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3175.141202] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3175.146399] Lustre: Skipped 59 previous similar messages [ 3175.778948] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3176.443371] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3176.981078] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3177.622760] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3178.091841] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3178.654573] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3179.213416] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3179.851542] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3180.376240] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3180.907167] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3181.530151] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3182.168582] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3182.713558] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3183.353541] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3183.879823] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3184.405208] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3184.904978] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3185.378382] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3185.987726] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3186.530116] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3186.991643] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3187.443080] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3187.982201] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3188.533449] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3189.066481] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3189.548261] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3190.074379] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3190.584713] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3191.134621] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3191.659954] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3192.168350] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3192.762077] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3193.318334] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3193.857497] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3194.362629] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3194.918347] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3195.388126] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3195.878384] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3196.388584] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3196.785704] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3197.271669] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3197.778287] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3198.305609] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3198.874389] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3199.412426] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3199.954966] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3200.453399] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3200.972683] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3201.620278] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3202.100893] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3202.508426] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3202.901828] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3203.322746] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3203.752673] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3204.189592] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3204.657346] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3205.098940] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3205.565903] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3206.080730] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3206.591183] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3207.116652] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3207.620346] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3208.107593] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3208.656586] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3209.208208] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3209.765518] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3210.306304] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3210.883578] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3211.450751] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3211.976697] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3212.534521] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3213.036882] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3213.559411] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3214.131440] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3214.650401] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3215.134981] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3215.645535] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3216.100393] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3216.563542] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3216.999275] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3217.450533] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3217.935560] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3218.491495] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3219.019673] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3219.546122] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3220.046041] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3220.524605] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3221.029497] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3221.516402] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3222.050250] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3222.581263] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3223.025137] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3223.543120] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3224.047750] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3224.529328] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3225.011917] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3225.529662] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3226.074681] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3226.612337] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3227.155296] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3227.647445] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3228.197491] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3228.719214] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3229.212204] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3229.724618] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3230.261296] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3230.761173] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3231.316329] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3231.762128] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3232.254709] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3232.696219] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3233.158613] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3233.632225] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3234.151077] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3234.617064] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3235.082614] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3235.657770] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3236.136498] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3236.598503] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3237.110352] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3237.590820] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3238.106358] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3238.593328] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3239.086576] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3239.547645] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3239.550646] Lustre: Skipped 124 previous similar messages [ 3239.559279] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3239.564857] Lustre: Skipped 124 previous similar messages [ 3239.567482] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3239.570812] Lustre: Skipped 124 previous similar messages [ 3239.573212] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3239.577489] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3239.580499] Lustre: Skipped 124 previous similar messages [ 3240.048374] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3240.519102] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3240.997905] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3241.512472] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3241.981536] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3242.398847] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3242.835384] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3243.258453] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3243.666481] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3244.076294] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3244.492303] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3244.919139] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3245.374765] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3245.844285] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3246.263335] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3246.646710] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3247.139673] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3247.578613] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3248.099921] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3248.634588] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3249.121590] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3249.668057] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3250.180970] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3250.696067] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3251.219670] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3251.671548] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3252.171504] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3252.626196] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3253.330965] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3254.194199] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3254.947692] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3255.570179] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3256.129621] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3256.721321] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3257.623546] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3258.377842] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3259.280805] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3259.924600] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3260.665823] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3261.364518] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3262.408383] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3263.462696] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3264.578536] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3265.405417] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3266.391444] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3267.458138] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3268.230314] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3269.414324] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3270.730983] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3271.694694] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3272.694252] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3273.689168] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3275.026589] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3276.143668] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3277.243921] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3278.247297] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3279.380739] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3280.178604] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3281.340619] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3282.350594] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3283.387410] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3284.399389] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3285.462308] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3286.563290] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3287.688522] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3288.774624] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3289.902279] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3291.078509] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3292.367593] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3293.310434] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3294.237140] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3295.111705] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3296.187522] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3297.343117] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3298.437262] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3299.780723] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3300.890832] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3301.947966] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3303.139708] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3304.365547] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3305.597248] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3306.548662] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3307.527149] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3308.853413] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3309.969481] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3310.968509] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3312.037982] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3312.932241] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3313.847914] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3314.493717] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3315.196867] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3316.021705] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3316.823060] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3317.855183] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3318.844442] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3319.700854] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3320.666051] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3321.671526] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3322.478316] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3323.395770] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3324.380864] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3325.452305] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3326.335278] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3327.396480] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3328.481799] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3329.463162] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3330.283256] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3330.943097] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3331.865197] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3332.760726] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3333.686492] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3334.541454] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3335.396375] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3336.075300] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3336.797783] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3337.676463] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3338.398985] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3339.212274] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3339.960189] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3340.828993] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3341.567174] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3342.387571] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3343.124684] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3343.842680] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3344.595390] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3345.320639] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3345.993155] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3346.734592] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3347.491193] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3348.178675] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3348.843148] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3349.473463] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3350.128978] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3351.007850] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3351.758130] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3352.414370] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3353.141840] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3353.755379] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3354.430267] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3355.096464] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3355.794505] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3356.517286] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3357.176489] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3357.716661] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3358.303225] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3358.964532] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3359.567229] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3360.165918] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3360.762173] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3361.385979] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3362.051381] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3362.684182] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3363.315454] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3363.950490] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3364.645498] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3365.386062] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3366.080502] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3366.801944] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3367.440376] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3368.009214] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3368.018052] Lustre: Skipped 159 previous similar messages [ 3368.029781] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3368.045849] Lustre: Skipped 159 previous similar messages [ 3368.052496] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3368.059720] Lustre: Skipped 159 previous similar messages [ 3368.063740] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3368.074448] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3368.081943] Lustre: Skipped 159 previous similar messages [ 3368.688339] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3369.240220] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3369.900466] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3370.633884] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3371.275135] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3371.946910] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3372.651034] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3373.304328] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3374.013558] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3374.579692] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3375.184672] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3375.781222] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3376.363776] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3376.941440] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3377.560552] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3378.267422] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3378.905198] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3379.568490] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3380.200885] LustreError: 139337:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 3380.207195] LustreError: 139337:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 3380.220369] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3380.740665] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3381.372142] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3382.035244] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3382.665586] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3383.347411] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3384.010884] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3384.666856] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3385.366638] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3385.966067] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3386.644585] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3387.261475] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3387.934604] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3388.592296] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3389.343317] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3389.934682] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3390.732609] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3391.422236] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3392.167800] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3392.969465] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3393.724740] LustreError: 139337:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 3393.735466] LustreError: 139337:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 3393.744849] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3394.324424] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3394.961311] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3395.656237] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3396.362839] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3396.963823] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3397.692472] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3398.405240] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3399.201296] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3399.917914] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3400.713308] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3401.408431] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3402.109752] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3402.808945] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3403.616156] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3404.289748] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3405.093273] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3405.841818] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3406.616611] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3407.449358] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3408.119846] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3408.760984] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3409.440592] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3410.121320] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3410.807630] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3411.530488] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3412.145697] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3412.739058] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3413.356704] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3413.996730] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3414.710054] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3415.345830] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3415.975888] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3416.623305] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3417.261286] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3417.904660] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3418.460708] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3419.023843] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3419.572439] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3420.152100] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3420.813160] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3421.380299] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3421.999064] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3422.599325] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3423.178642] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3423.833858] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3424.472349] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3424.995645] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3425.573455] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3426.128116] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3426.791884] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3427.419989] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3428.068967] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3428.639047] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3429.263809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3429.852804] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3430.520587] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3431.108613] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3431.709675] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3432.275864] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3432.929594] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3433.610187] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3434.280847] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3434.952553] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3435.532262] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3436.085238] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3436.602692] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3437.286220] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3437.996226] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3438.558195] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3439.134601] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3439.746906] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3440.380332] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3440.988616] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3441.652444] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3442.301624] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3442.862475] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3443.408667] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3443.954027] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3444.503550] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3445.131698] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3445.796674] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3446.354521] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3446.873828] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3447.488130] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3448.108752] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3448.730980] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3449.353849] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3449.970341] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3450.680250] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3451.274532] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3451.821716] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3452.396990] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3452.966816] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3453.593417] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3454.289809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3454.845375] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3455.455331] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3456.120123] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3456.780426] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3457.439889] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3458.072186] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3458.603746] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3459.199520] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3459.786230] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3460.429238] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3461.099626] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3461.847390] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3462.538805] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3463.219687] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3463.933759] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3464.817729] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3465.563162] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3466.308528] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3466.980500] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3467.622524] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3468.256820] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3468.870675] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3469.630178] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3470.202089] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3470.860896] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3471.512541] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3472.150150] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3472.770041] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3473.434583] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3474.125621] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3474.806676] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3475.477385] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3476.199803] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3477.024236] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3477.796497] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3478.522793] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3479.090968] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3479.678807] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3480.300462] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3480.948115] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3481.523408] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3482.246915] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3482.931727] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3483.716616] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3484.594898] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3485.336119] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3486.023186] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3486.851266] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3487.479565] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3488.247344] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3488.902196] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3489.722765] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3490.430945] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3491.302147] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3492.052384] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3492.770641] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3493.486292] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3494.177082] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3494.860551] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3495.472940] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3496.144121] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3496.825698] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3497.458553] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3498.166063] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3498.882291] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3499.572247] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3500.222934] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3500.885542] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3501.600033] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3502.278592] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3502.922792] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3503.537903] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3504.136882] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3505.014642] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3505.615123] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3506.314544] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3507.254490] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3508.068160] LustreError: 139337:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 3508.077891] LustreError: 139337:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 3508.083991] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3508.823969] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3509.812603] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3510.785301] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3511.640995] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3512.668497] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3513.491954] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3514.340078] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3515.311102] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3516.187405] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3517.247109] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3518.519823] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3520.148166] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3521.521500] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3522.580087] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3523.658870] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3524.493502] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3526.037402] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3527.268389] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3528.517360] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3529.789488] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3530.548862] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3532.147729] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3533.117384] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3533.970637] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3535.113743] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3536.289562] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3538.086838] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3539.619627] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3541.035538] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3542.549736] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3544.024312] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3545.293816] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3546.535317] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3547.357295] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3548.548043] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3549.535402] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3550.507835] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3551.885313] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3553.000155] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3554.084693] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3555.309828] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3557.102049] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3558.661701] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3559.936405] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3561.082383] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3562.139958] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3563.286188] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3564.319849] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3565.037282] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3566.054154] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3567.279726] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3568.295786] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3569.020663] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3569.737087] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3570.749438] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3571.851565] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3572.775604] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3573.565396] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3574.466177] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3575.392799] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3576.449742] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3577.363728] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3578.214602] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3579.093521] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3579.908172] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3580.745362] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3581.783984] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3582.722187] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3583.586644] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3584.396558] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3585.247954] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3586.136445] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3587.090043] LustreError: 139337:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 3587.104481] LustreError: 139337:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 3587.108701] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3587.938256] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3588.879650] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3589.741423] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3590.613193] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3591.446420] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3592.300426] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3592.962751] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3593.764846] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3594.519873] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3595.397092] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3596.384445] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3597.339910] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3598.086543] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3598.888689] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3599.743560] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3600.643883] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3601.593801] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3602.453343] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3603.316168] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3604.256315] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3605.188282] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3606.113845] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3606.874979] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3607.671404] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3608.465703] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3609.312912] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3610.020112] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3610.775295] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3611.532680] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3612.288187] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3613.007587] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3613.833713] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3614.642774] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3615.542955] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3616.299991] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3617.112588] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3617.794990] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3618.506444] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3619.257370] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3620.079311] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3620.895040] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3621.715407] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3622.492910] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3623.310854] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3624.060330] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3624.067676] Lustre: Skipped 329 previous similar messages [ 3624.079712] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3624.093290] Lustre: Skipped 329 previous similar messages [ 3624.097947] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3624.106223] Lustre: Skipped 329 previous similar messages [ 3624.110859] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3624.127572] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3624.140660] Lustre: Skipped 329 previous similar messages [ 3624.910380] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3625.662032] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3626.448386] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3627.027665] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3627.697692] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3628.352295] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3629.032697] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3629.965454] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3630.669061] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3631.239247] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3631.869199] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3632.632508] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3633.444290] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3634.068855] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3634.721328] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3635.340794] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3636.075383] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3636.668872] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3637.431978] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3638.100853] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3639.014487] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3639.783126] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3640.588378] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3641.300767] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3642.092388] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3642.974703] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3644.014142] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3644.690791] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3645.448322] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3646.070633] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3646.850442] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3647.649646] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3648.462497] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3649.208783] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3650.086922] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3650.911288] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3651.831240] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3653.100625] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3654.003300] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3655.032194] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3656.363976] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3657.123347] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3658.155572] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3659.142663] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3660.111038] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3661.064706] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3661.967328] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3662.944489] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3663.825950] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3664.892635] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3665.972521] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3667.237542] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3668.189639] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3669.250268] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3670.283130] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3671.204241] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3672.591677] LustreError: 139337:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 3672.609698] LustreError: 139337:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 3672.614183] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3674.103691] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3675.194798] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3676.451623] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3677.250924] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3678.421147] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3679.153127] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3680.030385] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3681.185981] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3682.132303] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3683.207545] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3684.394233] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3685.406925] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3686.874953] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3688.185309] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3689.129398] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3689.934893] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3691.113079] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3692.434775] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3693.287470] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3694.345151] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3695.371569] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3696.298076] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3697.051225] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3698.123772] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3698.957964] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3699.977155] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3701.238668] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3702.267524] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3703.299790] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3704.500821] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3705.415247] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3706.504641] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3707.469817] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3708.401463] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3709.152147] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3709.875366] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3710.779166] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3712.146046] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3713.099807] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3714.155350] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3715.087739] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3716.373184] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3717.245762] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3718.396800] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3719.617581] LustreError: 139337:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 3719.648331] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3719.649607] LustreError: 139337:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 3720.449597] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3721.309069] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3722.237961] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3723.222889] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3724.268435] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3725.139619] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3726.252514] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3727.307045] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3728.261614] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3729.479306] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3730.527883] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3731.558207] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3733.011708] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3734.365683] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3735.801790] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3736.753586] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3738.300336] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3739.442318] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3740.618078] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3741.643626] LustreError: 139337:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 3741.658101] LustreError: 139337:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 3741.707941] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3742.894101] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3743.972792] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3744.787728] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3745.939332] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3746.779690] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3747.696771] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3748.489303] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3749.346630] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3750.196593] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3751.178331] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3752.096459] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3752.761274] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3753.558357] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3754.528546] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3755.435620] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3756.229809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3757.119334] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3757.848834] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3758.768993] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3759.648033] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3760.518230] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3761.230658] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3762.232814] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3763.240886] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3764.472154] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3765.401378] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3766.409733] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3767.604758] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3768.744229] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3770.046467] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3771.219624] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3772.440240] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3773.790948] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3775.122689] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3776.400246] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3777.470011] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3778.335404] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3779.605454] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3780.902040] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3781.985436] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3783.042319] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3784.140203] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3785.459665] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3786.425421] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3787.513435] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3788.634455] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3789.724982] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3790.590951] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3791.870370] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3793.017742] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3794.261860] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3795.175915] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3796.148183] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3797.149626] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3798.142388] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3798.989359] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3799.862492] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3800.639219] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3801.592234] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3802.313719] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3803.120977] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3804.036955] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3804.992893] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3805.755125] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3806.583671] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3807.489288] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3808.605943] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3809.447692] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3810.175429] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3810.919416] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3812.086068] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3812.912023] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3813.797182] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3814.557710] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3815.309480] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3816.227537] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3816.942045] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3817.809108] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3818.776488] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3819.806074] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3820.742730] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3821.809627] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3822.707686] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3823.761421] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3824.734159] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3825.713382] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3826.534906] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3827.354951] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3828.338341] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3829.635069] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3830.595287] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3831.601413] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3832.737822] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3833.708829] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3834.703379] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3835.693357] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3836.730722] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3837.794196] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3838.863553] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3839.859687] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3840.813877] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3841.703783] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3842.661356] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3843.631169] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3844.649501] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3845.622484] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3846.697732] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3847.702966] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3848.680853] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3849.648714] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3850.470861] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3851.475512] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3852.437782] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3853.485695] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3854.459085] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3855.387535] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3856.442935] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3857.354803] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3858.387975] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3859.125355] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3859.857183] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3860.609323] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3861.478363] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3862.300549] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3863.237903] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3864.014435] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3864.690632] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3865.480985] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3866.508324] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3867.332827] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3868.153340] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3868.928794] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3869.771182] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3870.685846] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3871.637435] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3872.500618] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4350.575473] LustreError: 140231:0:(ofd_dev.c:1780:ofd_create_hdl()) lustre-OST0000: unable to precreate: rc = -28 [ 4350.606114] LustreError: 139337:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -28 [ 5037.042175] LustreError: lustre-OST0000-osc-MDT0000: operation ost_destroy to node 0@lo failed: rc = -107 [ 5037.044682] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5037.048457] LustreError: Skipped 1 previous similar message [ 5037.060985] Lustre: Skipped 258 previous similar messages [ 5037.066467] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5038.048439] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5038.389863] Lustre: server umount lustre-OST0000 complete [ 5042.276270] Lustre: server umount lustre-MDT0000 complete [ 5057.260627] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing unload_modules_local [ 5062.788706] Key type lgssc unregistered [ 5063.592582] LNet: 193455:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5063.639625] LNetError: 193455:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5063.675497] LNet: Removed LNI 192.168.203.156@tcp [ 5065.342412] Key type .llcrypt unregistered [ 5065.348847] Key type ._llcrypt unregistered [ 5093.306548] Key type ._llcrypt registered [ 5093.308578] Key type .llcrypt registered [ 5093.435596] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local [ 5094.221846] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5094.285432] alg: No test for adler32 (adler32-zlib) [ 5095.411571] Lustre: Lustre: Build Version: 2.17.58_2_g8df9471 [ 5095.696961] LNet: Added LNI 192.168.203.156@tcp [8/256/0/180] [ 5097.351276] Key type lgssc registered [ 5098.493203] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5105.026735] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5105.037284] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5106.738303] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5113.003883] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 5122.524495] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 5131.515848] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5131.965673] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5137.432401] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 5145.413228] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 5151.766823] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:49763 to 0x240000400:49794) [ 5161.171602] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5163.223838] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5163.237517] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5163.251328] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5163.280038] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5163.283429] LustreError: 194884:0:(osp_precreate.c:1268:osp_precreate_thread()) cfs_fail_timeout id 2107 sleeping for 20000ms [ 5167.077457] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5167.095147] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5171.717788] Lustre: server umount lustre-OST0000 complete [ 5183.312700] LustreError: 194884:0:(osp_precreate.c:1268:osp_precreate_thread()) cfs_fail_timeout id 2107 awake [ 5208.775424] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5209.324395] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5216.586955] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 5223.895883] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 5232.812113] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5232.844093] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5236.064866] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 9 sec [ 5246.016763] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff9d97d27f8000.ost_server_uuid 50 [ 5249.231489] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff9d97d27f8000.ost_server_uuid in FULL state after 0 sec [ 5254.629406] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 5254.646857] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5254.673639] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5254.686879] Lustre: Skipped 1 previous similar message [ 5256.250826] Lustre: server umount lustre-OST0000 complete [ 5262.949325] Lustre: server umount lustre-MDT0000 complete [ 5276.504746] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing unload_modules_local [ 5280.165979] Key type lgssc unregistered [ 5280.591648] LNet: 199003:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5280.602280] LNetError: 199003:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5280.630618] LNet: Removed LNI 192.168.203.156@tcp [ 5282.053767] Key type .llcrypt unregistered [ 5282.065626] Key type ._llcrypt unregistered [ 5315.171217] Key type ._llcrypt registered [ 5315.174045] Key type .llcrypt registered [ 5315.296970] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local [ 5316.343989] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5316.436035] alg: No test for adler32 (adler32-zlib) [ 5317.457398] Lustre: Lustre: Build Version: 2.17.58_2_g8df9471 [ 5317.637326] LNet: Added LNI 192.168.203.156@tcp [8/256/0/180] [ 5319.311203] Key type lgssc registered [ 5320.535180] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5330.596042] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5330.633189] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5332.126427] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5337.110612] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 5340.120307] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 5347.471338] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5348.021117] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5354.504449] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 5357.235906] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:49796 to 0x240000400:49826) [ 5363.705254] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5363.861535] Lustre: lustre-OST0001: new disk, initializing [ 5363.864903] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 5363.870891] Lustre: 202268:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 5363.946611] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 5371.038658] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost [ 5371.047896] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] [ 5371.087193] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 [ 5371.309124] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 5382.613381] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 5389.502721] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 5402.083843] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5402.088444] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5402.098365] Lustre: Skipped 1 previous similar message [ 5402.116593] Lustre: Skipped 1 previous similar message [ 5403.984143] Lustre: server umount lustre-MDT0000 complete [ 5407.986888] LustreError: 200654:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788923707 with bad export cookie 5665043339184879829 [ 5407.991341] LustreError: MGC192.168.203.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5407.999570] LustreError: 200654:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 5408.080313] Lustre: server umount lustre-OST0000 complete [ 5411.759346] Lustre: server umount lustre-OST0001 complete [ 5429.891224] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local [ 5439.375051] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5439.988458] Lustre: mylustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5444.051453] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 5446.888815] Lustre: 205476:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 5452.683562] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5453.015278] Lustre: mylustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5458.876241] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 5464.303876] Lustre: mylustre-OST0000: new connection from mylustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:49828 to 0x240000400:49858) [ 5467.368971] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5467.584463] Lustre: mylustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 5472.752672] Lustre: mylustre-OST0001: new connection from mylustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:3 to 0x280000400:33) [ 5473.936272] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 5480.852933] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 5484.658728] Lustre: 207338:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 5494.592548] Lustre: server umount mylustre-MDT0000 complete [ 5498.314363] LustreError: 205029:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788923797 with bad export cookie 5665043339184882041 [ 5498.331627] LustreError: MGC192.168.203.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5508.677206] Lustre: server umount mylustre-OST0000 complete [ 5521.297206] Lustre: server umount mylustre-OST0001 complete [ 5539.933526] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local [ 5550.475496] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5551.159047] Lustre: tfs-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5555.716216] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 5558.559411] Lustre: 209762:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 5564.884037] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5571.274935] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 5576.428340] LustreError: 210113:0:(ldlm_lib.c:1190:target_handle_connect()) tfs-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5576.447104] Lustre: tfs-OST0000: new connection from tfs-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:49828 to 0x240000400:49890) [ 5576.450140] LustreError: 210113:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 5579.936677] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5585.429847] Lustre: tfs-OST0001: new connection from tfs-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:35 to 0x280000400:65) [ 5586.875170] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 5595.084965] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 5598.236909] Lustre: 211624:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 5605.857597] Lustre: tfs-MDT0000-lwp-OST0001: Connection to tfs-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5605.879232] Lustre: tfs-MDT0000: Not available for connect from 0@lo (stopping) [ 5606.328729] Lustre: server umount tfs-MDT0000 complete [ 5610.109295] LustreError: 209316:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788923909 with bad export cookie 5665043339184883497 [ 5610.132326] LustreError: MGC192.168.203.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5610.243457] Lustre: server umount tfs-OST0000 complete [ 5614.351701] Lustre: server umount tfs-OST0001 complete [ 5632.619798] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local [ 5643.156573] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5643.751931] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5643.761028] Lustre: Skipped 2 previous similar messages [ 5648.284984] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 5651.562566] Lustre: 213990:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 5658.731568] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5666.089924] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 5669.351218] LustreError: 214342:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5669.372540] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:49828 to 0x240000400:49922) [ 5674.478648] LustreError: 214342:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5674.648562] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5680.120940] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:35 to 0x280000400:97) [ 5680.738828] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 5688.315428] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 5691.584698] Lustre: 215855:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 5698.269797] Lustre: DEBUG MARKER: == conf-sanity test 104a: Make sure user defined options are reflected in mount ========================================================== 23:19:55 (1788923995) [ 5715.936886] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5715.938267] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5715.962653] Lustre: Skipped 2 previous similar messages [ 5715.989259] Lustre: Skipped 2 previous similar messages [ 5720.932748] Lustre: server umount lustre-MDT0000 complete [ 5724.677449] LustreError: 213542:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788924023 with bad export cookie 5665043339184884757 [ 5724.684092] LustreError: MGC192.168.203.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5724.690989] LustreError: 213542:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 5730.838785] Lustre: server umount lustre-OST0000 complete [ 5741.347481] Lustre: server umount lustre-OST0001 complete [ 5751.806832] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_hostid [ 5762.462863] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local [ 5790.918093] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5791.131761] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 5791.163832] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 5791.240590] Lustre: lustre-MDT0000: new disk, initializing [ 5791.343116] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 188-180 [ 5791.346027] Lustre: Skipped 2 previous similar messages [ 5791.370617] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 5796.248313] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 5807.271423] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5807.730793] Lustre: lustre-OST0000: new disk, initializing [ 5807.735516] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 5807.740156] Lustre: Skipped 1 previous similar message [ 5807.746144] Lustre: 219385:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 5814.424533] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 5814.778890] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 5814.796483] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 5814.840741] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 5825.284205] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5825.418951] Lustre: lustre-OST0001: new disk, initializing [ 5825.423259] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 5825.428410] Lustre: 220249:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 5827.532257] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost [ 5827.546974] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] [ 5827.583865] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 [ 5831.797618] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 5844.254946] Lustre: DEBUG MARKER: == conf-sanity test 104b: Mount uses last flock argument ========================================================== 23:22:21 (1788924141) [ 5859.350538] Lustre: DEBUG MARKER: == conf-sanity test 105: check file creation for ro and rw bind mnt pt ========================================================== 23:22:36 (1788924156) [ 5876.193384] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 5876.204483] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5876.223878] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5881.212401] Lustre: server umount lustre-OST0000 complete [ 5883.874059] LustreError: 219368:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5888.992974] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5889.016948] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5889.022829] Lustre: Skipped 1 previous similar message [ 5891.749721] Lustre: server umount lustre-MDT0000 complete [ 5903.768406] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing unload_modules_local [ 5910.495216] Lustre: 199935:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788924193/real 1788924193] req@ffff8ec695692300 x1875822369743616/t0(0) o400->MGC192.168.203.156@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788924209 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 5910.537344] LustreError: MGC192.168.203.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5977.486032] Lustre: server umount lustre-OST0001 complete [ 5984.460673] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_hostid [ 6001.018215] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local [ 6039.378651] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6039.568693] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 6039.591229] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 6039.660916] Lustre: lustre-MDT0000: new disk, initializing [ 6039.749161] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6039.763636] Lustre: Skipped 2 previous similar messages [ 6039.784106] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 6046.320222] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 6056.903353] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 6063.656660] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6063.990726] Lustre: lustre-OST0000: new disk, initializing [ 6063.994283] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 6063.998276] Lustre: Skipped 1 previous similar message [ 6064.004305] Lustre: 225480:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 6065.260662] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 6065.272841] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 6065.295944] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 6070.409811] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 6080.082227] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 6090.727081] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6090.745060] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 6090.769987] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6091.971663] Lustre: server umount lustre-OST0000 complete [ 6096.516243] Lustre: server umount lustre-MDT0000 complete [ 6112.116937] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing unload_modules_local [ 6115.310893] Key type lgssc unregistered [ 6115.642790] LNet: 227030:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6115.656346] LNetError: 227030:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6115.672382] LNet: Removed LNI 192.168.203.156@tcp [ 6116.592160] Key type .llcrypt unregistered [ 6116.593846] Key type ._llcrypt unregistered [ 6145.690499] Key type ._llcrypt registered [ 6145.693617] Key type .llcrypt registered [ 6145.827309] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local [ 6147.133900] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6147.161049] alg: No test for adler32 (adler32-zlib) [ 6148.246569] Lustre: Lustre: Build Version: 2.17.58_2_g8df9471 [ 6148.647091] LNet: Added LNI 192.168.203.156@tcp [8/256/0/180] [ 6150.367170] Key type lgssc registered [ 6151.737511] Lustre: Echo OBD driver; http://www.lustre.org/ [ 6160.347591] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 6160.391662] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6161.931558] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6166.582345] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 6173.221686] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 6179.682212] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6180.076217] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6186.233264] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:3 to 0x240000400:33) [ 6187.498524] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 6197.037664] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 6198.448045] Lustre: Setting parameter lustre-OST0000.ost.unknown_param=50 in log lustre-OST0000 [ 6201.824599] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 6201.845070] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6201.863976] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6206.954301] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6212.066739] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6215.135179] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 6215.308181] Lustre: server umount lustre-OST0000 complete [ 6219.388728] Lustre: server umount lustre-MDT0000 complete [ 6233.513441] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing unload_modules_local [ 6236.933442] Key type lgssc unregistered [ 6237.339776] LNet: 230959:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6237.352526] LNetError: 230959:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6237.371318] LNet: Removed LNI 192.168.203.156@tcp [ 6238.567799] Key type .llcrypt unregistered [ 6238.572570] Key type ._llcrypt unregistered [ 6256.413303] Key type ._llcrypt registered [ 6256.417857] Key type .llcrypt registered [ 6256.605624] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local [ 6257.800461] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6257.998102] alg: No test for adler32 (adler32-zlib) [ 6259.239318] Lustre: Lustre: Build Version: 2.17.58_2_g8df9471 [ 6259.575076] LNet: Added LNI 192.168.203.156@tcp [8/256/0/180] [ 6261.255235] Key type lgssc registered [ 6263.005059] Lustre: Echo OBD driver; http://www.lustre.org/ [ 6275.460648] Lustre: lustre-OST0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 6275.491842] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6291.103516] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 6296.223326] LustreError: 232148:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.203.156@tcp: failed processing log, type 4: rc = -110 [ 6322.847375] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6328.463544] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 6335.973798] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 6337.767865] Lustre: server umount lustre-OST0000 complete [ 6354.579595] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing unload_modules_local [ 6357.727281] Key type lgssc unregistered [ 6358.108924] LNet: 233623:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6358.116296] LNetError: 233623:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6358.158210] LNet: Removed LNI 192.168.203.156@tcp [ 6359.069376] Key type .llcrypt unregistered [ 6359.072170] Key type ._llcrypt unregistered [ 6394.556696] Key type ._llcrypt registered [ 6394.562822] Key type .llcrypt registered [ 6394.719235] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local [ 6395.982888] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6396.064514] alg: No test for adler32 (adler32-zlib) [ 6397.102638] Lustre: Lustre: Build Version: 2.17.58_2_g8df9471 [ 6397.310712] LNet: Added LNI 192.168.203.156@tcp [8/256/0/180] [ 6399.087190] Key type lgssc registered [ 6400.304544] Lustre: Echo OBD driver; http://www.lustre.org/ [ 6414.995054] loop0: detected capacity change from 0 to 204800000 [ 6415.341681] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 6415.357499] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 6415.728656] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 6416.910320] loop0: detected capacity change from 0 to 204800000 [ 6417.144743] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 6417.157992] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 6417.721177] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 6418.841181] loop0: detected capacity change from 0 to 204800000 [ 6419.136177] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 6419.144793] blk_update_request: operation not supported error, dev loop0, sector 8224 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 6419.348785] blk_update_request: operation not supported error, dev loop0, sector 58264 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 6420.522798] loop0: detected capacity change from 0 to 204800000 [ 6420.759405] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 6420.777590] blk_update_request: operation not supported error, dev loop0, sector 8224 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 6420.960626] blk_update_request: operation not supported error, dev loop0, sector 58264 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 6422.091940] loop0: detected capacity change from 0 to 204800000 [ 6422.129722] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 6426.683852] loop0: detected capacity change from 0 to 204800000 [ 6426.706343] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 6430.762885] loop0: detected capacity change from 0 to 204800000 [ 6430.809955] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 6434.807497] loop0: detected capacity change from 0 to 204800000 [ 6434.867524] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 6438.947588] loop0: detected capacity change from 0 to 204800000 [ 6439.054344] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 6439.116615] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6439.252528] Lustre: 236888:0:(osd_scrub.c:1857:osd_index_restore()) lustre-MDT0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 6439.268500] Lustre: 236888:0:(osd_scrub.c:1857:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000003:0xa:0x0]: rc = 0 [ 6439.282894] Lustre: 236888:0:(osd_scrub.c:1857:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000003:0xb:0x0]: rc = 0 [ 6439.297498] Lustre: 236888:0:(osd_scrub.c:1857:osd_index_restore()) lustre-MDT0000: restore index '0x1010000-MDT0000' with [0x200000005:0x2:0x0]: rc = 0 [ 6439.310511] Lustre: 236888:0:(osd_scrub.c:1857:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000003:0xc:0x0]: rc = 0 [ 6439.319460] Lustre: 236888:0:(osd_scrub.c:1857:osd_index_restore()) lustre-MDT0000: restore index '0x2010000-MDT0000' with [0x200000005:0x3:0x0]: rc = 0 [ 6439.330800] Lustre: 236888:0:(osd_scrub.c:1857:osd_index_restore()) lustre-MDT0000: restore index '0x10000-MDT0000' with [0x200000005:0x1:0x0]: rc = 0 [ 6439.338096] Lustre: 236888:0:(osd_scrub.c:1857:osd_index_restore()) lustre-MDT0000: restore index 'nodemap' with [0x200000003:0x3:0x0]: rc = 0 [ 6439.346679] Lustre: 236888:0:(osd_scrub.c:1857:osd_index_restore()) lustre-MDT0000: restore index '0x2020000' with [0x200000006:0x2020000:0x0]: rc = 0 [ 6439.355398] Lustre: 236888:0:(osd_scrub.c:1857:osd_index_restore()) lustre-MDT0000: restore index '0x20000' with [0x200000006:0x20000:0x0]: rc = 0 [ 6439.364132] Lustre: 236888:0:(osd_scrub.c:1857:osd_index_restore()) lustre-MDT0000: restore index '0x1020000' with [0x200000006:0x1020000:0x0]: rc = 0 [ 6439.372456] Lustre: 236888:0:(osd_scrub.c:1857:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000006:0x10000:0x0]: rc = 0 [ 6439.379615] Lustre: 236888:0:(osd_scrub.c:1857:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000006:0x1010000:0x0]: rc = 0 [ 6439.390721] Lustre: 236888:0:(osd_scrub.c:1857:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000006:0x2010000:0x0]: rc = 0 [ 6446.014401] Lustre: server umount MGS complete [ 6446.941945] loop0: detected capacity change from 0 to 204800000 [ 6447.025386] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6447.456176] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6447.494789] Lustre: lustre-MDT0000: Aborting client recovery [ 6448.409416] loop1: detected capacity change from 0 to 204800000 [ 6448.569321] LDISKFS-fs (loop1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6448.712801] Lustre: 237320:0:(osd_scrub.c:1857:osd_index_restore()) lustre-MDT0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 6448.733357] Lustre: 237320:0:(osd_scrub.c:1857:osd_index_restore()) lustre-MDT0001: restore index '0x2010000-MDT0001' with [0x200000005:0x3:0x0]: rc = 0 [ 6448.754252] Lustre: 237320:0:(osd_scrub.c:1857:osd_index_restore()) lustre-MDT0001: restore index '0x10000' with [0x200000003:0x4:0x0]: rc = 0 [ 6448.774426] Lustre: 237320:0:(osd_scrub.c:1857:osd_index_restore()) lustre-MDT0001: restore index '0x10000-MDT0001' with [0x200000005:0x1:0x0]: rc = 0 [ 6448.801901] Lustre: 237320:0:(osd_scrub.c:1857:osd_index_restore()) lustre-MDT0001: restore index '0x1010000' with [0x200000003:0x5:0x0]: rc = 0 [ 6448.815132] Lustre: 237320:0:(osd_scrub.c:1857:osd_index_restore()) lustre-MDT0001: restore index '0x2010000' with [0x200000003:0x6:0x0]: rc = 0 [ 6448.825553] Lustre: 237320:0:(osd_scrub.c:1857:osd_index_restore()) lustre-MDT0001: restore index '0x1010000-MDT0001' with [0x200000005:0x2:0x0]: rc = 0 [ 6448.848149] Lustre: Found index 1 for lustre-MDT0001, updating log [ 6449.016697] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6449.088820] Lustre: lustre-MDT0001: Aborting client recovery [ 6450.019000] loop2: detected capacity change from 0 to 204800000 [ 6450.147426] LDISKFS-fs (loop2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6450.277302] Lustre: 237399:0:(osd_scrub.c:1857:osd_index_restore()) lustre-OST0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 6450.287259] Lustre: 237399:0:(osd_scrub.c:1857:osd_index_restore()) lustre-OST0000: restore index '0x20000-OST0000' with [0x200000005:0x1:0x0]: rc = 0 [ 6450.305283] Lustre: 237399:0:(osd_scrub.c:1857:osd_index_restore()) lustre-OST0000: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 6450.324768] Lustre: 237399:0:(osd_scrub.c:1857:osd_index_restore()) lustre-OST0000: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 6450.337703] Lustre: 237399:0:(osd_scrub.c:1857:osd_index_restore()) lustre-OST0000: restore index '0x1020000-OST0000' with [0x200000005:0x2:0x0]: rc = 0 [ 6450.356857] Lustre: 237399:0:(osd_scrub.c:1857:osd_index_restore()) lustre-OST0000: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 6450.373238] Lustre: 237399:0:(osd_scrub.c:1857:osd_index_restore()) lustre-OST0000: restore index '0x2020000-OST0000' with [0x200000005:0x3:0x0]: rc = 0 [ 6450.508569] Lustre: Found index 0 for lustre-OST0000, updating log [ 6450.545549] Lustre: 237418:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 6450.609464] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6450.636493] Lustre: lustre-OST0000: Aborting recovery [ 6451.560142] loop3: detected capacity change from 0 to 204800000 [ 6451.732754] LDISKFS-fs (loop3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6451.793736] Lustre: 237485:0:(osd_scrub.c:1857:osd_index_restore()) lustre-OST0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 6451.821400] Lustre: 237485:0:(osd_scrub.c:1857:osd_index_restore()) lustre-OST0001: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 6451.836901] Lustre: 237485:0:(osd_scrub.c:1857:osd_index_restore()) lustre-OST0001: restore index '0x1020000-OST0001' with [0x200000005:0x2:0x0]: rc = 0 [ 6451.854433] Lustre: 237485:0:(osd_scrub.c:1857:osd_index_restore()) lustre-OST0001: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 6451.866549] Lustre: 237485:0:(osd_scrub.c:1857:osd_index_restore()) lustre-OST0001: restore index '0x20000-OST0001' with [0x200000005:0x1:0x0]: rc = 0 [ 6451.876590] Lustre: 237485:0:(osd_scrub.c:1857:osd_index_restore()) lustre-OST0001: restore index '0x2020000-OST0001' with [0x200000005:0x3:0x0]: rc = 0 [ 6451.896099] Lustre: 237485:0:(osd_scrub.c:1857:osd_index_restore()) lustre-OST0001: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 6451.918918] Lustre: Found index 1 for lustre-OST0001, updating log [ 6451.990899] Lustre: 237489:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 6452.112402] Lustre: lustre-OST0001: Aborting recovery [ 6457.254781] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 6457.259216] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 6457.310956] LustreError: 237264:0:(lod_dev.c:511:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 10, retries 0, failed: rc = -108 [ 6457.316901] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000bd0 [ 6457.338347] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000bd0 [ 6459.303683] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:5 to 0x280000400:33) [ 6459.304225] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:5 to 0x2c0000400:33) [ 6460.957737] LustreError: 237231:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0000: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0000 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0000/identity_upcall, time 626us: rc = -2 [ 6461.462129] LustreError: 237231:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0000: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0000 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0000/identity_upcall, time 748us: rc = -2 [ 6461.484534] LustreError: 237231:0:(mdt_identity.c:115:mdt_identity_do_upcall()) Skipped 22 previous similar messages [ 6474.720385] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 6474.722043] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6474.722739] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6474.754581] Lustre: Skipped 3 previous similar messages [ 6479.844366] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6479.848334] Lustre: Skipped 4 previous similar messages [ 6480.774966] Lustre: server umount lustre-MDT0000 complete [ 6481.714498] LustreError: 237215:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788924780 with bad export cookie 5447294823898455839 [ 6481.722541] LustreError: MGC192.168.203.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6484.961391] LustreError: 237426:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6484.967878] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6484.969963] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 6484.984062] LustreError: 237426:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [ 6485.002070] Lustre: Skipped 1 previous similar message [ 6487.007660] LustreError: 237228:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6487.008447] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 6487.016172] LustreError: 237228:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 6487.022663] Lustre: Skipped 2 previous similar messages [ 6491.104263] LustreError: 237228:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6491.108047] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 6491.113417] LustreError: 237228:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 6491.136447] Lustre: Skipped 1 previous similar message [ 6496.223346] Lustre: lustre-MDT0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 6496.227125] LustreError: 237426:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6496.258230] LustreError: 237426:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 6496.585120] Lustre: server umount lustre-MDT0001 complete [ 6503.958838] Lustre: server umount lustre-OST0000 complete [ 6511.254377] Lustre: server umount lustre-OST0001 complete [ 6518.568930] Lustre: DEBUG MARKER: == conf-sanity test 109a: test lctl clear_conf fsname ==== 23:33:35 (1788924815) [ 6541.684335] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_hostid [ 6553.021958] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local [ 6586.768328] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6587.042565] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 6587.082367] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 6587.163662] Lustre: lustre-MDT0000: new disk, initializing [ 6587.268268] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6587.277604] Lustre: Skipped 1 previous similar message [ 6587.321793] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 6592.997100] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 6603.068852] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 6610.775643] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6611.094589] Lustre: lustre-OST0000: new disk, initializing [ 6611.098173] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 6611.103551] Lustre: Skipped 1 previous similar message [ 6611.111472] Lustre: 241986:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 6611.214293] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6618.440585] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 6619.287620] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 6619.316321] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 6619.349162] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 6628.917918] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 6634.646341] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 6646.694324] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 6658.242089] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 6667.339341] Lustre: Modifying parameter lustre-client.llite.max_read_ahead_mb=64 in log lustre-client [ 6711.265125] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6711.303391] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6711.305685] Lustre: Skipped 2 previous similar messages [ 6716.391555] Lustre: server umount lustre-OST0000 complete [ 6719.923955] Lustre: server umount lustre-MDT0000 complete [ 6728.045595] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6732.838777] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 6740.082078] Lustre: server umount MGS complete [ 6754.877544] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6755.647249] LustreError: 245746:0:(qmt_pool.c:1639:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 6755.756754] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6760.307455] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 6768.255908] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 6775.310473] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6775.673407] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6781.604673] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 6788.858630] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 6821.859917] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6821.867777] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 6821.873942] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6825.260516] Lustre: server umount lustre-OST0000 complete [ 6830.563397] Lustre: server umount lustre-MDT0000 complete [ 6842.833291] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing unload_modules_local [ 6845.847430] Key type lgssc unregistered [ 6846.177512] LNet: 248509:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6846.183154] LNetError: 248509:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6846.206265] LNet: Removed LNI 192.168.203.156@tcp [ 6847.080212] Key type .llcrypt unregistered [ 6847.088790] Key type ._llcrypt unregistered [ 6878.900890] Key type ._llcrypt registered [ 6878.908360] Key type .llcrypt registered [ 6879.065260] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_hostid [ 6893.193710] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local [ 6894.248076] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6894.276679] alg: No test for adler32 (adler32-zlib) [ 6895.527368] Lustre: Lustre: Build Version: 2.17.58_2_g8df9471 [ 6895.946684] LNet: Added LNI 192.168.203.156@tcp [8/256/0/180] [ 6897.671283] Key type lgssc registered [ 6898.723716] Lustre: Echo OBD driver; http://www.lustre.org/ [ 6926.638288] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 6926.686464] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6928.238596] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 6928.316633] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 6928.500486] Lustre: lustre-MDT0000: new disk, initializing [ 6928.726065] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6928.747800] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 6933.822965] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 6943.436270] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 6950.146099] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6950.470223] Lustre: lustre-OST0000: new disk, initializing [ 6950.479179] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 6950.486072] Lustre: Skipped 1 previous similar message [ 6950.523962] Lustre: 252896:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 6950.624121] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6957.758564] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 6957.772986] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 6957.806898] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 6958.626068] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 6968.282898] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 6977.045982] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 6989.601594] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 6995.056079] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 7001.772232] Lustre: Modifying parameter lustre-client.llite.max_read_ahead_mb=64 in log lustre-client [ 7039.975186] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 7039.975624] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7040.002908] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7044.684158] Lustre: server umount lustre-OST0000 complete [ 7049.209777] Lustre: server umount lustre-MDT0000 complete [ 7057.808483] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7062.697398] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 7067.611837] Lustre: server umount MGS complete [ 7078.382461] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7079.028488] LustreError: 256505:0:(qmt_pool.c:1639:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 7079.154458] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7084.076288] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 7091.720523] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 7098.394760] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7098.656502] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7105.358151] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 7112.948243] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 7140.835696] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 7140.837226] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7140.865051] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7145.954526] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7151.075099] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7154.143092] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 7154.268033] Lustre: server umount lustre-OST0000 complete [ 7157.793629] Lustre: server umount lustre-MDT0000 complete [ 7167.947989] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing unload_modules_local [ 7171.113331] Key type lgssc unregistered [ 7171.492475] LNet: 259272:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7171.506411] LNetError: 259272:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7172.524443] LNet: Removed LNI 192.168.203.156@tcp [ 7173.857539] Key type .llcrypt unregistered [ 7173.860078] Key type ._llcrypt unregistered [ 7197.052913] Key type ._llcrypt registered [ 7197.058105] Key type .llcrypt registered [ 7197.234408] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_hostid [ 7210.351499] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local [ 7211.328427] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7211.378420] alg: No test for adler32 (adler32-zlib) [ 7212.644756] Lustre: Lustre: Build Version: 2.17.58_2_g8df9471 [ 7212.934790] LNet: Added LNI 192.168.203.156@tcp [8/256/0/180] [ 7214.615295] Key type lgssc registered [ 7216.029894] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7238.959167] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local [ 7254.903309] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7254.999933] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7256.367167] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 7256.430724] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 7256.580614] Lustre: lustre-MDT0000: new disk, initializing [ 7256.676547] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7256.732053] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 7262.046458] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 7272.137919] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7272.447722] Lustre: lustre-OST0000: new disk, initializing [ 7272.456086] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 7272.464118] Lustre: Skipped 1 previous similar message [ 7272.467990] Lustre: 263295:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 7272.538980] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7278.713663] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 7282.787291] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 7282.796108] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 7282.833201] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 8127.459487] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8127.482134] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8131.205890] Lustre: server umount lustre-MDT0000 complete [ 8135.151502] LustreError: 262483:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788926434 with bad export cookie 6397170029199035704 [ 8135.161570] LustreError: MGC192.168.203.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8135.339296] Lustre: server umount lustre-OST0000 complete [ 8159.004892] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_hostid [ 8169.427296] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local [ 8202.263870] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8202.466833] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 8202.497117] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 8202.581469] Lustre: lustre-MDT0000: new disk, initializing [ 8202.712412] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8202.729374] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 8207.904600] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 8217.594470] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 8224.826302] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8225.046777] Lustre: lustre-OST0000: new disk, initializing [ 8225.051146] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 8225.055150] Lustre: Skipped 1 previous similar message [ 8225.059825] Lustre: 268249:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8225.174351] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8230.986992] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 8233.085337] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 8233.100972] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 8233.137206] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 8240.847350] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 8245.949391] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 8246.187816] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 8248.290569] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8248.311758] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8253.411395] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8254.278937] Lustre: server umount lustre-OST0000 complete [ 8259.133650] Lustre: server umount lustre-MDT0000 complete [ 8262.886936] Lustre: DEBUG MARKER: SKIP: conf-sanity test_111 skipping SLOW test 111 [ 8265.022933] Lustre: DEBUG MARKER: == conf-sanity test 112a: mount OST with no_create option ========================================================== 00:02:42 (1788926562) [ 8271.529737] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8272.057849] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8277.183133] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 8283.476489] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 8290.840060] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8291.294410] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8297.909822] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 8305.376562] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 8312.648535] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8312.846683] Lustre: lustre-OST0001: new disk, initializing [ 8312.852862] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 8312.871720] Lustre: 272012:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8312.975992] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 8319.087783] LustreError: 272332:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [ 8319.484277] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 8320.163167] LustreError: 272332:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [ 8321.186689] LustreError: 272332:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [ 8323.301374] LustreError: 272332:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [ 8323.327389] LustreError: 272332:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 1 previous similar message [ 8327.524452] LustreError: 272332:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [ 8327.558527] LustreError: 272332:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 3 previous similar messages [ 8329.488231] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 8329.764048] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 8335.778842] LustreError: 272332:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [ 8335.784840] LustreError: 272332:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 7 previous similar messages [ 8337.297286] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff9d97cc752000.ost_server_uuid 50 [ 8340.260975] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff9d97cc752000.ost_server_uuid in FULL state after 0 sec [ 8348.627642] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff9d97cc752000.ost_server_uuid 50 [ 8350.252621] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-ffff9d97cc752000.ost_server_uuid in IDLE state after 0 sec [ 8352.383056] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost [ 8352.400309] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] [ 8352.424133] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 [ 8365.791899] Lustre: lustre-OST0001: Not available for connect from 192.168.203.56@tcp (stopping) [ 8368.099097] LustreError: lustre-OST0001-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 8368.105910] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8368.120739] LustreError: Skipped 1 previous similar message [ 8370.152951] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 8370.160042] Lustre: Skipped 1 previous similar message [ 8379.871203] Lustre: lustre-OST0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 8380.072691] Lustre: server umount lustre-OST0001 complete [ 8385.508732] LustreError: 271001:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8385.527721] LustreError: 271001:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [ 8389.601191] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 8389.609086] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8389.623300] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8389.628763] Lustre: Skipped 3 previous similar messages [ 8390.634448] LustreError: 271004:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8391.822704] Lustre: server umount lustre-OST0000 complete [ 8395.557713] Lustre: server umount lustre-MDT0000 complete [ 8406.401925] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing unload_modules_local [ 8410.357847] Key type lgssc unregistered [ 8410.661298] LNet: 274490:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8410.670292] LNetError: 274490:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8410.699033] LNet: Removed LNI 192.168.203.156@tcp [ 8411.822940] Key type .llcrypt unregistered [ 8411.824587] Key type ._llcrypt unregistered [ 8457.093768] Key type ._llcrypt registered [ 8457.096347] Key type .llcrypt registered [ 8457.182992] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local [ 8457.960597] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8458.060454] alg: No test for adler32 (adler32-zlib) [ 8459.169605] Lustre: Lustre: Build Version: 2.17.58_2_g8df9471 [ 8459.455323] LNet: Added LNI 192.168.203.156@tcp [8/256/0/180] [ 8461.143174] Key type lgssc registered [ 8462.273433] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8471.147307] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 8471.191479] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8472.677785] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8476.659197] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 8478.951675] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 8486.159183] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8486.644663] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8495.320045] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 8497.911688] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:36 to 0x240000400:65) [ 8503.271669] LustreError: 277440:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8503.298091] LustreError: 277440:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 8506.401358] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8506.656281] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 8511.984260] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:3 to 0x280000400:33) [ 8512.598428] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 8522.981387] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 8536.776197] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 8552.935698] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8552.937826] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8552.947958] Lustre: Skipped 1 previous similar message [ 8552.958382] Lustre: Skipped 1 previous similar message [ 8555.055865] Lustre: server umount lustre-MDT0000 complete [ 8558.700644] LustreError: 276651:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788926857 with bad export cookie 1099958583094988009 [ 8558.705628] LustreError: MGC192.168.203.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8558.710917] LustreError: 276651:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 8558.848099] Lustre: server umount lustre-OST0000 complete [ 8562.425682] Lustre: server umount lustre-OST0001 complete [ 8576.651568] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local [ 8585.535365] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8585.924865] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8589.878598] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 8592.573796] Lustre: 281375:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 8598.843061] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8599.255732] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8605.094395] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 8610.552215] LustreError: 281729:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8610.571529] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:36 to 0x240000400:97) [ 8613.081137] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8613.310451] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 8618.498936] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:3 to 0x280000400:65) [ 8619.691165] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 8626.712788] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 8629.708520] Lustre: 283239:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 8633.825053] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8633.826153] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8633.837635] Lustre: Skipped 1 previous similar message [ 8638.957763] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8638.966990] Lustre: Skipped 2 previous similar messages [ 8639.478797] Lustre: server umount lustre-MDT0000 complete [ 8643.293430] LustreError: 280933:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788926942 with bad export cookie 1099958583094989255 [ 8643.313611] LustreError: MGC192.168.203.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8643.338458] LustreError: 280933:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 8643.515826] Lustre: server umount lustre-OST0000 complete [ 8648.549781] Lustre: server umount lustre-OST0001 complete [ 8652.512426] Lustre: DEBUG MARKER: SKIP: conf-sanity test_114 skipping SLOW test 114 [ 8654.404597] Lustre: DEBUG MARKER: SKIP: conf-sanity test_115 skipping excluded test 115 [ 8656.084603] Lustre: DEBUG MARKER: == conf-sanity test 116: big size MDT support ============ 00:09:13 (1788926953) [ 8677.659334] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local [ 8690.565197] loop0: detected capacity change from 0 to 1099511627776 [ 8691.945644] SGI XFS with ACLs, security attributes, quota, no debug enabled [ 8691.958155] *** VALIDATE xfs *** [ 8691.998213] XFS (loop0): Mounting V5 Filesystem [ 8692.067850] XFS (loop0): Ending clean mount [ 8694.198562] loop1: detected capacity change from 0 to 18691697672192 [ 8807.082969] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_hostid [ 8818.551931] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local [ 8847.672944] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8847.966760] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 8848.052166] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 8848.152352] Lustre: lustre-MDT0000: new disk, initializing [ 8848.242967] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8848.264295] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 8853.251727] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 8863.555543] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 8870.979532] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8871.298986] Lustre: lustre-OST0000: new disk, initializing [ 8871.303485] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 8871.310798] Lustre: Skipped 1 previous similar message [ 8871.320036] Lustre: 288603:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8872.751847] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 8872.761969] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 8872.815128] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 8878.016300] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 8889.724047] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 8895.172724] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 8895.449675] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 8898.539467] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 8898.550418] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8898.569833] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8903.664021] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8904.075974] Lustre: server umount lustre-OST0000 complete [ 8909.486353] Lustre: server umount lustre-MDT0000 complete [ 8920.566711] XFS (loop0): Unmounting Filesystem [ 8927.466298] Lustre: DEBUG MARKER: == conf-sanity test 117: lctl get_param return errors properly ========================================================== 00:13:43 (1788927223) [ 8935.489044] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8936.001695] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8936.005454] Lustre: Skipped 1 previous similar message [ 8940.864103] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 8949.127389] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 8955.742312] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8962.483315] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_default_debug -1 all [ 8969.356716] Lustre: DEBUG MARKER: oleg356-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 8980.962846] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 8980.975927] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8981.021079] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8983.434168] Lustre: server umount lustre-OST0000 complete [ 8988.409889] Lustre: server umount lustre-MDT0000 complete [ 9000.401517] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing unload_modules_local [ 9003.593309] Key type lgssc unregistered [ 9003.929462] LNet: 293206:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 9003.934917] LNetError: 293206:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 9003.946173] LNet: Removed LNI 192.168.203.156@tcp [ 9004.600628] Key type .llcrypt unregistered [ 9004.603665] Key type ._llcrypt unregistered [ 9034.587331] Key type ._llcrypt registered [ 9034.589988] Key type .llcrypt registered [ 9034.742773] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing set_hostid [ 9051.257439] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing load_modules_local [ 9052.539938] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 9052.775729] alg: No test for adler32 (adler32-zlib) [ 9053.958664] Lustre: Lustre: Build Version: 2.17.58_2_g8df9471 [ 9054.283664] LNet: Added LNI 192.168.203.156@tcp [8/256/0/180] [ 9056.023173] Key type lgssc registered [ 9057.581179] Lustre: Echo OBD driver; http://www.lustre.org/ [ 9081.313714] Lustre: DEBUG MARKER: == conf-sanity test complete, duration 8842 sec ========== 00:16:18 (1788927378) [ 9083.256036] Lustre: DEBUG MARKER: === conf-sanity: start cleanup 00:16:20 (1788927380) === [ 9086.231491] Lustre: DEBUG MARKER: === conf-sanity: finish cleanup 00:16:23 (1788927383) === [ 9120.987691] Lustre: DEBUG MARKER: oleg356-server.virtnet: executing unload_modules_local [ 9123.943672] Key type lgssc unregistered [ 9124.442776] LNet: 297822:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 9124.466420] LNetError: 297822:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 9124.492977] LNet: Removed LNI 192.168.203.156@tcp [ 9125.659546] Key type .llcrypt unregistered [ 9125.662546] Key type ._llcrypt unregistered