[ 0.000000] Linux version 4.18.0rh8.10-debug (green@maintenance) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-26) (GCC)) #2 SMP Mon Jul 14 01:24:22 EDT 2025 [ 0.000000] Command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffcdfff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffce000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x0000000146dfffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.8 present. [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-8.fc42 06/10/2025 [ 0.000000] Hypervisor detected: KVM [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 391512227 cycles [ 0.000000] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns [ 0.000000] tsc: Detected 2399.998 MHz processor [ 0.000000] last_pfn = 0x146e00 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0xbffce max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000f54b0-0x000f54bf] [ 0.000000] RAMDISK: [mem 0xbcc54000-0xbffbffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F52D0 000014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 0x00000000BFFE2439 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 0x00000000BFFE22D5 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 0x00000000BFFE0040 002295 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 0x00000000BFFE0000 000040 [ 0.000000] ACPI: APIC 0x00000000BFFE2349 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: HPET 0x00000000BFFE23D9 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: WAET 0x00000000BFFE2411 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0xbffe22d5-0xbffe2348] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe22d4] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0xbffe2349-0xbffe23d8] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0xbffe23d9-0xbffe2410] [ 0.000000] ACPI: Reserving WAET table memory at [mem 0xbffe2411-0xbffe2438] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x0000000146dfffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x1465a3000-0x1465cdfff] [ 0.000000] Reserving 256MB of memory at 2752MB for crashkernel (System RAM: 4205MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009efff] [ 0.000000] node 0: [mem 0x0000000000100000-0x00000000bffcdfff] [ 0.000000] node 0: [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Zeroed struct page in unavailable ranges: 4756 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x0000000146dfffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] TSC deadline timer available [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] kvm-guest: KVM setup pv remote TLB flush [ 0.000000] kvm-guest: setup PV sched yield [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbffce000-0xbfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.000000] [mem 0xc0000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u524288 [ 0.000000] kvm-guest: PV spinlocks enabled [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1059606 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] audit: disabled (until reboot) [ 0.000000] software IO TLB: area num 4. [ 0.000000] Memory: 2829652K/4306352K available (18435K kernel code, 11221K rwdata, 7248K rodata, 2908K init, 18040K bss, 524580K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] ftrace: allocating 41240 entries in 162 pages [ 0.000000] ftrace: allocated 162 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU event tracing is enabled. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=4. [ 0.000000] rcu: RCU callback double-/use-after-free debug enabled. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 [ 0.000000] NR_IRQS: 524544, nr_irqs: 456, preallocated irqs: 16 [ 0.000000] random: get_random_bytes called from start_kernel+0x622/0x9a8 with crng_init=0 [ 0.001000] Console: colour *CGA 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns [ 0.001009] APIC: Switch to symmetric I/O mode setup [ 0.002146] x2apic enabled [ 0.002945] Switched APIC routing to physical x2apic. [ 0.003006] kvm-guest: setup PV IPIs [ 0.004847] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.005000] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 0.005008] Calibrating delay loop (skipped) preset value.. 4799.99 BogoMIPS (lpj=2399998) [ 0.006004] pid_max: default: 32768 minimum: 301 [ 0.007067] LSM: Security Framework initializing [ 0.008024] Yama: becoming mindful. [ 0.009017] SELinux: Initializing. [ 0.009695] *** VALIDATE selinux *** [ 0.016362] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, vmalloc) [ 0.020635] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc) [ 0.021077] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.022059] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.023046] *** VALIDATE tmpfs *** [ 0.024317] *** VALIDATE proc *** [ 0.025158] *** VALIDATE cgroup *** [ 0.026004] *** VALIDATE cgroup2 *** [ 0.027167] x86/cpu: User Mode Instruction Prevention (UMIP) activated [ 0.028094] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.029002] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 [ 0.030015] Spectre V2 : User space: Vulnerable [ 0.030861] Speculative Store Bypass: Vulnerable [ 0.033218] debug: unmapping init [mem 0xffffffffb5059000-0xffffffffb5060fff] [ 0.035153] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (family: 0x6, model: 0x3e, stepping: 0x4) [ 0.036389] Performance Events: IvyBridge events, full-width counters, Intel PMU driver. [ 0.037021] ... version: 2 [ 0.037836] ... bit width: 48 [ 0.038005] ... generic registers: 4 [ 0.038754] ... value mask: 0000ffffffffffff [ 0.039005] ... max period: 00007fffffffffff [ 0.040005] ... fixed-purpose events: 3 [ 0.040751] ... event mask: 000000070000000f [ 0.041096] rcu: Hierarchical SRCU implementation. [ 0.042968] smp: Bringing up secondary CPUs ... [ 0.043317] x86: Booting SMP configuration: [ 0.044010] .... node #0, CPUs: #1 #2 #3 [ 0.046189] smp: Brought up 1 node, 4 CPUs [ 0.047880] smpboot: Max logical packages: 1 [ 0.048006] smpboot: Total of 4 processors activated (19199.98 BogoMIPS) [ 0.138195] node 0 deferred pages initialised in 89ms [ 0.140080] devtmpfs: initialized [ 0.141154] x86/mm: Memory block size: 128MB [ 0.143161] gcov: version magic: 0x41383552 [ 0.144578] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.146046] futex hash table entries: 1024 (order: 4, 65536 bytes, vmalloc) [ 0.148162] pinctrl core: initialized pinctrl subsystem [ 0.149072] [ 0.149375] ************************************************************* [ 0.151006] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.152005] ** ** [ 0.153005] ** IOMMU DebugFS SUPPORT HAS BEEN ENABLED IN THIS KERNEL ** [ 0.155006] ** ** [ 0.156005] ** This means that this kernel is built to expose internal ** [ 0.157005] ** IOMMU data structures, which may compromise security on ** [ 0.159006] ** your system. ** [ 0.160005] ** ** [ 0.161005] ** If you see this message and you are not debugging the ** [ 0.163005] ** kernel, report this immediately to your vendor! ** [ 0.164004] ** ** [ 0.165006] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.166005] ************************************************************* [ 0.168368] NET: Registered protocol family 16 [ 0.169265] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations [ 0.171029] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.172024] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.174237] cpuidle: using governor menu [ 0.175328] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.176252] PCI: Using configuration type 1 for base access [ 0.177086] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.183059] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.184021] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.186093] cryptd: max_cpu_qlen set to 1000 [ 0.188154] ACPI: Added _OSI(Module Device) [ 0.189009] ACPI: Added _OSI(Processor Device) [ 0.189968] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.191007] ACPI: Added _OSI(Processor Aggregator Device) [ 0.193962] ACPI: 1 ACPI AML tables successfully acquired and loaded [ 0.198375] ACPI: Interpreter enabled [ 0.199034] ACPI: PM: (supports S0 S3 S4 S5) [ 0.199885] ACPI: Using IOAPIC for interrupt routing [ 0.200040] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.202206] ACPI: Enabled 2 GPEs in block 00 to 0F [ 0.208577] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.210016] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3] [ 0.211007] acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI] [ 0.213028] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.215793] acpiphp: Slot [2] registered [ 0.217068] acpiphp: Slot [5] registered [ 0.217924] acpiphp: Slot [6] registered [ 0.219057] acpiphp: Slot [7] registered [ 0.219880] acpiphp: Slot [8] registered [ 0.220066] acpiphp: Slot [9] registered [ 0.220882] acpiphp: Slot [10] registered [ 0.222058] acpiphp: Slot [3] registered [ 0.222799] acpiphp: Slot [4] registered [ 0.223046] acpiphp: Slot [11] registered [ 0.223900] acpiphp: Slot [12] registered [ 0.225041] acpiphp: Slot [13] registered [ 0.225888] acpiphp: Slot [14] registered [ 0.227042] acpiphp: Slot [15] registered [ 0.227775] acpiphp: Slot [16] registered [ 0.228041] acpiphp: Slot [17] registered [ 0.228880] acpiphp: Slot [18] registered [ 0.230041] acpiphp: Slot [19] registered [ 0.230880] acpiphp: Slot [20] registered [ 0.231042] acpiphp: Slot [21] registered [ 0.231788] acpiphp: Slot [22] registered [ 0.233047] acpiphp: Slot [23] registered [ 0.233865] acpiphp: Slot [24] registered [ 0.235041] acpiphp: Slot [25] registered [ 0.235851] acpiphp: Slot [26] registered [ 0.236039] acpiphp: Slot [27] registered [ 0.236838] acpiphp: Slot [28] registered [ 0.238061] acpiphp: Slot [29] registered [ 0.238876] acpiphp: Slot [30] registered [ 0.239040] acpiphp: Slot [31] registered [ 0.239812] PCI host bridge to bus 0000:00 [ 0.241009] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.242007] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.243008] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.245008] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 0.246013] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] [ 0.248012] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.249082] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.250619] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.252571] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 0.259007] pci 0000:00:01.1: reg 0x20: [io 0xc320-0xc32f] [ 0.262035] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.264007] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.265007] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.267007] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.268328] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 0.269494] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 0.271019] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 0.273467] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 [ 0.276007] pci 0000:00:02.0: reg 0x10: [io 0xc300-0xc31f] [ 0.282007] pci 0000:00:02.0: reg 0x20: [mem 0xe0000000000-0xe0000003fff 64bit pref] [ 0.286007] pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 0.289766] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 [ 0.293007] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] [ 0.296007] pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] [ 0.304007] pci 0000:00:05.0: reg 0x20: [mem 0xe0000004000-0xe0000007fff 64bit pref] [ 0.310788] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 [ 0.313007] pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] [ 0.316000] pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 0.324008] pci 0000:00:06.0: reg 0x20: [mem 0xe0000008000-0xe000000bfff 64bit pref] [ 0.332145] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 [ 0.337007] pci 0000:00:07.0: reg 0x10: [io 0xc100-0xc17f] [ 0.341008] pci 0000:00:07.0: reg 0x14: [mem 0xfebc2000-0xfebc2fff] [ 0.352011] pci 0000:00:07.0: reg 0x20: [mem 0xe000000c000-0xe000000ffff 64bit pref] [ 0.357961] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 [ 0.362007] pci 0000:00:08.0: reg 0x10: [io 0xc180-0xc1ff] [ 0.364964] pci 0000:00:08.0: reg 0x14: [mem 0xfebc3000-0xfebc3fff] [ 0.374007] pci 0000:00:08.0: reg 0x20: [mem 0xe0000010000-0xe0000013fff 64bit pref] [ 0.378754] pci 0000:00:09.0: [1af4:1001] type 00 class 0x010000 [ 0.386006] pci 0000:00:09.0: reg 0x10: [io 0xc200-0xc27f] [ 0.389009] pci 0000:00:09.0: reg 0x14: [mem 0xfebc4000-0xfebc4fff] [ 0.398007] pci 0000:00:09.0: reg 0x20: [mem 0xe0000014000-0xe0000017fff 64bit pref] [ 0.403588] pci 0000:00:0a.0: [1af4:1001] type 00 class 0x010000 [ 0.407007] pci 0000:00:0a.0: reg 0x10: [io 0xc280-0xc2ff] [ 0.410007] pci 0000:00:0a.0: reg 0x14: [mem 0xfebc5000-0xfebc5fff] [ 0.419009] pci 0000:00:0a.0: reg 0x20: [mem 0xe0000018000-0xe000001bfff 64bit pref] [ 0.424376] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 [ 0.425196] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 0.427207] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 [ 0.428181] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 0.430099] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 [ 0.433100] iommu: Default domain type: Passthrough [ 0.434243] SCSI subsystem initialized [ 0.435000] ACPI: bus type USB registered [ 0.435054] usbcore: registered new interface driver usbfs [ 0.436030] usbcore: registered new interface driver hub [ 0.437034] usbcore: registered new device driver usb [ 0.438057] pps_core: LinuxPPS API ver. 1 registered [ 0.439005] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 0.441016] PTP clock support registered [ 0.442068] EDAC MC: Ver: 3.0.0 [ 0.443063] PCI: Using ACPI for IRQ routing [ 0.444487] NetLabel: Initializing [ 0.445006] NetLabel: domain hash size = 128 [ 0.445809] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 0.447037] NetLabel: unlabeled traffic allowed by default [ 0.448055] vgaarb: loaded [ 0.449153] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 0.449996] hpet0: 3 comparators, 64-bit 100.000000 MHz counter [ 0.454217] clocksource: Switched to clocksource kvm-clock [ 0.529399] VFS: Disk quotas dquot_6.6.0 [ 0.530266] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 0.531619] *** VALIDATE ramfs *** [ 0.532317] *** VALIDATE hugetlbfs *** [ 0.533170] pnp: PnP ACPI init [ 0.534559] pnp: PnP ACPI: found 6 devices [ 0.546288] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 0.548056] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 0.549201] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 0.550338] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 0.551620] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 0.552949] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] [ 0.554442] NET: Registered protocol family 2 [ 0.555761] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, vmalloc) [ 0.558669] tcp_listen_portaddr_hash hash table entries: 4096 (order: 5, 163840 bytes, vmalloc) [ 0.560680] TCP established hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.564233] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc) [ 0.566090] TCP: Hash tables configured (established 65536 bind 65536) [ 0.567560] MPTCP token hash table entries: 8192 (order: 6, 393216 bytes, vmalloc) [ 0.569220] UDP hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.570776] UDP-Lite hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.572303] NET: Registered protocol family 1 [ 0.573636] RPC: Registered named UNIX socket transport module. [ 0.574812] RPC: Registered udp transport module. [ 0.575673] RPC: Registered tcp transport module. [ 0.576577] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 0.577774] NET: Registered protocol family 44 [ 0.578644] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 0.579765] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 0.580940] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 0.582160] PCI: CLS 0 bytes, default 64 [ 0.583652] Unpacking initramfs... [ 1.685316] debug: unmapping init [mem 0xffff8d5c7cc54000-0xffff8d5c7ffbffff] [ 1.687817] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 1.689046] software IO TLB: mapped [mem 0x00000000a8000000-0x00000000ac000000] (64MB) [ 1.690595] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 2.114805] Initialise system trusted keyrings [ 2.115762] Key type blacklist registered [ 2.116872] workingset: timestamp_bits=36 max_order=20 bucket_order=0 [ 2.126996] zbud: loaded [ 2.129774] *** VALIDATE nfs *** [ 2.130968] *** VALIDATE nfs4 *** [ 2.132488] pstore: using deflate compression [ 2.134891] Platform Keyring initialized [ 2.199391] NET: Registered protocol family 38 [ 2.201368] Key type asymmetric registered [ 2.203064] Asymmetric key parser 'x509' registered [ 2.204939] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 2.207863] io scheduler mq-deadline registered [ 2.209478] io scheduler kyber registered [ 2.211014] io scheduler bfq registered [ 2.213052] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 2.215876] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 2.218579] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 2.221311] ACPI: Power Button [PWRF] [ 2.225045] ACPI: \_SB_.LNKB: Enabled at IRQ 10 [ 2.231405] ACPI: \_SB_.LNKA: Enabled at IRQ 11 [ 2.239414] ACPI: \_SB_.LNKC: Enabled at IRQ 11 [ 2.243390] ACPI: \_SB_.LNKD: Enabled at IRQ 10 [ 2.251708] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 2.276103] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 2.301077] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 2.304103] Non-volatile memory driver v1.3 [ 2.305014] Linux agpgart interface v0.103 [ 2.324235] virtio_blk virtio1: [vda] 134736 512-byte logical blocks (69.0 MB/65.8 MiB) [ 2.325917] vda: detected capacity change from 0 to 68984832 [ 2.337016] virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) [ 2.339409] vdb: detected capacity change from 0 to 1073741824 [ 2.353216] virtio_blk virtio3: [vdc] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 2.356190] vdc: detected capacity change from 0 to 2621440000 [ 2.366330] virtio_blk virtio4: [vdd] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 2.368107] vdd: detected capacity change from 0 to 2621440000 [ 2.377615] virtio_blk virtio5: [vde] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 2.379262] vde: detected capacity change from 0 to 4294967296 [ 2.388551] virtio_blk virtio6: [vdf] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 2.390340] vdf: detected capacity change from 0 to 4294967296 [ 2.394376] libphy: Fixed MDIO Bus: probed [ 2.398657] usbcore: registered new interface driver usbserial_generic [ 2.400109] usbserial: USB Serial support registered for generic [ 2.401392] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 2.403977] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 2.405028] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 2.406425] mousedev: PS/2 mouse device common for all mice [ 2.408186] rtc_cmos 00:05: RTC can wake from S4 [ 2.408832] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 2.410541] rtc_cmos 00:05: registered as rtc0 [ 2.413163] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 2.413169] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 [ 2.414755] intel_pstate: CPU model not supported [ 2.417302] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 [ 2.420000] hid: raw HID events driver (C) Jiri Kosina [ 2.421231] usbcore: registered new interface driver usbhid [ 2.422399] usbhid: USB HID core driver [ 2.423321] drop_monitor: Initializing network drop monitor service [ 2.424764] Initializing XFRM netlink socket [ 2.425961] NET: Registered protocol family 10 [ 2.427706] Segment Routing with IPv6 [ 2.428535] NET: Registered protocol family 17 [ 2.429649] mpls_gso: MPLS GSO support [ 2.433452] RAS: Correctable Errors collector initialized. [ 2.434642] AVX version of gcm_enc/dec engaged. [ 2.435587] AES CTR mode by8 optimization enabled [ 2.484382] sched_clock: Marking stable (2484342499, 0)->(3070647716, -586305217) [ 2.486278] registered taskstats version 1 [ 2.487427] Loading compiled-in X.509 certificates [ 2.488526] zswap: loaded using pool lzo/zbud [ 2.504168] Key type big_key registered [ 2.511679] Key type encrypted registered [ 2.512644] ima: No TPM chip found, activating TPM-bypass! [ 2.514392] ima: Allocated hash algorithm: sha1 [ 2.515344] ima: No architecture policies found [ 2.516534] evm: Initialising EVM extended attributes: [ 2.518692] evm: security.selinux [ 2.520118] evm: security.ima [ 2.521406] evm: security.capability [ 2.522953] evm: HMAC attrs: 0x1 [ 2.525333] rtc_cmos 00:05: setting system clock to 2026-02-27 04:41:15 UTC (1772167275) [ 2.532167] debug: unmapping init [mem 0xffffffffb6003000-0xffffffffb61fffff] [ 2.535444] debug: unmapping init [mem 0xffffffffb4d82000-0xffffffffb5058fff] [ 2.544085] Write protecting the kernel read-only data: 28672k [ 2.546737] debug: unmapping init [mem 0xffffffffb3403000-0xffffffffb35fffff] [ 2.548298] debug: unmapping init [mem 0xffffffffb3d14000-0xffffffffb3dfffff] [ 2.570482] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 2.575190] systemd[1]: Detected virtualization kvm. [ 2.576221] systemd[1]: Detected architecture x86-64. [ 2.577247] systemd[1]: Running in initial RAM disk. Welcome to Rocky Linux 8.10 (Green Obsidian) dracut-049-233.git20240115.el8 (Initramfs)! [ 2.599905] systemd[1]: No hostname configured. [ 2.600819] systemd[1]: Set hostname to . [ 2.601965] random: systemd: uninitialized urandom read (16 bytes read) [ 2.603275] systemd[1]: Initializing machine ID from random generator. [ 2.636635] random: ln: uninitialized urandom read (6 bytes read) [ 2.697308] random: systemd: uninitialized urandom read (16 bytes read) [ 2.698768] systemd[1]: Reached target Local File Systems. [ OK ] Reached target Local File Systems. [ 2.701778] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 2.704581] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ OK ] Reached target Swap. [ OK ] Reached target Timers. [ OK ] Reached target Slices. [ OK ] Reached target Initrd Root Device. [ OK ] Listening on Journal Socket. Starting Create list of required st…ce nodes for the current kernel... [ OK ] Started Memstrack Anylazing Service. Starting Journal Service... Starting Create Volatile Files and Directories... Starting Setup Virtual Console... [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Paths. [ OK ] Listening on udev Kernel Socket. [ OK ] Reached target Sockets. Starting Apply Kernel Variables... [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Create Volatile Files and Directories. [ OK ] Started Setup Virtual Console. [ OK ] Started Apply Kernel Variables. Starting dracut cmdline hook... Starting Create Static Device Nodes in /dev... [ OK ] Started Journal Service. [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ 3.097596] device-mapper: uevent: version 1.0.3 [ 3.098916] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting dracut pre-trigger hook... [ OK ] Started dracut pre-trigger hook. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ 3.475032] random: fast init done [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. Starting dracut initqueue hook... [ OK ] Reached target System Initialization. [ OK ] Reached target Basic System. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. [ 3.654734] virtio_net virtio0 ens2: renamed from eth0 [ 3.657585] scsi host0: ata_piix [ 3.665108] scsi host1: ata_piix [ 3.666238] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc320 irq 14 [ 3.667754] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc328 irq 15 [ 7.153505] dracut-initqueue[598]: RTNETLINK answers: File exists [ 8.028778] random: crng init done [ 8.029521] random: 7 urandom warning(s) missed due to ratelimiting Starting nbd nbd0... [ OK ] Started nbd nbd0. [ OK ] Started dracut initqueue hook. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Mounting /sysroot... [ 8.363518] EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Timers. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Remote File Systems (Pre). Stopping Hardware RNG Entropy Gatherer Daemon... [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped Hardware RNG Entropy Gatherer Daemon. [ OK ] Stopped target Basic System. [ OK ] Stopped target Sockets. [ OK ] Stopped target Slices. [ OK ] Stopped target Paths. [ OK ] Stopped target System Initialization. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped dracut pre-trigger hook. [ OK ] Stopped target Local Encrypted Volumes. [ OK ] Stopped Dispatch Password Requests to Console Directory Watch. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped target Swap. [ OK ] Stopped target Local File Systems. [ OK ] Stopped Apply Kernel Variables. Stopping udev Kernel Device Manager... [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Closed udev Kernel Socket. [ OK ] Closed udev Control Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Reached target Switch Root. Starting Switch Root... [ 9.261889] printk: systemd: 25 output lines suppressed due to ratelimiting [ 9.399500] SELinux: Disabled at runtime. [ 9.447237] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 9.452890] systemd[1]: Detected virtualization kvm. [ 9.453825] systemd[1]: Detected architecture x86-64. Welcome to Rocky Linux 8.10 (Green Obsidian)! [ 9.710638] systemd[1]: initrd-switch-root.service: Succeeded. [ 9.712498] systemd[1]: Stopped Switch Root. [ OK ] Stopped Switch Root. [ 9.715813] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. [ 9.717961] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 9.719687] systemd[1]: Stopped Journal Service. [ OK ] Stopped Journal Service. [ 9.723175] systemd[1]: Starting Journal Service... Starting Journal Service... [ 9.725396] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ OK ] Created slice system-sshd\x2dkeygen.slice. Starting Remount Root and Kernel File Systems... [FAILED] Failed to set up automount Arbitrar…rmats File System Automount Point. See 'systemctl status proc-sys-fs-binfmt_misc.automount' for details. [ OK ] Listening on udev Kernel Socket. Starting udev Coldplug all Devices... [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Created slice system-serial\x2dgetty.slice. [ OK ] Listening on RPCbind Server Activation Socket. Mounting Kernel Debug File System... Starting Create list of required st…ce nodes for the current kernel... [ OK ] Created slice User and Session Slice. [ OK ] Reached target Slices. [ OK ] Reached target rpc_pipefs.target. Activating swap /dev/disk/by-label/SWAP... [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Reached target RPC Port Mapper. [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd Root File System. [ OK ] Created slice system-getty.slice. [ OK ] Stopped target Initrd File Systems. Starting Apply Kernel Variables... [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Reached target Paths. [ 9.791805] Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS [ OK ] Reached target Local Encrypted Volumes. [ OK ] Listening on Process Core Dump Socket. Mounting POSIX Message Queue File System... Mounting Huge Pages File System... [ OK ] Started Journal Service. [FAILED] Failed to start Remount Root and Kernel File Systems. See 'systemctl status systemd-remount-fs.service' for details. [ OK ] Mounted Kernel Debug File System. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Activated swap /dev/disk/by-label/SWAP. [ OK ] Started Apply Kernel Variables. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted Huge Pages File System. [ OK ] Reached target Swap. Starting Configure read-only root support... Starting Create Static Device Nodes in /dev... Starting Flush Journal to Persistent Storage... [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Reached target Local File Systems (Pre). Mounting /home/green/git/lustre-release... Mounting /mnt... Starting udev Kernel Device Manager... [ OK ] Mounted /mnt. [ OK ] Started udev Coldplug all Devices. [ 10.013694] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ OK ] Mounted /home/green/git/lustre-release. [ OK ] Started udev Kernel Device Manager. [ 10.214852] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 10.359681] input: PC Speaker as /devices/platform/pcspkr/input/input5 [ 10.421883] RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer [ 10.428279] EDAC sbridge: Ver: 1.1.2 [ 11.235199] Key type dns_resolver registered [ 11.471196] NFS: Registering the id_resolver key type [ 11.472262] Key type id_resolver registered [ 11.473134] Key type id_legacy registered [ OK ] Started Configure read-only root support. [ OK ] Reached target Local File Systems. Starting Mark the need to relabel after reboot... Starting Rebuild Dynamic Linker Cache... Starting Load/Save Random Seed... Starting Create Volatile Files and Directories... [ OK ] Started Mark the need to relabel after reboot. [ OK ] Started Load/Save Random Seed. [ OK ] Started Create Volatile Files and Directories. Starting RPC Bind... Starting Update UTMP about System Boot/Shutdown... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Started RPC Bind. [ OK ] Started Rebuild Dynamic Linker Cache. Starting Update is Completed... [ OK ] Started Update is Completed. [ OK ] Reached target System Initialization. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Started dnf makecache --timer. [ OK ] Reached target Timers. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. Starting Login Service... [ OK ] Started irqbalance daemon. [ OK ] Reached target sshd-keygen.target. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. Starting Restore /run/initramfs on shutdown... [ OK ] Started D-Bus System Message Bus. Starting Network Manager... [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Login Service. [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting Dynamic System Tuning Daemon... Starting OpenSSH server daemon... Starting GSSAPI Proxy Daemon... Starting Network Manager Wait Online... [ OK ] Started OpenSSH server daemon. Starting Hostname Service... [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Started Permit User Sessions. [ OK ] Started Serial Getty on ttyS0. [ OK ] Started Command Scheduler. [ OK ] Started Getty on tty1. [ OK ] Started Serial Getty on ttyS1. [ OK ] Reached target Login Prompts. [ OK ] Started Hostname Service. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Notify NFS peers of a restart... Starting System Logging Service... Starting Crash recovery kernel arming... [ OK ] Started Notify NFS peers of a restart. [ OK ] Started System Logging Service. Starting Authorization Manager... [ OK ] Started Authorization Manager. [ OK ] Started Dynamic System Tuning Daemon. [ OK ] Reached target Multi-User System. [ OK ] Reached target Graphical Interface. Starting Update UTMP about System Runlevel Changes... [ OK ] Started Update UTMP about System Runlevel Changes. [ OK ] Started Crash recovery kernel arming. Rocky Linux 8.10 (Green Obsidian) Kernel 4.18.0rh8.10-debug on an x86_64 oleg327-server login: [ 38.719526] libcfs: loading out-of-tree module taints kernel. [ 38.748210] Key type ._llcrypt registered [ 38.749810] Key type .llcrypt registered [ 38.808151] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_hostid [ 46.693599] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 47.221487] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 47.226817] alg: No test for adler32 (adler32-zlib) [ 48.223331] Lustre: Lustre: Build Version: 2.17.50_152_g82f9dcf [ 48.501981] LNet: Added LNI 192.168.203.127@tcp [8/256/0/180] [ 50.112201] Key type lgssc registered [ 50.841383] Lustre: Echo OBD driver; http://www.lustre.org/ [ 57.611385] ZFS: Loaded module v2.3.2-1, ZFS pool version 5000, ZFS filesystem version 5 [ 73.608269] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 78.839706] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 78.850555] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 79.941641] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 79.952583] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 79.989244] Lustre: lustre-MDT0000: new disk, initializing [ 80.011406] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 80.021104] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 81.293430] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 87.503233] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 87.539063] Lustre: 6489:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 87.551402] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 87.552943] Lustre: Skipped 1 previous similar message [ 87.590969] Lustre: lustre-MDT0001: new disk, initializing [ 87.613551] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 87.621203] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 87.624523] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 89.040327] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 91.724710] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 95.452432] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 95.600293] Lustre: lustre-OST0000: new disk, initializing [ 95.604167] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 95.622546] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 95.947200] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 95.954655] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 95.996327] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 98.014643] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 105.049877] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 105.085713] Lustre: lustre-OST0001: Not available for connect from 0@lo (not set up) [ 105.089504] Lustre: lustre-OST0001: new disk, initializing [ 105.091580] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 105.107365] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 107.415522] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 110.565737] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 110.570493] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 110.587448] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 113.996723] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 121.401252] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 128.805991] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing check_logdir /tmp/testlogs/ [ 130.716064] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing yml_node [ 132.669036] Lustre: DEBUG MARKER: Client: 2.17.50.152 [ 133.843157] Lustre: DEBUG MARKER: MDS: 2.17.50.152 [ 135.039487] Lustre: DEBUG MARKER: OSS: 2.17.50.152 [ 135.689703] Lustre: DEBUG MARKER: -----============= acceptance-small: conf-sanity ============----- Thu Feb 26 23:43:28 EST 2026 [ 143.062949] Lustre: DEBUG MARKER: excepting tests: 102 106 115 32newtarball [ 143.606399] Lustre: DEBUG MARKER: skipping tests SLOW=no: 45 69 106 111 114 [ 156.640917] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 156.641351] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 156.644180] Lustre: Skipped 2 previous similar messages [ 156.645669] Lustre: Skipped 2 previous similar messages [ 161.662688] Lustre: server umount lustre-MDT0000 complete [ 163.291126] LustreError: 7419:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1772167436 with bad export cookie 9055883960611560288 [ 163.293687] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 163.298693] LustreError: 7419:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 166.881334] LustreError: 6495:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 166.881455] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 166.881784] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 166.881792] Lustre: Skipped 2 previous similar messages [ 166.891093] LustreError: 6495:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 6 previous similar messages [ 166.898858] Lustre: Skipped 2 previous similar messages [ 168.929103] LustreError: 6495:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 168.929120] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 168.938709] LustreError: 6495:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 168.942280] Lustre: Skipped 2 previous similar messages [ 169.458230] Lustre: server umount lustre-MDT0001 complete [ 171.181841] Lustre: server umount lustre-OST0000 complete [ 172.914588] Lustre: server umount lustre-OST0001 complete [ 175.723676] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_hostid [ 179.897211] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 196.357567] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 196.493228] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 196.506131] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 196.551384] Lustre: lustre-MDT0000: new disk, initializing [ 196.591492] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 196.603856] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 198.223275] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 203.816632] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 203.881828] Lustre: 14963:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 204.037493] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 205.648718] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 209.185857] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 210.700760] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 213.812129] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 213.932720] Lustre: lustre-OST0000: new disk, initializing [ 213.934776] Lustre: Skipped 1 previous similar message [ 213.936990] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 213.939275] Lustre: Skipped 2 previous similar messages [ 213.969250] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 213.973620] Lustre: Skipped 1 previous similar message [ 215.873229] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 215.878521] Lustre: Skipped 1 previous similar message [ 215.881582] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 215.924604] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 216.185146] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 219.798805] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 221.496081] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 221.597732] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 223.442275] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 223.563652] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 226.276907] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 226.280203] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 226.282439] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 226.287033] Lustre: Skipped 1 previous similar message [ 226.291871] LustreError: Skipped 1 previous similar message [ 230.632534] Lustre: server umount lustre-OST0000 complete [ 234.977684] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 234.982829] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 234.991391] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 234.995112] Lustre: Skipped 1 previous similar message [ 238.523151] Lustre: server umount lustre-MDT0000 complete [ 240.206811] LustreError: 14954:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1772167513 with bad export cookie 9055883960611561800 [ 240.212515] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 240.213553] LustreError: 14954:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 240.367139] Lustre: server umount lustre-MDT0001 complete [ 242.781802] Lustre: DEBUG MARKER: == conf-sanity test 76a: set permanent params with lctl across mounts ========================================================== 23:45:15 (1772167515) [ 245.884801] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 246.061226] LustreError: 18823:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 246.097786] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 247.646174] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 251.363680] LustreError: 18823:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 251.617803] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 253.253774] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 255.839572] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 257.549113] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 260.792340] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 263.456186] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 266.016443] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 273.493881] Lustre: Modifying parameter general.osc.*.max_dirty_mb=452 in log params [ 277.473623] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 277.476672] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 277.480893] Lustre: Skipped 1 previous similar message [ 277.483021] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 277.485566] Lustre: Skipped 2 previous similar messages [ 283.080899] Lustre: server umount lustre-MDT0000 complete [ 284.893316] LustreError: 18804:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1772167557 with bad export cookie 9055883960611562689 [ 284.898444] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 284.902315] LustreError: 18804:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 285.035277] Lustre: server umount lustre-MDT0001 complete [ 296.186593] Lustre: server umount lustre-OST0000 complete [ 305.601571] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 309.836082] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 310.031766] LustreError: 22846:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 310.051194] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 310.053471] Lustre: Skipped 2 previous similar messages [ 311.840464] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 315.924413] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 317.760273] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 319.132304] Lustre: Setting parameter general.debug_raw_pointers=Y in log params [ 322.238894] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 325.019568] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 328.918705] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 329.032482] Lustre: lustre-OST0001: new disk, initializing [ 329.036197] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 330.910573] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 330.916115] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 330.950716] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 331.610616] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 336.952476] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 338.733725] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 351.717876] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 351.720921] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 351.724863] Lustre: Skipped 5 previous similar messages [ 351.728539] Lustre: Skipped 5 previous similar messages [ 352.884722] Lustre: server umount lustre-MDT0000 complete [ 354.598551] LustreError: 22825:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1772167627 with bad export cookie 9055883960611563536 [ 354.604030] LustreError: 22825:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 354.604624] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 356.741924] Lustre: server umount lustre-MDT0001 complete [ 368.788869] Lustre: server umount lustre-OST0000 complete [ 380.990123] Lustre: server umount lustre-OST0001 complete [ 386.512654] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 391.093216] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 391.238272] LustreError: 28149:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 391.243534] LustreError: 28149:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 391.257996] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 391.259837] Lustre: Skipped 3 previous similar messages [ 392.804928] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 396.748154] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 398.504609] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 399.658743] Lustre: 29261:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 402.300993] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 404.793525] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 408.896739] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 411.442726] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 420.884787] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 422.652179] Lustre: 31114:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 432.103566] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 432.106209] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 432.111417] Lustre: Skipped 3 previous similar messages [ 432.115359] Lustre: Skipped 3 previous similar messages [ 436.022842] Lustre: server umount lustre-MDT0000 complete [ 437.220165] LustreError: 28148:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 437.232595] LustreError: 28148:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 5 previous similar messages [ 437.803293] LustreError: 31231:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1772167710 with bad export cookie 9055883960611564831 [ 437.809862] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 437.810743] LustreError: 31231:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 437.972891] Lustre: server umount lustre-MDT0001 complete [ 449.553656] Lustre: server umount lustre-OST0000 complete [ 461.691510] Lustre: server umount lustre-OST0001 complete [ 465.911461] Lustre: DEBUG MARKER: == conf-sanity test 76b: verify params log setup correctly ========================================================== 23:48:58 (1772167738) [ 478.644888] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 482.963714] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 483.185476] LustreError: 33896:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 484.850842] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 488.835258] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 490.677196] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 492.061688] Lustre: 35011:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 495.260460] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 497.928413] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 502.091183] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 504.526651] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 513.656242] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 515.386453] Lustre: 36858:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 524.264481] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 524.272180] Lustre: Skipped 2 previous similar messages [ 528.238945] Lustre: server umount lustre-MDT0000 complete [ 529.897776] LustreError: 36860:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1772167802 with bad export cookie 9055883960611565937 [ 529.903312] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 529.906126] LustreError: 36860:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 530.065431] Lustre: server umount lustre-MDT0001 complete [ 541.717923] Lustre: server umount lustre-OST0000 complete [ 553.787335] Lustre: server umount lustre-OST0001 complete [ 558.024961] Lustre: DEBUG MARKER: == conf-sanity test 76c: verify changelog_mask is applied with lctl set_param -P ========================================================== 23:50:31 (1772167831) [ 565.497407] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 569.841045] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 570.037014] LustreError: 38982:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 570.044762] LustreError: 38982:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 6 previous similar messages [ 570.060290] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 570.062613] Lustre: Skipped 7 previous similar messages [ 571.701391] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 575.625377] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 577.542216] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 578.890290] Lustre: 40094:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 581.930191] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 584.512887] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 588.490444] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 591.053418] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 600.219574] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 607.425937] Lustre: Setting parameter general.mdd.*.changelog_mask=-CLOSE in log params [ 607.430106] Lustre: Skipped 1 previous similar message [ 610.792862] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 610.794956] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 610.800560] Lustre: Skipped 4 previous similar messages [ 610.807397] Lustre: Skipped 7 previous similar messages [ 615.092713] Lustre: server umount lustre-MDT0000 complete [ 616.885731] LustreError: 38962:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1772167889 with bad export cookie 9055883960611567043 [ 616.892931] LustreError: 38962:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 616.893281] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 631.264162] Lustre: lustre-MDT0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 631.379234] Lustre: server umount lustre-MDT0001 complete [ 635.357748] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 641.505176] LustreError: 3643:0:(client.c:1390:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff8d5bc4329f80 x1858252121109248/t0(0) o250->MGC192.168.203.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 643.356112] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 647.089079] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 648.844193] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 651.384423] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 658.377257] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 6 sec [ 659.709223] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 660.462508] Lustre: DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec [ 661.992904] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 662.499029] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 668.281909] Lustre: server umount lustre-MDT0000 complete [ 669.848338] LustreError: 40476:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1772167942 with bad export cookie 9055883960611568184 [ 669.854639] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 669.855546] LustreError: 40476:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 670.016695] Lustre: server umount lustre-MDT0001 complete [ 681.498961] Lustre: server umount lustre-OST0000 complete [ 693.567993] Lustre: server umount lustre-OST0001 complete [ 697.585743] Lustre: DEBUG MARKER: == conf-sanity test 76d: verify llite.*.xattr_cache can be set by 'lctl set_param -P' correctly ========================================================== 23:52:50 (1772167970) [ 703.569734] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 707.299124] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 707.429973] LustreError: 46319:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 707.435360] LustreError: 46319:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 17 previous similar messages [ 709.045948] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 713.040706] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 714.625966] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 715.568544] Lustre: 47438:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 715.574358] Lustre: 47438:0:(mgs_llog.c:1348:mgs_modify_param()) Skipped 1 previous similar message [ 718.535386] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 720.983324] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 724.337847] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 727.074827] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 735.945534] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 743.060722] Lustre: Setting parameter general.llite.*.xattr_cache=0 in log params [ 748.519950] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 748.527667] Lustre: Skipped 8 previous similar messages [ 754.164573] Lustre: server umount lustre-MDT0000 complete [ 755.844948] LustreError: 47440:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1772168028 with bad export cookie 9055883960611569010 [ 755.850341] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 755.852127] LustreError: 47440:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 755.998159] Lustre: server umount lustre-MDT0001 complete [ 768.026951] Lustre: server umount lustre-OST0000 complete [ 779.898100] Lustre: server umount lustre-OST0001 complete [ 784.337608] Lustre: DEBUG MARKER: == conf-sanity test 77: comma-separated MGS NIDs and failover node NIDs ========================================================== 23:54:17 (1772168057) [ 785.500290] Lustre: DEBUG MARKER: SKIP: conf-sanity test_77 mixed loopback and real device not working [ 786.327789] Lustre: DEBUG MARKER: == conf-sanity test 78: run resize2fs on MDT and OST filesystems ========================================================== 23:54:19 (1772168059) [ 790.917397] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_hostid [ 794.754553] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 804.937652] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 805.080083] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 805.133728] Lustre: lustre-MDT0000: new disk, initializing [ 805.174858] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 806.763562] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 810.671490] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 813.723161] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 814.973522] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 814.982198] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 815.813395] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 819.859124] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 820.949339] Lustre: DEBUG MARKER: create test files [ 835.555810] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 837.993875] Lustre: server umount lustre-OST0000 complete [ 839.671361] Lustre: server umount lustre-MDT0000 complete [ 844.093238] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing unload_modules_local [ 845.348433] Key type lgssc unregistered [ 845.477920] LNet: 54809:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 845.480761] LNetError: 54809:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 845.492465] LNet: Removed LNI 192.168.203.127@tcp [ 845.897156] Key type .llcrypt unregistered [ 845.899398] Key type ._llcrypt unregistered [ 859.442742] Key type ._llcrypt registered [ 859.444512] Key type .llcrypt registered [ 859.491745] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 859.812195] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 859.855846] alg: No test for adler32 (adler32-zlib) [ 860.787249] Lustre: Lustre: Build Version: 2.17.50_152_g82f9dcf [ 860.914047] LNet: Added LNI 192.168.203.127@tcp [8/256/0/180] [ 862.520169] Key type lgssc registered [ 863.147287] Lustre: Echo OBD driver; http://www.lustre.org/ [ 867.093695] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 867.108193] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 868.320061] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 870.106587] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 872.462698] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 875.868369] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 876.057662] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 878.122108] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:102 to 0x240000400:129) [ 878.164461] Lustre: 57387:0:(osd_internal.h:1455:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 515 < left 544, rollback = 9 [ 878.168220] Lustre: 57387:0:(osd_handler.c:2093:osd_trans_dump_creds()) create: 32/128/0, destroy: 0/0/0 [ 878.171207] Lustre: 57387:0:(osd_handler.c:2100:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 878.174186] Lustre: 57387:0:(osd_handler.c:2110:osd_trans_dump_creds()) write: 2/13/1, punch: 0/0/0, quota 1/3/0 [ 878.177221] Lustre: 57387:0:(osd_handler.c:2117:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 878.179916] Lustre: 57387:0:(osd_handler.c:2124:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 878.760131] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 880.998789] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 884.542061] Lustre: DEBUG MARKER: check files after expanding the MDT and OST filesystems [ 887.338008] Lustre: DEBUG MARKER: create more files after expanding the MDT and OST filesystems [ 893.412881] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 893.413533] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 893.421486] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 895.792830] Lustre: server umount lustre-OST0000 complete [ 897.675652] Lustre: server umount lustre-MDT0000 complete [ 902.020531] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing unload_modules_local [ 903.476271] Key type lgssc unregistered [ 903.638790] LNet: 58870:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 903.643564] LNetError: 58870:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 903.652606] LNet: Removed LNI 192.168.203.127@tcp [ 904.089775] Key type .llcrypt unregistered [ 904.091980] Key type ._llcrypt unregistered [ 917.641821] Key type ._llcrypt registered [ 917.643300] Key type .llcrypt registered [ 917.702119] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 917.999787] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 918.006890] alg: No test for adler32 (adler32-zlib) [ 918.871930] Lustre: Lustre: Build Version: 2.17.50_152_g82f9dcf [ 918.954730] LNet: Added LNI 192.168.203.127@tcp [8/256/0/180] [ 920.552199] Key type lgssc registered [ 921.034480] Lustre: Echo OBD driver; http://www.lustre.org/ [ 924.439304] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 924.452952] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 925.634191] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 927.189719] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 929.694624] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 932.765296] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 932.934733] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 935.080646] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 936.041428] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:140 to 0x240000400:161) [ 936.078387] Lustre: 61553:0:(osd_internal.h:1455:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 515 < left 544, rollback = 9 [ 936.084092] Lustre: 61553:0:(osd_handler.c:2093:osd_trans_dump_creds()) create: 32/128/0, destroy: 0/0/0 [ 936.088581] Lustre: 61553:0:(osd_handler.c:2100:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 936.092700] Lustre: 61553:0:(osd_handler.c:2110:osd_trans_dump_creds()) write: 2/13/1, punch: 0/0/0, quota 1/3/0 [ 936.096984] Lustre: 61553:0:(osd_handler.c:2117:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 936.101063] Lustre: 61553:0:(osd_handler.c:2124:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 937.590478] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 941.001401] Lustre: DEBUG MARKER: check files after shrinking the MDT and OST filesystems [ 946.657863] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 946.657877] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 946.661573] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 950.180382] Lustre: server umount lustre-OST0000 complete [ 952.088139] Lustre: server umount lustre-MDT0000 complete [ 956.506259] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing unload_modules_local [ 957.721177] Key type lgssc unregistered [ 957.835331] LNet: 62983:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 957.837401] LNetError: 62983:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 957.849293] LNet: Removed LNI 192.168.203.127@tcp [ 958.139164] Key type .llcrypt unregistered [ 958.141462] Key type ._llcrypt unregistered [ 965.036346] Key type ._llcrypt registered [ 965.038154] Key type .llcrypt registered [ 965.100441] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_hostid [ 972.117589] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 972.417263] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 972.451201] alg: No test for adler32 (adler32-zlib) [ 973.284292] Lustre: Lustre: Build Version: 2.17.50_152_g82f9dcf [ 973.356339] LNet: Added LNI 192.168.203.127@tcp [8/256/0/180] [ 974.936164] Key type lgssc registered [ 975.468862] Lustre: Echo OBD driver; http://www.lustre.org/ [ 992.062461] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 992.073979] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 993.202086] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 993.221323] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 993.266582] Lustre: lustre-MDT0000: new disk, initializing [ 993.294150] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 993.300667] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 994.440210] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 999.921424] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 999.992265] Lustre: 66079:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1000.024423] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 1000.028331] Lustre: Skipped 1 previous similar message [ 1000.075606] Lustre: lustre-MDT0001: new disk, initializing [ 1000.126504] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1000.148053] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 1000.155040] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1001.826692] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 1005.475728] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1006.971130] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1009.900178] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1010.064587] Lustre: lustre-OST0000: new disk, initializing [ 1010.067920] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1010.106637] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1012.586343] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 1013.641895] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 1013.648110] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1013.700645] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1016.464278] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1017.895567] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1018.007478] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1019.432986] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1019.491019] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1023.973996] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1023.974870] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1023.978725] LustreError: Skipped 1 previous similar message [ 1023.987394] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1023.993118] Lustre: Skipped 1 previous similar message [ 1026.342422] Lustre: server umount lustre-OST0000 complete [ 1029.091205] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1029.098976] Lustre: Skipped 1 previous similar message [ 1029.102818] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1029.106639] Lustre: Skipped 1 previous similar message [ 1034.220354] Lustre: server umount lustre-MDT0000 complete [ 1035.959826] LustreError: 66069:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1772168308 with bad export cookie 15072873598038855120 [ 1035.966546] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1035.967045] LustreError: 66069:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 1036.107742] Lustre: server umount lustre-MDT0001 complete [ 1040.056369] Lustre: DEBUG MARKER: == conf-sanity test 79: format MDT/OST without mgs option (should return errors) ========================================================== 23:58:33 (1772168313) [ 1044.667814] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 1060.357896] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_hostid [ 1064.516513] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 1080.718224] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1080.871127] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1080.896082] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1080.946876] Lustre: lustre-MDT0000: new disk, initializing [ 1080.980986] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1080.992083] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1082.663966] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 1088.023669] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1088.085420] Lustre: 73635:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1088.121056] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 1088.124933] Lustre: Skipped 1 previous similar message [ 1088.176712] Lustre: lustre-MDT0001: new disk, initializing [ 1088.215665] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1088.233388] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 1088.239385] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1089.870975] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 1093.816537] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1095.090682] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1097.563333] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1097.669163] Lustre: lustre-OST0000: new disk, initializing [ 1097.670988] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1097.701765] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1100.116223] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 1104.012141] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1105.794253] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1106.441986] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 1106.448444] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1106.501369] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1106.945074] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 1 sec [ 1108.756321] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1108.877258] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1111.526239] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1111.526654] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1111.530767] LustreError: Skipped 1 previous similar message [ 1111.531675] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1111.537964] Lustre: Skipped 2 previous similar messages [ 1115.816901] Lustre: server umount lustre-OST0000 complete [ 1119.201374] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1119.206199] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1119.214850] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1119.218590] Lustre: Skipped 1 previous similar message [ 1123.745009] Lustre: server umount lustre-MDT0000 complete [ 1125.385812] LustreError: 73625:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1772168398 with bad export cookie 15072873598038856002 [ 1125.392085] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1125.392951] LustreError: 73625:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 1125.544272] Lustre: server umount lustre-MDT0001 complete [ 1129.492527] Lustre: DEBUG MARKER: == conf-sanity test 80: mgc import reconnect race ======== 00:00:02 (1772168402) [ 1132.538125] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1132.772882] LustreError: 77648:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1132.784075] LustreError: 77648:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 1132.810901] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1134.652294] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 1138.146293] LustreError: 77648:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1138.754370] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1140.681523] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 1143.301130] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1145.052441] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1148.176328] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1150.902733] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 1153.341990] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1154.709166] Lustre: 79980:0:(genops.c:1793:obd_export_evict_by_uuid()) MGS: evicting 1e3f9c4c-4876-413c-bff4-24459ef2434b at adminstrative request [ 1157.540351] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1157.550080] Lustre: *** cfs_fail_loc=906, val=2147483648*** [ 1167.778255] Lustre: MGS: Client 1e3f9c4c-4876-413c-bff4-24459ef2434b (at 0@lo) reconnecting [ 1167.786493] Lustre: Evicted from MGS (at 0@lo) after server handle changed from 0xd12d9aad8b785498 to 0xd12d9aad8b785723 [ 1167.794204] Lustre: MGC192.168.203.127@tcp: Connection restored to 0@lo (at 0@lo) [ 1187.948410] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1188.048710] Lustre: lustre-OST0001: new disk, initializing [ 1188.051762] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 1188.092475] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 1188.095188] Lustre: Skipped 2 previous similar messages [ 1190.178094] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 1194.128979] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 1194.529174] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 1194.535615] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 1194.586285] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 1199.593135] LustreError: lustre-OST0001-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1199.593696] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1199.595881] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 1199.595890] Lustre: Skipped 2 previous similar messages [ 1199.597977] LustreError: Skipped 1 previous similar message [ 1199.615039] Lustre: Skipped 2 previous similar messages [ 1201.612229] Lustre: server umount lustre-OST0001 complete [ 1203.681231] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1204.709472] LustreError: 79241:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1204.719157] LustreError: 79241:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 1209.509718] Lustre: server umount lustre-OST0000 complete [ 1214.947298] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1214.948106] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1214.955043] Lustre: Skipped 3 previous similar messages [ 1214.958868] Lustre: Skipped 4 previous similar messages [ 1217.459781] Lustre: server umount lustre-MDT0000 complete [ 1219.205860] LustreError: 79262:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1772168492 with bad export cookie 15072873598038857507 [ 1219.213132] LustreError: 79262:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 1219.213357] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1219.370448] Lustre: server umount lustre-MDT0001 complete [ 1223.585391] Lustre: DEBUG MARKER: == conf-sanity test 81: sparse OST indexing ============== 00:01:36 (1772168496) [ 1224.367100] Lustre: DEBUG MARKER: SKIP: conf-sanity test_81 needs >= 3 OSTs [ 1225.250297] Lustre: DEBUG MARKER: == conf-sanity test 82a: specify OSTs for file (succeed) or directory (succeed) ========================================================== 00:01:38 (1772168498) [ 1226.052882] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82a needs >= 3 OSTs [ 1226.939860] Lustre: DEBUG MARKER: == conf-sanity test 82b: specify OSTs for file with --pool and --ost-list options ========================================================== 00:01:39 (1772168499) [ 1227.749325] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82b needs >= 4 OSTs [ 1228.676645] Lustre: DEBUG MARKER: == conf-sanity test 82c: specify sparse OSTs for setstripe (should not crash) ========================================================== 00:01:41 (1772168501) [ 1229.483843] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82c needs >= 4 OSTs [ 1230.414538] Lustre: DEBUG MARKER: == conf-sanity test 83: ENOSPACE on OST doesn't cause message VFS: Busy inodes after unmount ... ========================================================== 00:01:43 (1772168503) [ 1231.202596] Lustre: DEBUG MARKER: mount the OST /dev/mapper/ost1_flakey as a ldiskfs filesystem [ 1234.093471] loop: module loaded [ 1234.100456] loop0: detected capacity change from 0 to 4294967296 [ 1234.118298] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 1234.907145] Lustre: DEBUG MARKER: run llverfs in partial mode on the OST ldiskfs /mnt/lustre-ost1 [ 1236.141714] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing run_llverfs /mnt/lustre-ost1 -vpl no [ 1237.892916] Lustre: DEBUG MARKER: unmount the OST /dev/mapper/ost1_flakey [ 1250.575256] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1250.599190] LustreError: 84377:0:(obd_config.c:880:class_setup()) setup lustre-OST0000-osd failed (-28) [ 1250.603673] LustreError: 84377:0:(obd_mount.c:217:lustre_start_simple()) lustre-OST0000-osd setup error -28 [ 1250.608491] LustreError: 84377:0:(tgt_mount.c:2547:server_fill_super()) Unable to start osd on /dev/mapper/ost1_flakey: -28 [ 1250.613569] LustreError: 84377:0:(super25.c:190:lustre_fill_super()) llite: Unable to mount : rc = -28 [ 1259.415675] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_hostid [ 1264.094389] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 1281.306887] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1281.466450] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1281.486258] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1281.542309] Lustre: lustre-MDT0000: new disk, initializing [ 1281.579955] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1281.591608] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1283.477916] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 1289.039879] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1289.114883] Lustre: 87203:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1289.286590] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1291.230596] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 1295.208428] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1296.942537] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1300.203788] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1302.899355] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 1306.897757] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1307.657446] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1307.722178] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1308.708760] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1308.827802] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1310.622584] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1310.743939] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1312.742060] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1312.742642] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1312.746939] LustreError: Skipped 2 previous similar messages [ 1312.755502] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1312.761392] Lustre: Skipped 1 previous similar message [ 1317.800796] Lustre: server umount lustre-OST0000 complete [ 1325.753546] Lustre: server umount lustre-MDT0000 complete [ 1327.497820] LustreError: 87984:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1772168600 with bad export cookie 15072873598038858130 [ 1327.502258] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1327.505299] LustreError: 87984:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 1327.662899] Lustre: server umount lustre-MDT0001 complete [ 1331.603562] Lustre: DEBUG MARKER: == conf-sanity test 84: check recovery_hard_time ========= 00:03:24 (1772168604) [ 1334.743364] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1334.963509] LustreError: 91209:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1336.577139] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 1340.385883] LustreError: 91209:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1340.540952] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1342.475272] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 1344.987736] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1346.650267] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1349.797025] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1352.376901] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 1354.661629] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1356.384308] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1359.589482] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 3 sec [ 1361.346159] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1361.466150] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1364.564475] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1364.667418] Lustre: lustre-OST0001: new disk, initializing [ 1364.670027] Lustre: Skipped 2 previous similar messages [ 1364.673469] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 1364.677671] Lustre: Skipped 3 previous similar messages [ 1366.934104] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 1366.937779] Lustre: Skipped 2 previous similar messages [ 1366.940712] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 1366.971512] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 1367.216624] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 1371.101945] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 1372.880802] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid 50 [ 1372.996228] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1374.691513] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [ 1374.794725] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1386.139612] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 1395.969977] Lustre: Failing over lustre-MDT0000 [ 1396.318550] Lustre: server umount lustre-MDT0000 complete [ 1396.888948] LustreError: 91203:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.27@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1396.899417] LustreError: 91203:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 1397.218372] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1397.223085] LustreError: Skipped 1 previous similar message [ 1397.225953] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1397.233889] Lustre: Skipped 3 previous similar messages [ 1413.037236] LDISKFS-fs (dm-0): 4 truncates cleaned up [ 1413.039821] LDISKFS-fs (dm-0): recovery complete [ 1413.045201] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1413.072143] Lustre: 64305:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1772168670/real 1772168670] req@000000008316f022 x1858253090917376/t0(0) o400->MGC192.168.203.127@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1772168686 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 1413.091059] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1413.092281] LustreError: 91209:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1413.108861] LustreError: 91209:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 21 previous similar messages [ 1423.340825] Lustre: Evicted from MGS (at 0@lo) after server handle changed from 0x0 to 0xd12d9aad8b792189 [ 1423.346276] Lustre: MGC192.168.203.127@tcp: Connection restored to 0@lo (at 0@lo) [ 1423.475426] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-60 [ 1423.478705] Lustre: Skipped 6 previous similar messages [ 1423.520415] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 1425.201090] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 1427.599177] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 1427.600224] Lustre: 91204:0:(ldlm_lib.c:2068:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 1428.963651] Lustre: 91227:0:(ldlm_lib.c:2068:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 1428.970504] Lustre: 91227:0:(ldlm_lib.c:2068:extend_recovery_timer()) Skipped 1 previous similar message [ 1428.979659] Lustre: lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) [ 1429.006257] LustreError: 96862:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1429.320128] LustreError: 96862:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1429.642746] LustreError: 96862:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1429.648159] LustreError: 96862:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 1 previous similar message [ 1429.968129] LustreError: 96862:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1429.972853] LustreError: 96862:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 1 previous similar message [ 1429.978679] Lustre: 96862:0:(ldlm_lib.c:2068:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 1429.985366] Lustre: 96862:0:(ldlm_lib.c:2068:extend_recovery_timer()) Skipped 7 previous similar messages [ 1430.930745] LustreError: 96862:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1430.936430] LustreError: 96862:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 3 previous similar messages [ 1431.256123] LustreError: 96862:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1431.260859] LustreError: 96862:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 3 previous similar messages [ 1432.202717] Lustre: 96862:0:(ldlm_lib.c:2068:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 1432.209452] Lustre: 96862:0:(ldlm_lib.c:2068:extend_recovery_timer()) Skipped 6 previous similar messages [ 1433.152954] LustreError: 96862:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1433.158803] LustreError: 96862:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 6 previous similar messages [ 1433.472121] LustreError: 96862:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1433.476885] LustreError: 96862:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 6 previous similar messages [ 1436.297194] Lustre: 96862:0:(ldlm_lib.c:2068:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 1436.304178] Lustre: 96862:0:(ldlm_lib.c:2068:extend_recovery_timer()) Skipped 12 previous similar messages [ 1437.250755] LustreError: 96862:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1437.256601] LustreError: 96862:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 12 previous similar messages [ 1437.576123] LustreError: 96862:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1437.580829] LustreError: 96862:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 12 previous similar messages [ 1444.448947] Lustre: 96862:0:(ldlm_lib.c:2068:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 1444.455807] Lustre: 96862:0:(ldlm_lib.c:2068:extend_recovery_timer()) Skipped 25 previous similar messages [ 1445.402783] LustreError: 96862:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1445.408694] LustreError: 96862:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 25 previous similar messages [ 1445.728129] LustreError: 96862:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1445.732973] LustreError: 96862:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 25 previous similar messages [ 1460.720953] Lustre: 96862:0:(ldlm_lib.c:2068:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 1460.727711] Lustre: 96862:0:(ldlm_lib.c:2068:extend_recovery_timer()) Skipped 51 previous similar messages [ 1461.674809] LustreError: 96862:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1461.680517] LustreError: 96862:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 51 previous similar messages [ 1462.000214] LustreError: 96862:0:(ldlm_lib.c:2681:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1462.005048] LustreError: 96862:0:(ldlm_lib.c:2681:replay_request_or_update()) Skipped 51 previous similar messages [ 1487.280201] Lustre: 96862:0:(ldlm_lib.c:2377:target_recovery_overseer()) lustre-MDT0000 recovery is aborted by hard timeout [ 1487.285741] Lustre: 96862:0:(ldlm_lib.c:2387:target_recovery_overseer()) recovery is aborted, evict exports in recovery [ 1487.290836] Lustre: 96862:0:(genops.c:1620:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client 4bdd897d-02df-4ffe-9bcd-2c8e09521f63@192.168.203.27@tcp [ 1487.298056] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 1487.302049] Lustre: 96862:0:(ldlm_lib.c:1897:abort_req_replay_queue()) @@@ aborted: req@00000000c905d8a0 x1858253084496896/t0(8589934783) o101->4bdd897d-02df-4ffe-9bcd-2c8e09521f63@192.168.203.27@tcp:305/0 lens 592/0 e 0 to 0 dl 1772168770 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:0 [ 1487.317354] Lustre: lustre-MDT0000-osd: cancel update llog [0x200000400:0x1:0x0] [ 1487.321710] Lustre: lustre-MDT0000: Denying connection for new client 4bdd897d-02df-4ffe-9bcd-2c8e09521f63 (at 192.168.203.27@tcp), waiting for 3 known clients (2 recovered, 0 in progress, and 1 evicted) to recover in 0:00 [ 1487.329181] Lustre: lustre-MDT0001-osp-MDT0000: cancel update llog [0x240000401:0x1:0x0] [ 1487.352408] Lustre: lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 1487.357170] Lustre: Skipped 2 previous similar messages [ 1487.361213] Lustre: lustre-MDT0000: Recovery over after 1:00, of 3 clients 2 recovered and 1 was evicted. [ 1487.388994] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:49 to 0x2c0000401:545) [ 1487.389055] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:80 to 0x280000401:577) [ 1492.962285] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1492.967739] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1492.975320] Lustre: Skipped 3 previous similar messages [ 1492.978671] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1492.982483] Lustre: Skipped 3 previous similar messages [ 1507.296267] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 1507.350826] Lustre: server umount lustre-OST0000 complete [ 1510.883499] LustreError: 97217:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1510.893130] LustreError: 97217:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 13 previous similar messages [ 1515.238502] Lustre: server umount lustre-OST0001 complete [ 1531.360146] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 1531.456405] Lustre: server umount lustre-MDT0000 complete [ 1533.171926] LustreError: 91188:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1772168806 with bad export cookie 15072873598038909321 [ 1533.178567] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1533.179096] LustreError: 91188:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 1533.342501] Lustre: server umount lustre-MDT0001 complete [ 1536.254307] Lustre: DEBUG MARKER: == conf-sanity test 85: osd_ost init: fail ea_fid_set ==== 00:06:49 (1772168809) [ 1538.662805] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1538.665172] Lustre: *** cfs_fail_loc=197, val=0*** [ 1554.081155] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 1559.200497] LustreError: 98822:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.203.127@tcp: failed processing log, type 4: rc = -110 [ 1564.342197] Lustre: *** cfs_fail_loc=197, val=0*** [ 1564.345813] Lustre: Skipped 65 previous similar messages [ 1586.680608] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 1588.364522] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1589.018620] Lustre: server umount lustre-OST0000 complete [ 1591.504132] Lustre: DEBUG MARKER: == conf-sanity test 86: Replacing mkfs.lustre -G option == 00:07:44 (1772168864) [ 1604.953329] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1605.086681] LustreError: 100327:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1606.348136] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 1609.435841] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1611.428422] LustreError: 100358:0:(osp_object.c:617:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x200000009:0x1:0x0]: rc = -5 [ 1611.432846] LustreError: 100358:0:(lod_sub_object.c:917:lod_sub_prep_llog()) lustre-MDT0000-mdtlov: can't get id from catalogs: rc = -5 [ 1611.435358] LustreError: 100358:0:(lod_dev.c:510:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 6, retries 0, failed: rc = -5 [ 1611.552511] Lustre: server umount lustre-MDT0000 complete [ 1622.223407] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_hostid [ 1625.339737] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 1636.609062] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1636.687685] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1636.696197] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1636.725608] Lustre: lustre-MDT0000: new disk, initializing [ 1636.749533] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1637.875330] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 1641.956946] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1641.996245] Lustre: 104378:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1642.099855] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1643.312295] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 1646.304550] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1647.470511] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1649.806065] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1651.812559] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 1654.702771] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1655.838975] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1655.958138] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1656.031939] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1657.367591] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1657.451496] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1660.901603] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1660.902093] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1660.902885] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1660.902891] Lustre: Skipped 20 previous similar messages [ 1660.904340] LustreError: Skipped 4 previous similar messages [ 1660.907522] Lustre: Skipped 6 previous similar messages [ 1664.214899] Lustre: server umount lustre-OST0000 complete [ 1671.578835] Lustre: server umount lustre-MDT0000 complete [ 1672.762945] LustreError: 104369:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1772168945 with bad export cookie 15072873598038920024 [ 1672.765165] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1672.768037] LustreError: 104369:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 1672.878795] Lustre: server umount lustre-MDT0001 complete [ 1675.544026] Lustre: DEBUG MARKER: == conf-sanity test 87: check if MDT inode can hold EAs with N stripes properly ========================================================== 00:09:08 (1772168948) [ 1678.269179] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing unload_modules_local [ 1679.202288] Key type lgssc unregistered [ 1679.316297] LNet: 108434:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1679.318855] LNetError: 108434:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1679.325232] LNet: Removed LNI 192.168.203.127@tcp [ 1679.589809] Key type .llcrypt unregistered [ 1679.590774] Key type ._llcrypt unregistered [ 1685.434591] Key type ._llcrypt registered [ 1685.436099] Key type .llcrypt registered [ 1685.483185] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_hostid [ 1691.390524] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 1691.793186] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1691.804976] alg: No test for adler32 (adler32-zlib) [ 1692.665964] Lustre: Lustre: Build Version: 2.17.50_152_g82f9dcf [ 1692.749194] LNet: Added LNI 192.168.203.127@tcp [8/256/0/180] [ 1694.336145] Key type lgssc registered [ 1694.693516] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1707.033079] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1707.038435] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1708.117382] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1708.126959] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1708.161075] Lustre: lustre-MDT0000: new disk, initializing [ 1708.182966] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1708.188782] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1709.326501] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 1713.237270] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1713.350289] Lustre: lustre-OST0000: new disk, initializing [ 1713.352040] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1713.353647] Lustre: Skipped 1 previous similar message [ 1713.379263] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1715.125083] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 1717.432906] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 1717.436106] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 1717.445754] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 1718.923692] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1718.981706] Lustre: lustre-OST0001: new disk, initializing [ 1718.983279] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 1719.006350] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 1720.749632] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 1729.505705] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1729.506440] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1729.509686] Lustre: Skipped 1 previous similar message [ 1730.671820] Lustre: server umount lustre-MDT0000 complete [ 1732.732699] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null) [ 1734.276624] LustreError: 112527:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1772169007 with bad export cookie 12480069024464385952 [ 1734.281361] LustreError: 112527:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 1734.281627] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1734.314773] Lustre: server umount lustre-OST0000 complete [ 1735.565767] Lustre: server umount lustre-OST0001 complete [ 1738.346700] Lustre: DEBUG MARKER: == conf-sanity test 88: check the default mount options can be overridden ========================================================== 00:10:11 (1772169011) [ 1741.314762] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 1748.627976] Lustre: DEBUG MARKER: == conf-sanity test 89: check tunefs --param and --erase-param{s} options ========================================================== 00:10:21 (1772169021) [ 1760.689527] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_hostid [ 1763.590573] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 1774.474108] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1774.578400] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1774.589846] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1774.629670] Lustre: lustre-MDT0000: new disk, initializing [ 1774.655498] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1774.662163] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1775.919655] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 1779.978773] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1780.019138] Lustre: 120041:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1780.043454] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 1780.045886] Lustre: Skipped 1 previous similar message [ 1780.083831] Lustre: lustre-MDT0001: new disk, initializing [ 1780.117780] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1780.128549] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 1780.132466] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1781.442602] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 1784.482608] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1785.661379] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1787.857882] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1789.827770] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 1792.506645] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 1792.510704] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1792.547760] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1792.856885] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount (FULL|IDLE) failover.node=192.0.2.254@tcp0,osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1794.246874] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1794.332280] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1795.642736] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1795.714735] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1797.606724] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1797.607181] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1797.607679] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1797.607686] Lustre: Skipped 1 previous similar message [ 1797.610906] Lustre: Skipped 1 previous similar message [ 1798.421542] Lustre: server umount lustre-OST0000 complete [ 1800.672947] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1800.675504] LustreError: Skipped 1 previous similar message [ 1800.677063] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1800.681330] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1800.684022] Lustre: Skipped 1 previous similar message [ 1802.721159] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1802.721902] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1805.860100] Lustre: server umount lustre-MDT0000 complete [ 1807.100328] LustreError: 121782:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1772169080 with bad export cookie 12480069024464387086 [ 1807.102809] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1807.103716] LustreError: 121782:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 1807.219830] Lustre: server umount lustre-MDT0001 complete [ 1809.872752] Lustre: DEBUG MARKER: == conf-sanity test 90a: check max_mod_rpcs_in_flight is enforced ========================================================== 00:11:23 (1772169083) [ 1811.963163] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1812.143198] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1812.145173] Lustre: Skipped 1 previous similar message [ 1813.407176] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 1816.224488] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1817.675143] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 1819.414535] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1820.631916] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1822.889066] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1824.867297] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 1826.559662] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1844.300991] Lustre: *** cfs_fail_loc=159, val=0*** [ 1844.302545] Lustre: Skipped 1 previous similar message [ 1860.758659] Lustre: lustre-MDT0000: Client 134b0564-4418-4331-be4c-c3ed5923ba2b (at 192.168.203.27@tcp) reconnecting [ 1861.248204] Lustre: *** cfs_fail_loc=159, val=0*** [ 1861.250331] Lustre: Skipped 4 previous similar messages [ 1877.646730] Lustre: lustre-MDT0000: Client 134b0564-4418-4331-be4c-c3ed5923ba2b (at 192.168.203.27@tcp) reconnecting [ 1882.593618] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1882.598783] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1882.608282] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1882.612220] Lustre: Skipped 1 previous similar message [ 1885.276022] Lustre: server umount lustre-OST0000 complete [ 1888.225320] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1888.227956] LustreError: Skipped 1 previous similar message [ 1892.854045] Lustre: server umount lustre-MDT0000 complete [ 1893.857804] LustreError: 124060:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1893.867419] LustreError: 124060:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 1894.667237] LustreError: 124023:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1772169167 with bad export cookie 12480069024464387954 [ 1894.672853] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1894.675467] LustreError: 124023:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 1894.816426] Lustre: server umount lustre-MDT0001 complete [ 1898.863785] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing unload_modules_local [ 1900.547742] Key type lgssc unregistered [ 1900.730608] LNet: 127479:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1900.736202] LNetError: 127479:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1900.747840] LNet: Removed LNI 192.168.203.127@tcp [ 1901.232513] Key type .llcrypt unregistered [ 1901.235616] Key type ._llcrypt unregistered [ 1911.148337] Key type ._llcrypt registered [ 1911.149374] Key type .llcrypt registered [ 1911.190688] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 1911.669798] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1911.725809] alg: No test for adler32 (adler32-zlib) [ 1912.579465] Lustre: Lustre: Build Version: 2.17.50_152_g82f9dcf [ 1912.666383] LNet: Added LNI 192.168.203.127@tcp [8/256/0/180] [ 1914.256152] Key type lgssc registered [ 1914.658812] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1917.331785] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1917.339379] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1918.510317] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1919.755710] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 1922.337386] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1922.457490] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1923.743887] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 1925.462853] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1926.566853] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1928.644747] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1928.675531] LustreError: 130445:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1928.679524] LustreError: 130445:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 1928.775962] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1930.577319] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 1932.318096] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1932.902679] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:42 to 0x280000401:65) [ 1942.868721] Lustre: *** cfs_fail_loc=159, val=0*** [ 1959.068039] Lustre: lustre-MDT0000: Client ecf0d46b-07f3-4c52-a803-dcdf5ce7cc9e (at 192.168.203.27@tcp) reconnecting [ 1959.757649] Lustre: *** cfs_fail_loc=159, val=0*** [ 1975.965299] Lustre: lustre-MDT0001: Client ecf0d46b-07f3-4c52-a803-dcdf5ce7cc9e (at 192.168.203.27@tcp) reconnecting [ 1976.643550] Lustre: *** cfs_fail_loc=159, val=0*** [ 1976.647025] Lustre: Skipped 3 previous similar messages [ 1992.862715] Lustre: lustre-MDT0001: Client ecf0d46b-07f3-4c52-a803-dcdf5ce7cc9e (at 192.168.203.27@tcp) reconnecting [ 1994.128114] Lustre: 131554:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 1994.994173] Lustre: *** cfs_fail_loc=159, val=0*** [ 1994.995366] Lustre: Skipped 4 previous similar messages [ 2010.270226] Lustre: lustre-MDT0000: Client d2328bc8-7274-44ed-a231-15dd4fb04532 (at 192.168.203.27@tcp) reconnecting [ 2010.823151] Lustre: *** cfs_fail_loc=159, val=0*** [ 2010.826073] Lustre: Skipped 13 previous similar messages [ 2027.174178] Lustre: lustre-MDT0000: Client d2328bc8-7274-44ed-a231-15dd4fb04532 (at 192.168.203.27@tcp) reconnecting [ 2027.699171] Lustre: 131842:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 2030.561216] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2030.561250] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2030.563535] LustreError: Skipped 1 previous similar message [ 2030.567583] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2030.570367] Lustre: Skipped 1 previous similar message [ 2033.634495] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2033.636501] Lustre: Skipped 1 previous similar message [ 2035.165445] Lustre: server umount lustre-OST0000 complete [ 2038.753771] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2038.754372] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2038.761480] Lustre: Skipped 2 previous similar messages [ 2042.660487] Lustre: server umount lustre-MDT0000 complete [ 2043.873673] LustreError: 128853:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2043.878785] LustreError: 128853:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 2044.266818] LustreError: 131517:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1772169317 with bad export cookie 315373674883969852 [ 2044.272248] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2044.276343] LustreError: 131517:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 2044.421589] Lustre: server umount lustre-MDT0001 complete [ 2048.883300] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing unload_modules_local [ 2050.168326] Key type lgssc unregistered [ 2050.318548] LNet: 132876:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2050.320680] LNetError: 132876:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2050.329450] LNet: Removed LNI 192.168.203.127@tcp [ 2050.668139] Key type .llcrypt unregistered [ 2050.669283] Key type ._llcrypt unregistered [ 2060.115978] Key type ._llcrypt registered [ 2060.116958] Key type .llcrypt registered [ 2060.152733] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 2060.542433] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2060.601128] alg: No test for adler32 (adler32-zlib) [ 2061.436554] Lustre: Lustre: Build Version: 2.17.50_152_g82f9dcf [ 2061.508074] LNet: Added LNI 192.168.203.127@tcp [8/256/0/180] [ 2063.080101] Key type lgssc registered [ 2063.372483] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2065.596223] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2065.601612] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2066.747042] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2067.842799] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 2070.289737] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2070.401395] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2071.480252] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 2073.368838] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2074.510727] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2076.762851] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2076.879711] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2078.588050] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 2080.523200] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2080.999609] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:97) [ 2091.242169] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:129) [ 2098.454301] Lustre: 136517:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 2099.063034] Lustre: 136566:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 2099.549162] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 in log params [ 2100.647385] Lustre: 136711:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre/mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 (mode = 0) failed: rc = -17 [ 2100.925321] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=7 in log params [ 2100.928479] Lustre: Skipped 1 previous similar message [ 2101.208897] Lustre: 136809:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 2106.850693] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2106.851434] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2106.851884] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2106.854364] Lustre: Skipped 1 previous similar message [ 2108.181196] Lustre: server umount lustre-OST0000 complete [ 2111.456703] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2111.459210] LustreError: Skipped 1 previous similar message [ 2111.460576] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2111.464649] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2111.466623] Lustre: Skipped 1 previous similar message [ 2115.543405] Lustre: server umount lustre-MDT0000 complete [ 2116.757149] LustreError: 136529:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1772169389 with bad export cookie 3482891098147983731 [ 2116.759924] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2116.761446] LustreError: 136529:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2116.874228] Lustre: server umount lustre-MDT0001 complete [ 2120.434514] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing unload_modules_local [ 2121.319983] Key type lgssc unregistered [ 2121.431316] LNet: 137847:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2121.433662] LNetError: 137847:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2121.442275] LNet: Removed LNI 192.168.203.127@tcp [ 2121.711056] Key type .llcrypt unregistered [ 2121.712418] Key type ._llcrypt unregistered [ 2132.517733] Key type ._llcrypt registered [ 2132.518934] Key type .llcrypt registered [ 2132.550174] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 2132.844251] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2132.877946] alg: No test for adler32 (adler32-zlib) [ 2133.723980] Lustre: Lustre: Build Version: 2.17.50_152_g82f9dcf [ 2133.799576] LNet: Added LNI 192.168.203.127@tcp [8/256/0/180] [ 2135.376095] Key type lgssc registered [ 2135.686472] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2138.047845] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2138.053485] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2139.214463] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2140.428601] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 2143.336850] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2143.478777] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2144.643275] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 2146.448223] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2147.747973] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2150.481510] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2150.642039] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2152.841190] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 2153.702653] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:129) [ 2154.597305] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2164.966262] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:161) [ 2172.363256] Lustre: *** cfs_fail_loc=159, val=0*** [ 2188.950457] Lustre: lustre-MDT0000: Client 4173297a-c2fe-4164-bf9a-8361fbcd1c7f (at 192.168.203.27@tcp) reconnecting [ 2205.153304] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2205.155878] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2205.159996] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2206.177461] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2206.178587] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2206.180233] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2209.929534] Lustre: server umount lustre-OST0000 complete [ 2211.297260] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2211.297781] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2211.301176] Lustre: Skipped 1 previous similar message [ 2211.303165] Lustre: Skipped 1 previous similar message [ 2216.417339] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2216.420798] Lustre: Skipped 1 previous similar message [ 2217.302288] Lustre: server umount lustre-MDT0000 complete [ 2218.491084] LustreError: 141821:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1772169491 with bad export cookie 5275780688827816719 [ 2218.493794] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2218.494691] LustreError: 141821:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2218.606768] Lustre: server umount lustre-MDT0001 complete [ 2222.279187] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing unload_modules_local [ 2223.152821] Key type lgssc unregistered [ 2223.270291] LNet: 142554:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2223.272863] LNetError: 142554:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2223.280306] LNet: Removed LNI 192.168.203.127@tcp [ 2223.530088] Key type .llcrypt unregistered [ 2223.531131] Key type ._llcrypt unregistered [ 2234.596362] Key type ._llcrypt registered [ 2234.597683] Key type .llcrypt registered [ 2234.631345] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 2235.001791] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2235.026612] alg: No test for adler32 (adler32-zlib) [ 2235.862281] Lustre: Lustre: Build Version: 2.17.50_152_g82f9dcf [ 2235.935513] LNet: Added LNI 192.168.203.127@tcp [8/256/0/180] [ 2237.512096] Key type lgssc registered [ 2237.804486] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2240.206816] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2240.213257] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2241.384494] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2242.795311] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 2246.006964] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2246.139669] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2247.301516] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 2248.894631] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2250.316480] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2252.770853] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2252.938175] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2255.102105] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 2256.047126] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:161) [ 2257.062968] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2266.279212] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:170 to 0x280000401:193) [ 2280.575234] Lustre: lustre-OST0000: evicting 2204f2e0-2ff8-41ab-9a82-195a16ecbd2f (at 192.168.203.27@tcp) by administrative request [ 2280.578443] Lustre: Skipped 1 previous similar message [ 2307.561386] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2307.563240] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2307.566560] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2307.571788] Lustre: Skipped 1 previous similar message [ 2311.461288] Lustre: server umount lustre-OST0000 complete [ 2317.794198] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2317.794265] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2317.794811] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2317.797440] Lustre: Skipped 2 previous similar messages [ 2317.799273] LustreError: Skipped 1 previous similar message [ 2318.946801] Lustre: server umount lustre-MDT0000 complete [ 2320.664278] LustreError: 143908:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1772169593 with bad export cookie 11146478559997568735 [ 2320.671647] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2320.829454] Lustre: server umount lustre-MDT0001 complete [ 2325.247900] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing unload_modules_local [ 2326.726423] Key type lgssc unregistered [ 2326.861630] LNet: 147663:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2326.864379] LNetError: 147663:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2326.873649] LNet: Removed LNI 192.168.203.127@tcp [ 2327.242959] Key type .llcrypt unregistered [ 2327.244278] Key type ._llcrypt unregistered [ 2356.522047] Key type ._llcrypt registered [ 2356.523017] Key type .llcrypt registered [ 2356.567364] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 2356.909262] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2356.959447] alg: No test for adler32 (adler32-zlib) [ 2357.844257] Lustre: Lustre: Build Version: 2.17.50_152_g82f9dcf [ 2357.957035] LNet: Added LNI 192.168.203.127@tcp [8/256/0/180] [ 2359.544172] Key type lgssc registered [ 2360.001335] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2363.147084] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2363.157891] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2364.353553] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2365.841173] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 2369.506472] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2369.676045] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2371.573589] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 2374.049812] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2375.705688] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2378.868108] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2379.067879] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2380.086359] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:193) [ 2381.938664] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 2384.615440] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2389.294624] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:195 to 0x280000401:225) [ 2394.598356] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2394.599248] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2394.601450] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2394.606046] Lustre: Skipped 1 previous similar message [ 2395.310438] Lustre: server umount lustre-OST0000 complete [ 2399.199101] Lustre: server umount lustre-MDT0000 complete [ 2399.714572] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2399.723471] LustreError: 150834:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2399.734967] LustreError: 150834:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 2401.035443] LustreError: 150828:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1772169674 with bad export cookie 12097329471879331858 [ 2401.041830] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2401.043179] LustreError: 150828:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2401.191357] Lustre: server umount lustre-MDT0001 complete [ 2405.865236] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing unload_modules_local [ 2407.353784] Key type lgssc unregistered [ 2407.523630] LNet: 153291:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2407.528446] LNetError: 153291:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2407.539537] LNet: Removed LNI 192.168.203.127@tcp [ 2408.003735] Key type .llcrypt unregistered [ 2408.006119] Key type ._llcrypt unregistered [ 2419.463980] Key type ._llcrypt registered [ 2419.465328] Key type .llcrypt registered [ 2419.499571] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 2419.890990] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2419.898428] alg: No test for adler32 (adler32-zlib) [ 2420.763454] Lustre: Lustre: Build Version: 2.17.50_152_g82f9dcf [ 2420.854472] LNet: Added LNI 192.168.203.127@tcp [8/256/0/180] [ 2422.440217] Key type lgssc registered [ 2423.052948] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2430.277689] Lustre: DEBUG MARKER: == conf-sanity test 100: check lshowmount lists MGS, MDT, OST and 0@lo ========================================================== 00:21:43 (1772169703) [ 2437.957650] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_hostid [ 2441.187208] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 2457.474348] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2457.491979] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2458.617813] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2458.638381] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2458.694444] Lustre: lustre-MDT0000: new disk, initializing [ 2458.736540] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2458.748552] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2460.246142] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 2465.250602] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2465.295219] Lustre: 157499:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2465.324284] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 2465.327046] Lustre: Skipped 1 previous similar message [ 2465.369313] Lustre: lustre-MDT0001: new disk, initializing [ 2465.418058] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2465.438987] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 2465.446218] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2467.140321] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 2470.825579] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2472.561121] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2475.495897] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2475.613536] Lustre: lustre-OST0000: new disk, initializing [ 2475.615538] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 2475.642326] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2476.424419] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 2476.430779] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2476.486248] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2478.229482] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 2482.248144] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2486.755179] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2486.757487] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2486.760694] LustreError: Skipped 1 previous similar message [ 2486.771510] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2486.777653] Lustre: Skipped 1 previous similar message [ 2491.876772] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2491.880595] Lustre: Skipped 1 previous similar message [ 2492.267331] Lustre: server umount lustre-OST0000 complete [ 2496.481674] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2496.486797] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2496.493908] Lustre: Skipped 1 previous similar message [ 2496.497286] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2500.279705] Lustre: server umount lustre-MDT0000 complete [ 2502.112534] LustreError: 160282:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1772169775 with bad export cookie 13456669253909447990 [ 2502.120028] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2502.126182] LustreError: 160282:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2502.280073] Lustre: server umount lustre-MDT0001 complete [ 2507.183313] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing unload_modules_local [ 2508.485259] Key type lgssc unregistered [ 2508.657678] LNet: 161015:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2508.662855] LNetError: 161015:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2508.673629] LNet: Removed LNI 192.168.203.127@tcp [ 2509.011166] Key type .llcrypt unregistered [ 2509.012356] Key type ._llcrypt unregistered [ 2520.011971] Key type ._llcrypt registered [ 2520.013404] Key type .llcrypt registered [ 2520.060601] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 2520.414056] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2520.454302] alg: No test for adler32 (adler32-zlib) [ 2521.317749] Lustre: Lustre: Build Version: 2.17.50_152_g82f9dcf [ 2521.398787] LNet: Added LNI 192.168.203.127@tcp [8/256/0/180] [ 2522.984194] Key type lgssc registered [ 2523.595842] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2527.637960] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2527.650425] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2528.857628] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2530.554485] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 2534.718136] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2534.865084] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2536.556889] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 2539.055558] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2540.774267] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2544.310844] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2544.517955] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2547.405271] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 2549.975659] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2553.780497] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:33) [ 2562.663789] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2562.671351] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2562.675740] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2562.678868] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2562.682403] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2563.023878] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2563.338795] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2563.341052] Lustre: Skipped 1 previous similar message [ 2563.346099] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2563.350079] Lustre: Skipped 1 previous similar message [ 2563.351637] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2563.354635] Lustre: Skipped 1 previous similar message [ 2563.356603] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2563.360645] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2563.362415] Lustre: Skipped 1 previous similar message [ 2563.640269] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2563.929801] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2564.210866] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2564.494545] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2564.496936] Lustre: Skipped 3 previous similar messages [ 2564.502201] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2564.505536] Lustre: Skipped 3 previous similar messages [ 2564.506947] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2564.508765] Lustre: Skipped 3 previous similar messages [ 2564.509918] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2564.513690] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2564.515714] Lustre: Skipped 3 previous similar messages [ 2564.831065] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2565.147064] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2565.422186] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2565.740888] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2566.020815] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2566.321569] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2566.675208] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2566.677054] Lustre: Skipped 6 previous similar messages [ 2566.681484] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2566.684386] Lustre: Skipped 6 previous similar messages [ 2566.685668] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2566.689181] Lustre: Skipped 6 previous similar messages [ 2566.690615] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2566.694976] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2566.696578] Lustre: Skipped 6 previous similar messages [ 2566.978383] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2567.256411] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2567.540443] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2567.850210] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2568.171573] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2568.477933] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2568.834640] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2569.212723] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2569.549195] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2569.854233] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2570.180988] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2570.486272] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2570.791954] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2570.794753] Lustre: Skipped 12 previous similar messages [ 2570.800357] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2570.803621] Lustre: Skipped 12 previous similar messages [ 2570.805081] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2570.807054] Lustre: Skipped 12 previous similar messages [ 2570.808489] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2570.811532] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2570.813441] Lustre: Skipped 12 previous similar messages [ 2571.100239] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2571.392041] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2571.754798] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2572.060373] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2572.381212] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2572.683424] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2572.990032] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2573.301031] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2573.631435] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2574.014058] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2574.438840] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2574.803287] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2575.120623] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2575.460233] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2575.785745] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2576.153079] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2576.482615] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2576.881932] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2577.187978] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2577.548993] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2577.937955] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2578.290713] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2578.653755] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2579.022142] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2579.024598] Lustre: Skipped 23 previous similar messages [ 2579.031129] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2579.036683] Lustre: Skipped 23 previous similar messages [ 2579.038986] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2579.041840] Lustre: Skipped 23 previous similar messages [ 2579.043586] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2579.047319] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2579.049804] Lustre: Skipped 23 previous similar messages [ 2579.414250] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2579.736358] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2580.048279] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2580.363820] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2580.743186] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2581.180933] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2581.556688] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2581.995491] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2582.407112] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2582.812563] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2583.237326] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2583.582750] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2583.943172] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2584.315809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2584.739275] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2585.166711] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2585.643275] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2586.063154] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2586.461712] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2586.805105] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2587.183977] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2587.590224] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2587.971743] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2588.370145] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2588.842211] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2589.304753] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2589.706507] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2590.141391] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2590.502657] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2590.862362] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2591.270884] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2591.699689] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2592.171178] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2592.565325] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2592.941592] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2593.291779] LustreError: 162410:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 2593.294380] LustreError: 162410:0:(osp_precreate.c:1355:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 2593.295577] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2593.684191] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2594.151850] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2594.647461] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2595.094328] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2595.098975] Lustre: Skipped 39 previous similar messages [ 2595.109211] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2595.117943] Lustre: Skipped 39 previous similar messages [ 2595.121480] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2595.126820] Lustre: Skipped 39 previous similar messages [ 2595.130645] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2595.137933] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2595.142106] Lustre: Skipped 39 previous similar messages [ 2595.597256] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2596.068166] LustreError: 162410:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 2596.075065] LustreError: 162410:0:(osp_precreate.c:1355:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 2596.075679] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2596.551324] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2597.029709] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2597.547925] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2598.011678] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2598.384810] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2598.682427] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2599.077679] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2599.571802] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2600.072144] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2600.414396] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2600.762248] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2601.168336] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2601.540097] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2601.899765] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2602.247301] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2602.688440] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2603.155296] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2603.596331] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2603.953708] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2604.415603] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2604.887612] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2605.355299] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2605.812312] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2606.284327] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2606.740651] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2607.225524] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2607.716083] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2608.184060] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2608.611466] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2608.931696] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2609.302170] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2609.696220] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2610.116661] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2610.487379] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2610.876427] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2611.281079] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2611.659558] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2612.133561] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2612.587643] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2613.049733] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2613.533778] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2613.856600] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2614.264107] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2614.737035] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2615.241467] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2615.677727] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2616.135616] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2616.641889] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2617.114428] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2617.431632] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2617.916582] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2618.377301] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2618.770083] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2619.057989] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2619.414317] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2619.779564] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2620.150113] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2620.540543] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2620.953166] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2621.389489] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2621.850884] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2622.340376] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2622.845815] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2623.305467] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2623.743086] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2624.204646] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2624.655126] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2625.004138] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2625.311924] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2625.678665] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2626.120658] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2626.500464] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2626.849581] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2627.206524] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2627.209971] Lustre: Skipped 75 previous similar messages [ 2627.217101] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2627.222978] Lustre: Skipped 75 previous similar messages [ 2627.225826] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2627.229443] Lustre: Skipped 75 previous similar messages [ 2627.231981] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2627.238443] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2627.241676] Lustre: Skipped 75 previous similar messages [ 2627.627413] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2627.992781] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2628.387760] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2628.737376] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2629.049570] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2629.455145] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2629.860748] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2630.294416] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2630.723883] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2631.147971] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2631.486500] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2631.774810] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2632.056387] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2632.361403] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2632.656629] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2632.956017] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2633.259213] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2633.548142] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2633.858649] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2634.147186] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2634.438302] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2634.732992] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2635.026378] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2635.324982] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2635.612484] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2635.904502] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2636.186305] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2636.472270] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2636.769786] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2637.112680] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2637.405953] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2637.718340] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2638.022179] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2638.333376] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2638.629379] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2638.966826] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2639.324972] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2639.764581] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2640.169183] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2640.565169] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2641.016102] LustreError: 162410:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 2641.022163] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2641.022862] LustreError: 162410:0:(osp_precreate.c:1355:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 2641.412633] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2641.824476] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2642.302420] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2642.697955] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2643.101259] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2643.531944] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2643.902181] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2644.347731] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2644.853115] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2645.229522] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2645.660852] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2646.076787] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2646.554656] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2646.993573] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2647.466515] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2647.917472] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2648.386809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2648.820336] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2649.226922] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2649.577740] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2649.940230] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2650.350925] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2650.806990] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2651.264705] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2651.723892] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2652.178534] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2652.648770] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2653.054866] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2653.476336] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2653.912311] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2654.353479] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2654.792309] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2655.269343] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2655.693231] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2656.115373] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2656.510617] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2656.946317] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2657.405631] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2657.876978] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2658.331348] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2658.806518] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2659.232409] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2659.592427] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2659.921881] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2660.356597] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2660.776871] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2661.167111] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2661.627547] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2662.062430] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2662.487164] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2662.916444] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2663.306915] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2663.759772] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2664.198928] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2664.612342] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2665.066970] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2665.495844] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2665.873934] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2666.292522] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2666.664355] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2667.039392] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2667.452183] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2667.885825] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2668.275272] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2668.717773] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2669.172419] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2669.509161] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2669.912616] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2670.327273] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2670.711171] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2671.167354] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2671.506831] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2671.849398] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2672.226233] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2672.545489] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2672.907079] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2673.291638] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2673.664680] LustreError: 162410:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 2673.667855] LustreError: 162410:0:(osp_precreate.c:1355:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 2673.668387] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2673.953226] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2674.242334] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2674.528804] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2674.866851] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2675.252653] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2675.707587] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2676.071270] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2676.400096] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2676.850185] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2677.304913] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2677.686175] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2678.156683] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2678.606164] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2678.988662] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2679.311078] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2679.696265] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2680.131135] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2680.558856] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2680.969611] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2681.435033] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2681.863600] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2682.274894] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2682.656806] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2683.119378] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2683.582393] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2684.030254] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2684.451356] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2684.871897] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2685.288479] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2685.713641] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2686.187208] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2686.630928] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2687.084793] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2687.538572] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2688.012496] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2688.445119] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2688.907795] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2689.334376] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2689.803806] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2690.283651] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2690.713109] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2691.150119] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2691.625601] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2691.630532] Lustre: Skipped 161 previous similar messages [ 2691.639767] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2691.647151] Lustre: Skipped 161 previous similar messages [ 2691.650462] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2691.654633] Lustre: Skipped 161 previous similar messages [ 2691.657427] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2691.664805] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2691.668790] Lustre: Skipped 161 previous similar messages [ 2692.104214] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2692.544682] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2692.928197] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2693.207636] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2693.477473] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2693.762561] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2694.151952] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2694.593043] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2695.055231] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2695.485692] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2695.933395] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2696.411599] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2696.877685] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2697.316295] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2697.777061] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2698.225078] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2698.678380] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2699.126902] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2699.589953] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2700.039512] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2700.499975] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2700.973231] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2701.435749] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2701.867451] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2702.304678] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2702.705536] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2703.082553] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2703.484814] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2703.917573] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2704.390580] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2704.878337] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2705.356381] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2705.824438] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2706.248610] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2706.690123] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2707.148319] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2707.599298] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2708.035096] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2708.478709] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2708.922579] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2709.282938] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2709.726105] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2710.210908] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2710.707257] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2711.186956] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2711.715596] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2712.199420] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2712.685779] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2713.175074] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2713.634196] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2714.099841] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2714.577213] LustreError: 162410:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 2714.583652] LustreError: 162410:0:(osp_precreate.c:1355:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 2714.584136] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2715.046440] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2715.496216] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2715.922879] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2716.379636] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2716.836288] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2717.311463] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2717.703652] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2718.147564] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2718.629857] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2719.106291] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2719.566159] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2720.022318] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2720.456051] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2720.928288] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2721.422107] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2721.894460] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2722.324388] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2722.808474] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2723.250420] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2723.710158] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2724.196292] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2724.668318] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2725.127416] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2725.604271] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2726.067438] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2726.542697] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2727.012412] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2727.476529] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2727.918378] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2728.409137] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2728.882535] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2729.345051] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2729.782558] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2730.206374] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2730.672229] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2731.151101] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2731.601798] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2732.038259] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2732.518432] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2732.983325] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2733.448499] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2733.937598] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2734.377565] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2734.844045] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2735.316693] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2735.776059] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2736.207607] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2736.669511] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2737.129090] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2737.607152] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2738.088186] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2738.536770] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2739.020272] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2739.412918] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2739.695492] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2740.037807] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2740.508523] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2740.932030] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2741.365143] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2741.854454] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2742.286108] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2742.728172] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2743.181890] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2743.626819] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2744.055577] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2744.461107] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2744.869535] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2745.321770] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2745.786798] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2746.227797] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2746.680220] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2747.148755] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2747.596305] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2748.027723] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2748.513441] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2748.933424] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2749.370880] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2749.811269] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2750.230803] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2750.642554] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2751.089443] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2751.545341] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2751.968126] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2752.457596] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2752.861439] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2753.210285] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2753.624028] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2753.985694] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2754.378979] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2754.877643] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2755.353764] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2755.729377] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2756.155097] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2756.577341] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2757.021147] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2757.320019] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2757.712333] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2758.130656] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2758.621701] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2759.100368] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2759.550492] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2759.968759] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2760.395648] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2760.752108] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2761.197763] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2761.646709] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2762.105123] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2762.584761] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2763.055766] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2763.483688] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2763.948213] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2764.368481] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2764.813452] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2765.269971] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2765.717503] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2766.163132] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2766.629794] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2767.058695] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2767.503312] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2767.925648] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2768.336417] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2768.683912] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2769.173532] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2769.622854] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2769.998729] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2770.464462] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2770.887737] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2771.264218] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2771.635818] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2772.020392] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2772.481645] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2772.860212] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2773.301599] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2773.654717] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2774.092517] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2774.533560] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2774.948661] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2775.417387] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2775.857448] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2776.232313] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2776.679856] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2777.041889] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2777.463206] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2777.851622] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2778.303324] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2778.761363] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2779.213551] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2779.646525] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2780.094499] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2780.566438] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2780.985964] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2781.404235] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2781.843679] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2782.243582] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2782.615183] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2783.062326] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2783.463702] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2783.823887] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2784.296946] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2784.749493] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2785.182724] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2785.649388] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2786.044074] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2786.488171] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2786.964718] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2787.354867] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2787.756939] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2788.156844] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2788.576687] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2789.040403] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2789.516441] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2789.957674] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2790.395740] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2790.852486] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2791.296913] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2791.742762] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2792.198716] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2792.625743] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2793.086384] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2793.577823] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2794.026715] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2794.484741] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2794.959004] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2795.399022] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2795.784581] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2796.222165] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2796.649573] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2797.041952] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2797.451550] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2797.906437] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2798.366636] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2798.832276] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2799.257588] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2799.660265] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2799.936601] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2800.327616] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2800.749677] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2801.211332] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2801.657542] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2802.119158] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2802.484316] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2802.880935] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2803.313626] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2803.776215] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2804.216187] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2804.683391] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2805.081053] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2805.457559] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2805.891177] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2806.334140] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2806.695696] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2807.091747] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2807.518629] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2807.921966] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2808.328426] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2808.782439] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2809.210944] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2809.609517] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2810.037766] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2810.406592] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2810.803642] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2811.197326] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2811.626596] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2812.060131] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2812.433378] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2812.729192] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2813.075906] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2813.494066] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2813.920426] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2814.318179] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2814.770292] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2815.182586] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2815.614507] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2816.066450] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2816.513162] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2816.953990] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2817.414574] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2817.876483] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2818.317201] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2818.801139] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2819.217944] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2819.642573] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 2819.647131] Lustre: Skipped 293 previous similar messages [ 2819.656163] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2819.663704] Lustre: Skipped 293 previous similar messages [ 2819.666793] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 2819.671318] Lustre: Skipped 293 previous similar messages [ 2819.674559] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2819.685720] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 2819.689608] Lustre: Skipped 293 previous similar messages [ 2820.122158] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2820.573144] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2821.029122] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2821.508615] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2821.948452] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2822.409795] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2822.891940] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2823.368132] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2823.743378] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2824.074719] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2824.405064] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2824.746300] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2825.044463] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2825.391618] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2825.702753] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2826.017229] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2826.403278] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2826.873506] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2827.271633] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2827.615636] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2827.943079] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2828.288075] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2828.589252] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2828.891316] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2829.230438] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2829.570607] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2829.957562] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2830.379952] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2830.803609] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2831.233987] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2831.591423] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2831.947813] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2832.368252] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2832.816385] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2833.228492] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2833.646453] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2834.060574] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2834.483425] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2834.899269] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2835.329035] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2835.758162] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2836.143571] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2836.582187] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2837.015370] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2837.489820] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2838.008204] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2838.445965] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2838.904574] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2839.336576] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2839.801328] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2840.247425] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2840.733711] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2841.145376] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2841.563300] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2842.048606] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2842.490122] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2842.954856] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2843.433879] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2843.878243] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2844.283058] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2844.720353] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2845.130691] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2845.530744] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2846.000695] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2846.436065] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2846.859270] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2847.314621] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2847.765332] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2848.219269] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2848.692464] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2849.151937] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2849.605392] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2850.037323] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2850.450931] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2850.899828] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2851.356535] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2851.816445] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2852.303368] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2852.759121] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2853.219379] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2853.693677] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2854.183238] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2854.622551] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2855.092186] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2855.588586] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2856.046224] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2856.500333] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2857.018668] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2857.460834] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2857.829320] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2858.254228] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2858.670244] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2859.095134] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2859.543425] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2859.934159] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2860.261566] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2860.677740] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2861.140230] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2861.548192] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2861.996783] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2862.402773] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2862.823400] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2863.272587] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2863.680527] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2864.129662] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2864.595593] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2865.053295] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2865.544440] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2866.063316] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2866.529166] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2866.989890] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2867.486983] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2867.924260] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2868.373052] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2868.819941] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2869.244365] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2869.701047] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2870.169176] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2870.613444] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2871.040871] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2871.425300] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2871.827295] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2872.298700] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2872.726168] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2873.155925] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2873.541304] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2874.011157] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2874.469599] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2874.899305] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2875.354268] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2875.810165] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2876.228529] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2876.698080] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2877.146065] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2877.575566] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2878.011828] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2878.445805] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2878.903965] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2879.366821] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2879.812284] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2880.273825] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2880.747525] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2881.199858] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2881.659485] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2882.161545] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2882.585475] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2883.029784] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2883.406336] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2883.756216] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2884.121936] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2884.496315] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2884.897803] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2885.330762] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2885.792755] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2886.244069] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2886.694417] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2887.164351] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2887.597752] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2888.041254] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2888.514973] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2888.963689] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2889.415029] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2889.891357] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2890.323424] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2890.776974] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2891.195602] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2891.637784] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2892.026112] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2892.421850] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2892.826414] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2893.245705] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2893.669814] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2894.058141] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2894.498885] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2894.943903] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2895.331823] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2895.766550] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2896.187637] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2896.622130] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2897.068040] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2897.528572] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2897.961850] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2898.373243] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2898.824355] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2899.251203] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2899.675662] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2900.074165] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2900.519598] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2900.951487] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2901.419397] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2901.845258] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2902.302061] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2902.760049] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2903.189460] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2903.628991] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2904.097675] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2904.533099] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2904.996580] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2905.473384] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2905.913537] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2906.356740] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2906.817445] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2907.266741] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2907.713778] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2908.158808] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2908.596676] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2909.059158] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2909.541128] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2909.988912] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2910.434702] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2910.897594] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2911.330724] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2911.771548] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2912.228440] LustreError: 162410:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 2912.235308] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2912.236052] LustreError: 162410:0:(osp_precreate.c:1355:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 2912.646821] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2913.099418] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2913.567714] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2914.022994] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2914.465389] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2914.953779] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2915.397683] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2915.843958] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2916.286674] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2916.732865] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2917.179675] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2917.640521] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2918.069206] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2918.528501] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2919.013959] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2919.465278] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2919.899037] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2920.311737] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2920.598784] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2920.995827] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2921.441665] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2921.884906] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2922.334786] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2922.828589] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2923.271118] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2923.717934] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2924.186719] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2924.612597] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2925.057855] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2925.431227] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2925.902765] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2926.357930] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2926.832299] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2927.290127] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2927.737625] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2928.204609] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2928.634045] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2929.068997] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2929.538124] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2929.952711] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2930.395515] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2930.865828] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2931.303607] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2931.740268] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2932.080516] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2932.508414] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2932.929876] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2933.362279] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2933.771599] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2934.206195] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2934.581161] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2934.950053] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2935.319684] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2935.689410] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2936.126458] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2936.568587] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2936.919155] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2937.228081] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2937.647235] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2938.080785] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2938.506105] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2938.937894] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2939.398487] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2939.829699] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2940.262093] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2940.616145] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2940.927975] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2941.207214] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2941.503538] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2941.906402] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2942.319205] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2942.751024] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2943.174130] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2943.625187] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2944.061378] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2944.513556] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2944.941458] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2945.372614] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2945.780812] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2946.220959] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2946.673385] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2947.153737] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2947.595665] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2948.044872] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2948.484306] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2948.916698] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2949.266649] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2949.697438] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2950.118827] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2950.548841] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2950.988619] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2951.443289] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2951.892177] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2952.353664] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2952.778881] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2953.200620] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2953.634189] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2954.079442] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2954.537406] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2954.947136] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2955.381577] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2955.815273] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2956.266262] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2956.707204] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2957.136254] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2957.602488] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2958.058065] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2958.505846] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2958.968432] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2959.406751] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2959.865870] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2960.334534] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2960.757336] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2961.211797] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2961.642324] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2962.075340] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2962.512613] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2962.972870] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2963.413745] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2963.850651] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2964.299274] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2964.733578] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2965.149452] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2965.623324] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2966.041422] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2966.499359] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2966.973769] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2967.413711] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2967.853759] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2968.321936] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2968.751357] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2969.181256] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2969.635237] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2970.075323] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2970.483385] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2970.911259] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2971.369137] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2971.806089] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2972.251569] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2972.691189] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2973.061412] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2973.535620] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2973.975986] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2974.421269] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2974.875308] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2975.302209] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2975.743096] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2976.186542] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2976.634202] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2977.061949] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2977.533220] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2977.949510] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2978.376558] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2978.818403] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2979.209131] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2979.637111] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2980.107309] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2980.513301] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2980.795663] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2981.101444] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2981.431968] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2981.783378] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2982.124352] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3112.773704] LustreError: 164548:0:(ofd_dev.c:1780:ofd_create_hdl()) lustre-OST0000: unable to precreate: rc = -28 [ 3112.780100] LustreError: 162410:0:(osp_precreate.c:651:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -28 [ 3235.809327] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3235.816486] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3235.827411] Lustre: Skipped 377 previous similar messages [ 3235.830769] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3238.369476] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3238.375824] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3239.907594] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3239.911294] Lustre: Skipped 1 previous similar message [ 3241.744455] Lustre: server umount lustre-OST0000 complete [ 3245.028901] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3245.034401] Lustre: Skipped 1 previous similar message [ 3249.766824] Lustre: server umount lustre-MDT0000 complete [ 3250.146821] LustreError: 162390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3250.157161] LustreError: 162390:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 3251.303226] LustreError: 162371:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1772170524 with bad export cookie 4750882223844811860 [ 3251.308635] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3251.309746] LustreError: 162371:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 3251.453920] Lustre: server umount lustre-MDT0001 complete [ 3256.014538] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing unload_modules_local [ 3257.407708] Key type lgssc unregistered [ 3257.580641] LNet: 217107:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3257.585134] LNetError: 217107:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3257.595530] LNet: Removed LNI 192.168.203.127@tcp [ 3258.046106] Key type .llcrypt unregistered [ 3258.048149] Key type ._llcrypt unregistered [ 3268.652886] Key type ._llcrypt registered [ 3268.654210] Key type .llcrypt registered [ 3268.696194] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 3269.006295] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3269.017243] alg: No test for adler32 (adler32-zlib) [ 3269.879621] Lustre: Lustre: Build Version: 2.17.50_152_g82f9dcf [ 3269.961118] LNet: Added LNI 192.168.203.127@tcp [8/256/0/180] [ 3271.536190] Key type lgssc registered [ 3272.055822] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3275.804571] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3275.815786] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3277.029492] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3278.754738] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 3282.173534] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3282.323292] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3284.041250] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 3286.716405] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3288.387247] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3291.511455] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3291.679705] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3294.257104] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 3296.980265] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3301.936072] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49666 to 0x280000401:49697) [ 3304.386841] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3305.226935] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3305.235729] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3305.240373] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3305.247339] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3305.247375] LustreError: 218500:0:(osp_precreate.c:1263:osp_precreate_thread()) cfs_fail_timeout id 2107 sleeping for 20000ms [ 3306.981183] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3306.983959] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3306.989301] Lustre: Skipped 1 previous similar message [ 3307.676836] Lustre: lustre-OST0000: Not available for connect from 192.168.203.27@tcp (stopping) [ 3307.681130] Lustre: Skipped 1 previous similar message [ 3308.268667] Lustre: server umount lustre-OST0000 complete [ 3325.328093] LustreError: 218500:0:(osp_precreate.c:1263:osp_precreate_thread()) cfs_fail_timeout id 2107 awake [ 3337.395925] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3337.562671] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3340.010506] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 3342.227289] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3347.818473] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3347.825300] LustreError: lustre-OST0000-osc-MDT0001: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3347.825397] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3347.834748] Lustre: Skipped 1 previous similar message [ 3349.007228] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 6 sec [ 3350.371449] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff89b786266000.ost_server_uuid 50 [ 3350.986857] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff89b786266000.ost_server_uuid in FULL state after 0 sec [ 3353.062583] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3353.064189] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3353.071789] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3353.078021] Lustre: Skipped 1 previous similar message [ 3358.182463] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3358.186124] Lustre: Skipped 1 previous similar message [ 3358.307447] Lustre: server umount lustre-OST0000 complete [ 3363.299084] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3363.306107] Lustre: Skipped 1 previous similar message [ 3363.309708] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3363.313132] Lustre: Skipped 1 previous similar message [ 3366.053121] Lustre: server umount lustre-MDT0000 complete [ 3367.582842] LustreError: 218462:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1772170640 with bad export cookie 5283579065341129325 [ 3367.589155] LustreError: 218462:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3367.589549] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3367.739669] Lustre: server umount lustre-MDT0001 complete [ 3371.555812] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing unload_modules_local [ 3373.081388] Key type lgssc unregistered [ 3373.249694] LNet: 223125:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3373.256386] LNetError: 223125:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3373.270645] LNet: Removed LNI 192.168.203.127@tcp [ 3373.717434] Key type .llcrypt unregistered [ 3373.719529] Key type ._llcrypt unregistered [ 3387.064168] Key type ._llcrypt registered [ 3387.065441] Key type .llcrypt registered [ 3387.110367] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 3387.511251] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3387.522024] alg: No test for adler32 (adler32-zlib) [ 3388.381278] Lustre: Lustre: Build Version: 2.17.50_152_g82f9dcf [ 3388.478494] LNet: Added LNI 192.168.203.127@tcp [8/256/0/180] [ 3390.064194] Key type lgssc registered [ 3390.589755] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3394.991769] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3395.002932] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3396.203354] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3397.843748] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 3402.059231] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3402.251399] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3403.778018] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 3405.193484] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 3408.377731] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3408.546534] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3411.081886] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 3415.178989] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3415.259643] Lustre: lustre-OST0001: new disk, initializing [ 3415.262511] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 3415.306593] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 3417.886136] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 3421.488696] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49699 to 0x280000401:49729) [ 3423.773374] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 3423.780129] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 3423.830491] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 3427.872231] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 3435.726491] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 3448.289491] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3448.294433] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3448.303100] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3449.318789] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3449.321135] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3449.326531] Lustre: Skipped 2 previous similar messages [ 3449.330417] Lustre: Skipped 2 previous similar messages [ 3454.272189] Lustre: server umount lustre-MDT0000 complete [ 3454.435262] LustreError: 227345:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3454.444787] LustreError: 227345:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 5 previous similar messages [ 3456.060276] LustreError: 224793:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1772170729 with bad export cookie 8461399364086636870 [ 3456.067300] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3456.067681] LustreError: 224793:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3456.213139] Lustre: server umount lustre-MDT0001 complete [ 3468.819611] Lustre: server umount lustre-OST0000 complete [ 3480.899882] Lustre: server umount lustre-OST0001 complete [ 3490.215983] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 3494.445057] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3494.686885] LustreError: 230147:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3494.713926] Lustre: mylustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3496.346131] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 3500.001456] LustreError: 230147:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3500.345359] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3502.220586] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 3503.666670] Lustre: 231255:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 3507.018836] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3507.207012] Lustre: mylustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3507.210497] Lustre: Skipped 1 previous similar message [ 3509.673818] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 3510.312066] LustreError: 231608:0:(ldlm_lib.c:1179:target_handle_connect()) mylustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3513.913413] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3516.644468] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 3519.984929] Lustre: mylustre-OST0001: new connection from mylustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:33) [ 3519.985093] Lustre: mylustre-OST0000: new connection from mylustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49731 to 0x280000401:49761) [ 3526.180217] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 3527.993114] Lustre: 233097:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 3540.453122] Lustre: mylustre-MDT0000-osp-MDT0001: Connection to mylustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3540.456772] Lustre: mylustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3540.461326] Lustre: Skipped 2 previous similar messages [ 3540.467543] Lustre: Skipped 4 previous similar messages [ 3541.167591] Lustre: server umount mylustre-MDT0000 complete [ 3542.671883] LustreError: 233099:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1772170815 with bad export cookie 8461399364086639663 [ 3542.677872] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3542.678849] LustreError: 233099:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3544.822226] Lustre: server umount mylustre-MDT0001 complete [ 3557.010550] Lustre: server umount mylustre-OST0000 complete [ 3568.109312] Lustre: server umount mylustre-OST0001 complete [ 3577.817520] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 3582.812446] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3583.053501] LustreError: 235391:0:(ldlm_lib.c:1179:target_handle_connect()) tfs-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3583.090434] Lustre: tfs-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3583.093774] Lustre: Skipped 1 previous similar message [ 3584.656856] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 3588.998826] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3591.114098] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 3592.547155] Lustre: 236498:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 3595.661509] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3598.716162] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 3599.980733] LustreError: 236853:0:(ldlm_lib.c:1179:target_handle_connect()) tfs-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3599.995315] LustreError: 236853:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 3603.015726] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3605.620331] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 3608.047947] Lustre: tfs-OST0000: new connection from tfs-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49731 to 0x280000401:49793) [ 3608.049981] Lustre: tfs-OST0001: new connection from tfs-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) [ 3614.891467] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 3616.525781] Lustre: 238341:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 3624.929846] LustreError: tfs-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3624.934671] Lustre: tfs-MDT0000-osp-MDT0001: Connection to tfs-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3624.941972] Lustre: Skipped 1 previous similar message [ 3624.945408] Lustre: tfs-MDT0000: Not available for connect from 0@lo (stopping) [ 3630.335339] Lustre: server umount tfs-MDT0000 complete [ 3632.097216] LustreError: 236118:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1772170905 with bad export cookie 8461399364086641553 [ 3632.104025] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3632.104784] LustreError: 236118:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3632.248189] Lustre: server umount tfs-MDT0001 complete [ 3644.438428] Lustre: server umount tfs-OST0000 complete [ 3656.448162] Lustre: server umount tfs-OST0001 complete [ 3665.978721] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 3670.573950] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3670.818649] LustreError: 240575:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3670.861785] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3670.865911] Lustre: Skipped 3 previous similar messages [ 3672.489406] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 3676.671065] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3678.596984] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 3679.932811] Lustre: 241683:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 3683.109611] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3685.735205] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 3689.884555] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3692.569799] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 3695.467689] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49731 to 0x280000401:49825) [ 3695.468194] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:97) [ 3702.073861] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 3703.925864] Lustre: 243524:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 3712.346527] Lustre: DEBUG MARKER: == conf-sanity test 104a: Make sure user defined options are reflected in mount ========================================================== 00:43:05 (1772170985) [ 3726.312428] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3726.314978] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3726.321127] Lustre: Skipped 6 previous similar messages [ 3726.324933] Lustre: Skipped 6 previous similar messages [ 3730.875674] Lustre: server umount lustre-MDT0000 complete [ 3731.428467] LustreError: 240574:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3731.436758] LustreError: 240574:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 5 previous similar messages [ 3732.561164] LustreError: 241302:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1772171005 with bad export cookie 8461399364086643219 [ 3732.567312] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3732.567597] LustreError: 241302:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 3736.547542] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3736.549487] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 3736.556623] Lustre: Skipped 1 previous similar message [ 3736.560975] Lustre: Skipped 1 previous similar message [ 3738.780331] Lustre: server umount lustre-MDT0001 complete [ 3746.763879] Lustre: server umount lustre-OST0000 complete [ 3754.611286] Lustre: server umount lustre-OST0001 complete [ 3757.339539] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_hostid [ 3761.357095] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 3778.089675] LDISKFS-fs (dm-0): Mount option "noacl" will be removed by 3.5 [ 3778.089675] Contact linux-ldiskfs@vger.kernel.org if you think we should keep it. [ 3778.089675] [ 3778.139791] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: acl,user_xattr,errors=remount-ro,noacl,no_mbcache,nodelalloc [ 3778.277087] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3778.294571] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3778.345906] Lustre: lustre-MDT0000: new disk, initializing [ 3778.374421] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3778.377251] Lustre: Skipped 3 previous similar messages [ 3778.385229] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3780.120731] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 3785.583193] LDISKFS-fs (dm-1): Mount option "noacl" will be removed by 3.5 [ 3785.583193] Contact linux-ldiskfs@vger.kernel.org if you think we should keep it. [ 3785.583193] [ 3785.598975] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: acl,user_xattr,errors=remount-ro,noacl,no_mbcache,nodelalloc [ 3785.673144] Lustre: 246666:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 3785.722478] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 3785.726439] Lustre: Skipped 1 previous similar message [ 3785.778500] Lustre: lustre-MDT0001: new disk, initializing [ 3785.864381] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 3785.870912] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 3787.687682] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 3793.313678] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3793.473888] Lustre: lustre-OST0000: new disk, initializing [ 3793.478300] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3794.702940] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 3794.709372] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 3794.766077] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 3796.198625] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 3801.911271] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3802.036608] Lustre: lustre-OST0001: new disk, initializing [ 3802.041948] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 3803.532646] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 3803.537726] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 3803.574880] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 3804.600038] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 3810.443068] Lustre: DEBUG MARKER: == conf-sanity test 104b: Mount uses last flock argument ========================================================== 00:44:43 (1772171083) [ 3815.012647] Lustre: DEBUG MARKER: == conf-sanity test 105: check file creation for ro and rw bind mnt pt ========================================================== 00:44:48 (1772171088) [ 3829.223636] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3829.224497] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3829.227753] Lustre: Skipped 1 previous similar message [ 3829.229801] Lustre: Skipped 2 previous similar messages [ 3832.578854] Lustre: server umount lustre-OST0000 complete [ 3834.338365] LustreError: 250082:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3834.344550] LustreError: 250082:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 4 previous similar messages [ 3848.160089] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 3848.244700] Lustre: server umount lustre-MDT0000 complete [ 3849.567191] LustreError: 248215:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1772171122 with bad export cookie 8461399364086644773 [ 3849.570624] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3849.570982] LustreError: 248215:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3855.739160] Lustre: server umount lustre-MDT0001 complete [ 3859.607974] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing unload_modules_local [ 3869.524207] Lustre: server umount lustre-OST0001 complete [ 3871.772011] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_hostid [ 3879.406557] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 3894.464111] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3894.587285] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3894.606166] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3894.649777] Lustre: lustre-MDT0000: new disk, initializing [ 3894.693780] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3896.188731] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 3901.092358] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3901.160517] Lustre: 253536:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 3901.308097] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 3902.787223] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 3906.426561] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3907.953610] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3910.612875] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3910.722696] Lustre: lustre-OST0000: new disk, initializing [ 3910.724447] Lustre: Skipped 1 previous similar message [ 3910.726278] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3910.728360] Lustre: Skipped 2 previous similar messages [ 3910.757476] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3910.759797] Lustre: Skipped 5 previous similar messages [ 3911.810989] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 3911.814686] Lustre: Skipped 1 previous similar message [ 3911.816945] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 3911.846196] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 3912.768617] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 3916.007862] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3922.402085] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3922.403754] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3922.405242] LustreError: Skipped 1 previous similar message [ 3922.406253] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3922.410975] Lustre: Skipped 5 previous similar messages [ 3922.412720] Lustre: Skipped 11 previous similar messages [ 3924.445737] Lustre: server umount lustre-OST0000 complete [ 3927.008892] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3940.320200] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 3940.400677] Lustre: server umount lustre-MDT0000 complete [ 3941.830850] LustreError: 254311:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1772171214 with bad export cookie 8461399364086646243 [ 3941.835877] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3941.837950] LustreError: 254311:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 3941.980154] Lustre: server umount lustre-MDT0001 complete [ 3945.827877] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing unload_modules_local [ 3947.373869] Key type lgssc unregistered [ 3947.551717] LNet: 256906:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3947.556188] LNetError: 256906:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3947.569594] LNet: Removed LNI 192.168.203.127@tcp [ 3948.013144] Key type .llcrypt unregistered [ 3948.014881] Key type ._llcrypt unregistered [ 3957.643262] Key type ._llcrypt registered [ 3957.644438] Key type .llcrypt registered [ 3957.678020] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 3958.134853] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3958.143516] alg: No test for adler32 (adler32-zlib) [ 3958.985239] Lustre: Lustre: Build Version: 2.17.50_152_g82f9dcf [ 3959.059776] LNet: Added LNI 192.168.203.127@tcp [8/256/0/180] [ 3960.640142] Key type lgssc registered [ 3960.962424] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3963.560422] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3963.566878] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3964.732722] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3966.029322] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 3969.242974] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3969.361928] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3970.661156] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 3972.545584] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3973.999725] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3976.407148] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3976.530971] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3978.325080] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 3980.218541] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3980.750779] Lustre: Setting parameter lustre-OST0000.ost.unknown_param=50 in log lustre-OST0000 [ 3984.870690] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3984.872348] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3984.884683] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3987.812242] Lustre: server umount lustre-OST0000 complete [ 3989.499913] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3989.505063] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3989.507251] Lustre: Skipped 1 previous similar message [ 3994.594869] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3994.599107] Lustre: Skipped 1 previous similar message [ 3995.701800] Lustre: server umount lustre-MDT0000 complete [ 3997.430100] LustreError: 258307:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1772171270 with bad export cookie 4350277041272495093 [ 3997.436803] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3997.439292] LustreError: 258307:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3997.594895] Lustre: server umount lustre-MDT0001 complete [ 4002.697965] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing unload_modules_local [ 4004.170702] Key type lgssc unregistered [ 4004.320599] LNet: 261556:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4004.323700] LNetError: 261556:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4004.332588] LNet: Removed LNI 192.168.203.127@tcp [ 4004.784278] Key type .llcrypt unregistered [ 4004.787157] Key type ._llcrypt unregistered [ 4013.639250] Key type ._llcrypt registered [ 4013.640444] Key type .llcrypt registered [ 4013.676850] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 4014.231714] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4014.241848] alg: No test for adler32 (adler32-zlib) [ 4015.148368] Lustre: Lustre: Build Version: 2.17.50_152_g82f9dcf [ 4015.276310] LNet: Added LNI 192.168.203.127@tcp [8/256/0/180] [ 4016.864212] Key type lgssc registered [ 4017.442509] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4021.828705] Lustre: lustre-OST0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4021.840630] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4037.344429] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 4042.464257] LustreError: 262708:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.203.127@tcp: failed processing log, type 4: rc = -110 [ 4069.088233] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4071.618324] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 4074.103130] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4075.236194] Lustre: server umount lustre-OST0000 complete [ 4082.588717] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing unload_modules_local [ 4084.105705] Key type lgssc unregistered [ 4084.271761] LNet: 264207:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4084.277231] LNetError: 264207:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4084.286611] LNet: Removed LNI 192.168.203.127@tcp [ 4084.741609] Key type .llcrypt unregistered [ 4084.744080] Key type ._llcrypt unregistered [ 4103.493262] Key type ._llcrypt registered [ 4103.494804] Key type .llcrypt registered [ 4103.540144] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 4103.970394] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4103.978537] alg: No test for adler32 (adler32-zlib) [ 4104.828369] Lustre: Lustre: Build Version: 2.17.50_152_g82f9dcf [ 4104.918221] LNet: Added LNI 192.168.203.127@tcp [8/256/0/180] [ 4106.504235] Key type lgssc registered [ 4107.063402] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4113.534614] loop0: detected capacity change from 0 to 204800000 [ 4113.653926] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 4113.657899] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 4113.860176] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 4114.390539] loop0: detected capacity change from 0 to 204800000 [ 4114.492355] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 4114.497060] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 4114.713597] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 4115.215447] loop0: detected capacity change from 0 to 204800000 [ 4115.299588] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 4115.303932] blk_update_request: operation not supported error, dev loop0, sector 8224 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 4115.359306] blk_update_request: operation not supported error, dev loop0, sector 58264 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 4115.890200] loop0: detected capacity change from 0 to 204800000 [ 4115.991888] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 4116.553950] loop0: detected capacity change from 0 to 204800000 [ 4116.567425] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 4118.544333] loop0: detected capacity change from 0 to 204800000 [ 4118.559442] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 4120.489616] loop0: detected capacity change from 0 to 204800000 [ 4120.506771] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 4122.457277] loop0: detected capacity change from 0 to 204800000 [ 4122.474939] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 4124.316795] loop0: detected capacity change from 0 to 204800000 [ 4124.362743] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4124.382237] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4124.444509] Lustre: 267580:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 4124.448744] Lustre: 267580:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000003:0xa:0x0]: rc = 0 [ 4124.453338] Lustre: 267580:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000003:0xb:0x0]: rc = 0 [ 4124.457938] Lustre: 267580:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0000: restore index '0x2010000-MDT0000' with [0x200000005:0x3:0x0]: rc = 0 [ 4124.462409] Lustre: 267580:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0000: restore index '0x1010000-MDT0000' with [0x200000005:0x2:0x0]: rc = 0 [ 4124.466557] Lustre: 267580:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000003:0xc:0x0]: rc = 0 [ 4124.470448] Lustre: 267580:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0000: restore index '0x10000-MDT0000' with [0x200000005:0x1:0x0]: rc = 0 [ 4124.474365] Lustre: 267580:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0000: restore index 'nodemap' with [0x200000003:0x3:0x0]: rc = 0 [ 4124.478116] Lustre: 267580:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000006:0x10000:0x0]: rc = 0 [ 4124.481886] Lustre: 267580:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000006:0x1010000:0x0]: rc = 0 [ 4124.486980] Lustre: 267580:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000006:0x2010000:0x0]: rc = 0 [ 4124.490899] Lustre: 267580:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0000: restore index '0x2020000' with [0x200000006:0x2020000:0x0]: rc = 0 [ 4124.496671] Lustre: 267580:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0000: restore index '0x20000' with [0x200000006:0x20000:0x0]: rc = 0 [ 4124.500557] Lustre: 267580:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0000: restore index '0x1020000' with [0x200000006:0x1020000:0x0]: rc = 0 [ 4127.525694] Lustre: server umount MGS complete [ 4127.951337] loop0: detected capacity change from 0 to 204800000 [ 4127.996961] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4128.175125] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4128.193825] Lustre: lustre-MDT0000: Aborting client recovery [ 4128.551329] loop1: detected capacity change from 0 to 204800000 [ 4128.595727] LDISKFS-fs (loop1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4128.638460] Lustre: 268009:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 4128.642239] Lustre: 268009:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0001: restore index '0x10000-MDT0001' with [0x200000005:0x1:0x0]: rc = 0 [ 4128.645647] Lustre: 268009:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0001: restore index '0x1010000-MDT0001' with [0x200000005:0x2:0x0]: rc = 0 [ 4128.649250] Lustre: 268009:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0001: restore index '0x2010000-MDT0001' with [0x200000005:0x3:0x0]: rc = 0 [ 4128.652790] Lustre: 268009:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0001: restore index '0x2010000' with [0x200000003:0x6:0x0]: rc = 0 [ 4128.656863] Lustre: 268009:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0001: restore index '0x1010000' with [0x200000003:0x5:0x0]: rc = 0 [ 4128.660754] Lustre: 268009:0:(osd_scrub.c:1831:osd_index_restore()) lustre-MDT0001: restore index '0x10000' with [0x200000003:0x4:0x0]: rc = 0 [ 4128.667879] Lustre: Found index 1 for lustre-MDT0001, updating log [ 4128.736760] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4128.764044] Lustre: lustre-MDT0001: Aborting client recovery [ 4129.142167] loop2: detected capacity change from 0 to 204800000 [ 4129.187793] LDISKFS-fs (loop2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4129.225537] Lustre: 268090:0:(osd_scrub.c:1831:osd_index_restore()) lustre-OST0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 4129.229135] Lustre: 268090:0:(osd_scrub.c:1831:osd_index_restore()) lustre-OST0000: restore index '0x1020000-OST0000' with [0x200000005:0x2:0x0]: rc = 0 [ 4129.233303] Lustre: 268090:0:(osd_scrub.c:1831:osd_index_restore()) lustre-OST0000: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 4129.237072] Lustre: 268090:0:(osd_scrub.c:1831:osd_index_restore()) lustre-OST0000: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 4129.240692] Lustre: 268090:0:(osd_scrub.c:1831:osd_index_restore()) lustre-OST0000: restore index '0x2020000-OST0000' with [0x200000005:0x3:0x0]: rc = 0 [ 4129.244544] Lustre: 268090:0:(osd_scrub.c:1831:osd_index_restore()) lustre-OST0000: restore index '0x20000-OST0000' with [0x200000005:0x1:0x0]: rc = 0 [ 4129.248376] Lustre: 268090:0:(osd_scrub.c:1831:osd_index_restore()) lustre-OST0000: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 4129.298654] Lustre: Found index 0 for lustre-OST0000, updating log [ 4129.333265] Lustre: lustre-OST0000: Aborting recovery [ 4129.689746] loop3: detected capacity change from 0 to 204800000 [ 4129.738359] LDISKFS-fs (loop3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4129.773809] Lustre: 268174:0:(osd_scrub.c:1831:osd_index_restore()) lustre-OST0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 4129.777523] Lustre: 268174:0:(osd_scrub.c:1831:osd_index_restore()) lustre-OST0001: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 4129.781260] Lustre: 268174:0:(osd_scrub.c:1831:osd_index_restore()) lustre-OST0001: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 4129.784723] Lustre: 268174:0:(osd_scrub.c:1831:osd_index_restore()) lustre-OST0001: restore index '0x1020000-OST0001' with [0x200000005:0x2:0x0]: rc = 0 [ 4129.788468] Lustre: 268174:0:(osd_scrub.c:1831:osd_index_restore()) lustre-OST0001: restore index '0x2020000-OST0001' with [0x200000005:0x3:0x0]: rc = 0 [ 4129.792361] Lustre: 268174:0:(osd_scrub.c:1831:osd_index_restore()) lustre-OST0001: restore index '0x20000-OST0001' with [0x200000005:0x1:0x0]: rc = 0 [ 4129.795917] Lustre: 268174:0:(osd_scrub.c:1831:osd_index_restore()) lustre-OST0001: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 4129.826159] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 4129.828673] Lustre: Skipped 1 previous similar message [ 4129.835277] Lustre: lustre-OST0001: Aborting recovery [ 4138.980877] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 4138.980892] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 4138.982654] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:5 to 0x280000400:33) [ 4138.990862] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:5 to 0x2c0000400:33) [ 4138.996249] LustreError: 267953:0:(lod_dev.c:510:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 10, retries 0, failed: rc = -108 [ 4139.000084] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000bd0 [ 4139.004825] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000bd0 [ 4140.670643] LustreError: 267921:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0000: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0000 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0000/identity_upcall, time 358us: rc = -2 [ 4154.338122] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4154.339307] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4154.340242] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4154.353035] Lustre: Skipped 2 previous similar messages [ 4158.266882] Lustre: server umount lustre-MDT0000 complete [ 4158.733871] LustreError: 267904:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1772171431 with bad export cookie 18233494217125342681 [ 4158.736509] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4158.741674] LustreError: 267904:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 4159.457131] LustreError: 268406:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4159.457854] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4159.458378] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 4159.458388] Lustre: Skipped 3 previous similar messages [ 4159.468258] LustreError: 268406:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 4159.476214] Lustre: Skipped 2 previous similar messages [ 4163.488921] LustreError: 268406:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4163.489239] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 4163.498686] LustreError: 268406:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 4163.502202] Lustre: Skipped 2 previous similar messages [ 4168.609110] LustreError: 267917:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4168.609159] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 4168.619788] LustreError: 267917:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 4168.628605] Lustre: Skipped 1 previous similar message [ 4173.280140] Lustre: lustre-MDT0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 4173.428653] Lustre: server umount lustre-MDT0001 complete [ 4188.128177] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 4188.182892] Lustre: server umount lustre-OST0000 complete [ 4194.790641] Lustre: server umount lustre-OST0001 complete [ 4198.368807] Lustre: DEBUG MARKER: == conf-sanity test 109a: test lctl clear_conf fsname ==== 00:51:11 (1772171471) [ 4210.378884] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_hostid [ 4214.192276] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 4231.416468] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4231.565682] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 4231.586231] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 4231.641575] Lustre: lustre-MDT0000: new disk, initializing [ 4231.676430] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4231.686103] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 4233.601126] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 4238.950465] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4239.013538] Lustre: 272221:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 4239.055471] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 4239.057398] Lustre: Skipped 1 previous similar message [ 4239.099308] Lustre: lustre-MDT0001: new disk, initializing [ 4239.139605] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4239.155694] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 4239.159258] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 4240.776769] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 4244.215456] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4245.868995] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4248.580686] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4248.733069] Lustre: lustre-OST0000: new disk, initializing [ 4248.736848] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 4248.795503] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4251.248609] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 4254.191693] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 4254.196624] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 4254.217274] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 4255.259363] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4258.108033] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 4271.024144] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 4276.263099] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 4315.621553] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4315.622236] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4315.623320] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4315.624520] Lustre: Skipped 1 previous similar message [ 4315.627189] LustreError: Skipped 1 previous similar message [ 4321.201373] Lustre: server umount lustre-OST0000 complete [ 4325.859050] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4325.860972] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4325.864077] Lustre: Skipped 1 previous similar message [ 4325.870100] Lustre: Skipped 4 previous similar messages [ 4329.276171] Lustre: server umount lustre-MDT0000 complete [ 4330.945883] LustreError: 272213:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1772171603 with bad export cookie 18233494217125345390 [ 4330.951967] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4330.954056] LustreError: 272213:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4331.099629] Lustre: server umount lustre-MDT0001 complete [ 4335.287373] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4337.010876] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 4339.526491] Lustre: server umount MGS complete [ 4345.084668] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4345.329718] LustreError: 277938:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4345.338177] LustreError: 277950:0:(qmt_pool.c:1614:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 4345.379801] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4346.837257] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 4350.435164] LustreError: 277938:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4351.303426] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4353.401520] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 4356.016986] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4357.704720] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4361.230507] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4364.018429] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 4366.548644] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4396.517983] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4396.519228] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4396.521993] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4396.534551] Lustre: Skipped 1 previous similar message [ 4401.323729] Lustre: server umount lustre-OST0000 complete [ 4406.755307] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4406.763344] Lustre: Skipped 1 previous similar message [ 4409.406737] Lustre: server umount lustre-MDT0000 complete [ 4411.320357] LustreError: 280328:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1772171684 with bad export cookie 18233494217125347231 [ 4411.326873] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4411.327286] LustreError: 280328:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4411.477765] Lustre: server umount lustre-MDT0001 complete [ 4416.046460] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing unload_modules_local [ 4417.444671] Key type lgssc unregistered [ 4417.602552] LNet: 281526:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4417.607311] LNetError: 281526:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4417.619517] LNet: Removed LNI 192.168.203.127@tcp [ 4418.062978] Key type .llcrypt unregistered [ 4418.065226] Key type ._llcrypt unregistered [ 4434.991107] Key type ._llcrypt registered [ 4434.993115] Key type .llcrypt registered [ 4435.057467] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_hostid [ 4443.126944] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 4443.457522] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4443.528057] alg: No test for adler32 (adler32-zlib) [ 4444.397754] Lustre: Lustre: Build Version: 2.17.50_152_g82f9dcf [ 4444.515664] LNet: Added LNI 192.168.203.127@tcp [8/256/0/180] [ 4446.104187] Key type lgssc registered [ 4446.742303] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4463.976435] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4463.985633] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4465.104059] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 4465.117254] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 4465.169915] Lustre: lustre-MDT0000: new disk, initializing [ 4465.202366] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4465.213162] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 4466.950516] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 4472.699511] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4472.773820] Lustre: 285425:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 4472.816463] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 4472.820757] Lustre: Skipped 1 previous similar message [ 4472.866590] Lustre: lustre-MDT0001: new disk, initializing [ 4472.912087] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4472.932138] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 4472.938170] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 4474.721981] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 4478.848409] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4480.651793] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4484.093403] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4484.250910] Lustre: lustre-OST0000: new disk, initializing [ 4484.254525] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 4484.298433] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4486.791904] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 4486.795686] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 4486.843353] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 4487.007671] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 4490.709166] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4494.714432] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 4503.816399] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 4511.938900] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 4523.213899] Lustre: Modifying parameter lustre-client.llite.max_read_ahead_mb=64 in log lustre-client [ 4574.182636] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4574.182824] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4574.192536] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4574.196394] LustreError: Skipped 1 previous similar message [ 4574.203294] Lustre: Skipped 1 previous similar message [ 4577.428754] Lustre: server umount lustre-OST0000 complete [ 4579.299236] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4579.301311] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4579.305106] Lustre: Skipped 2 previous similar messages [ 4579.309740] Lustre: Skipped 1 previous similar message [ 4584.418332] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4584.423285] Lustre: Skipped 1 previous similar message [ 4585.273965] Lustre: server umount lustre-MDT0000 complete [ 4587.010913] LustreError: 286200:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1772171859 with bad export cookie 3157863891037523580 [ 4587.017318] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4587.018565] LustreError: 286200:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4587.183991] Lustre: server umount lustre-MDT0001 complete [ 4591.091582] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4592.906327] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 4595.200261] Lustre: server umount MGS complete [ 4600.425782] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4600.609854] LustreError: 291128:0:(qmt_pool.c:1614:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 4600.638979] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4602.260664] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 4605.922963] LustreError: 291116:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4605.932127] LustreError: 291116:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 4605.975382] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4606.154767] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4607.763211] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 4610.118141] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4611.897629] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4615.268854] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4615.418561] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4617.930947] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 4620.456598] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4651.494555] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4651.494916] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4651.497307] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4651.502166] Lustre: Skipped 1 previous similar message [ 4652.140190] Lustre: server umount lustre-OST0000 complete [ 4656.610806] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4656.619075] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4656.622587] Lustre: Skipped 2 previous similar messages [ 4666.849549] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4666.852168] Lustre: Skipped 3 previous similar messages [ 4668.384102] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 4668.447256] Lustre: server umount lustre-MDT0000 complete [ 4669.874583] LustreError: 293502:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1772171942 with bad export cookie 3157863891037525533 [ 4669.877779] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4669.880127] LustreError: 293502:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 4670.010839] Lustre: server umount lustre-MDT0001 complete [ 4673.469466] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing unload_modules_local [ 4674.706357] Key type lgssc unregistered [ 4674.858532] LNet: 294703:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4674.861914] LNetError: 294703:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4674.874438] LNet: Removed LNI 192.168.203.127@tcp [ 4675.247476] Key type .llcrypt unregistered [ 4675.248871] Key type ._llcrypt unregistered [ 4682.068850] Key type ._llcrypt registered [ 4682.069964] Key type .llcrypt registered [ 4682.112979] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_hostid [ 4687.652798] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 4688.059264] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4688.067830] alg: No test for adler32 (adler32-zlib) [ 4688.903593] Lustre: Lustre: Build Version: 2.17.50_152_g82f9dcf [ 4688.976671] LNet: Added LNI 192.168.203.127@tcp [8/256/0/180] [ 4690.552110] Key type lgssc registered [ 4690.860147] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4697.596508] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 4702.083658] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4702.089877] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4703.172595] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 4703.183586] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 4703.217742] Lustre: lustre-MDT0000: new disk, initializing [ 4703.239365] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4703.245235] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 4704.428309] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 4708.226067] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4708.322376] Lustre: lustre-OST0000: new disk, initializing [ 4708.324187] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 4708.325793] Lustre: Skipped 1 previous similar message [ 4708.346352] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4710.033141] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 4711.102826] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 4711.107588] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 4711.114954] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 4941.252742] Lustre: server umount lustre-MDT0000 complete [ 4942.911777] LustreError: 297859:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1772172215 with bad export cookie 17364551831498596240 [ 4942.918684] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4952.101966] Lustre: server umount lustre-OST0000 complete [ 4961.862833] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_hostid [ 4965.183258] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 4977.428130] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4977.509461] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 4977.519281] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 4977.551838] Lustre: lustre-MDT0000: new disk, initializing [ 4977.574524] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4977.580897] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 4978.843310] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 4982.844073] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4982.878229] Lustre: 302855:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 4982.897493] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 4982.899013] Lustre: Skipped 1 previous similar message [ 4982.929088] Lustre: lustre-MDT0001: new disk, initializing [ 4982.958917] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4982.970478] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 4982.974566] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 4984.145465] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 4987.306364] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4988.562462] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4990.814319] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4990.910045] Lustre: lustre-OST0000: new disk, initializing [ 4990.911911] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 4990.938514] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4991.027627] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 4991.030721] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 4991.064372] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 4992.828667] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 4995.980093] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4997.510605] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 4997.589730] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 4998.975990] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 4999.046267] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 5001.187760] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5001.187961] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 5001.189209] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5001.192352] Lustre: Skipped 1 previous similar message [ 5001.195799] LustreError: Skipped 1 previous similar message [ 5005.909288] Lustre: server umount lustre-OST0000 complete [ 5008.864652] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5008.867156] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5008.870765] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5008.873532] Lustre: Skipped 1 previous similar message [ 5011.425073] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5011.425554] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5013.269115] Lustre: server umount lustre-MDT0000 complete [ 5014.479146] LustreError: 303632:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1772172287 with bad export cookie 17364551831501537017 [ 5014.482024] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5014.483021] LustreError: 303632:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 5014.595335] Lustre: server umount lustre-MDT0001 complete [ 5015.718402] Lustre: DEBUG MARKER: SKIP: conf-sanity test_111 skipping SLOW test 111 [ 5016.272402] Lustre: DEBUG MARKER: == conf-sanity test 112a: mount OST with no_create option ========================================================== 01:04:49 (1772172289) [ 5018.523493] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5018.718884] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5020.008807] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 5022.761826] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5024.024237] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 5025.667175] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5026.786978] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 5028.910442] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5030.677754] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 5032.418485] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5034.766254] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5034.824922] Lustre: lustre-OST0001: new disk, initializing [ 5034.826686] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 5034.857511] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 5034.859467] Lustre: Skipped 2 previous similar messages [ 5036.816601] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 5040.481859] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 5040.553233] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 5041.662926] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 5041.665786] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 5041.682080] LustreError: 310126:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 5041.731499] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff89b7a067a000.ost_server_uuid 50 [ 5042.181035] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff89b7a067a000.ost_server_uuid in FULL state after 0 sec [ 5042.724466] LustreError: 310126:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 5042.727790] LustreError: 310126:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) Skipped 2 previous similar messages [ 5043.437855] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff89b7a067a000.ost_server_uuid 50 [ 5043.748180] LustreError: 310126:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 5043.751930] LustreError: 310126:0:(osp_precreate.c:969:osp_precreate_cleanup_orphans()) Skipped 1 previous similar message [ 5043.941164] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-ffff89b7a067a000.ost_server_uuid in FULL state after 0 sec [ 5044.779133] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 5056.995175] Lustre: lustre-OST0001-osc-MDT0001: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5056.998370] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 5056.999439] Lustre: Skipped 1 previous similar message [ 5057.001890] Lustre: Skipped 1 previous similar message [ 5061.761494] Lustre: server umount lustre-OST0001 complete [ 5062.117528] LustreError: 308352:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5062.124264] LustreError: 308352:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 5066.209153] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 5066.212232] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5066.217411] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5066.220038] Lustre: Skipped 1 previous similar message [ 5067.235779] LustreError: 308539:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5067.241392] LustreError: 308539:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 5069.657840] Lustre: server umount lustre-OST0000 complete [ 5077.367499] Lustre: server umount lustre-MDT0000 complete [ 5077.474522] LustreError: 308239:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5077.481186] LustreError: 308239:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 5078.887183] LustreError: 309256:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1772172351 with bad export cookie 17364551831501537885 [ 5078.890115] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5078.891094] LustreError: 309256:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 5079.014278] Lustre: server umount lustre-MDT0001 complete [ 5083.116332] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing unload_modules_local [ 5084.265392] Key type lgssc unregistered [ 5084.401508] LNet: 311695:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5084.404837] LNetError: 311695:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5084.411297] LNet: Removed LNI 192.168.203.127@tcp [ 5084.757386] Key type .llcrypt unregistered [ 5084.759167] Key type ._llcrypt unregistered [ 5095.288096] Key type ._llcrypt registered [ 5095.289513] Key type .llcrypt registered [ 5095.333028] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 5095.729982] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5095.759942] alg: No test for adler32 (adler32-zlib) [ 5096.620063] Lustre: Lustre: Build Version: 2.17.50_152_g82f9dcf [ 5096.711555] LNet: Added LNI 192.168.203.127@tcp [8/256/0/180] [ 5098.304159] Key type lgssc registered [ 5098.720279] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5101.783965] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5101.795936] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5103.015194] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5104.556905] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 5106.821759] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5109.589944] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5109.748337] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5111.368635] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 5115.398989] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5115.540102] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5117.958923] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 5119.654467] LustreError: 314625:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5119.661424] LustreError: 314625:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 5120.347616] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5123.355705] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5123.455232] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 5125.703147] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 5127.275731] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:65) [ 5127.281459] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:33) [ 5127.973342] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 5130.871852] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing wait_import_state (FULL|IDLE) os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [ 5130.975759] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 5214.700900] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5214.702094] LustreError: lustre-OST0001-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 5214.711517] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 5214.719457] Lustre: Skipped 1 previous similar message [ 5218.630184] Lustre: server umount lustre-OST0001 complete [ 5219.811847] LustreError: 314626:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5219.819818] LustreError: 314626:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 5222.371751] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 5222.378861] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5222.386873] Lustre: Skipped 1 previous similar message [ 5222.390221] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5224.935148] LustreError: 314626:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5224.935337] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5224.938132] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 5224.938178] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5224.944570] LustreError: 314626:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 5224.974699] Lustre: Skipped 1 previous similar message [ 5230.052490] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5230.053508] LustreError: 316020:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5230.054768] Lustre: Skipped 1 previous similar message [ 5230.062827] LustreError: 316020:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 5235.168741] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 5235.185204] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5235.187422] LustreError: 314625:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5235.191295] Lustre: Skipped 1 previous similar message [ 5235.205913] LustreError: 314625:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 5235.314537] Lustre: server umount lustre-OST0000 complete [ 5237.729487] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5237.732947] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5243.232091] Lustre: server umount lustre-MDT0000 complete [ 5244.789175] LustreError: 313055:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1772172517 with bad export cookie 9986458227247364986 [ 5244.792523] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5244.796392] LustreError: 313055:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 5244.942944] Lustre: server umount lustre-MDT0001 complete [ 5249.174582] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing unload_modules_local [ 5250.369980] Key type lgssc unregistered [ 5250.501528] LNet: 317632:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5250.505396] LNetError: 317632:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5250.515496] LNet: Removed LNI 192.168.203.127@tcp [ 5250.835810] Key type .llcrypt unregistered [ 5250.837352] Key type ._llcrypt unregistered [ 5270.286992] Key type ._llcrypt registered [ 5270.288329] Key type .llcrypt registered [ 5270.330457] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 5270.715419] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5270.760907] alg: No test for adler32 (adler32-zlib) [ 5271.633923] Lustre: Lustre: Build Version: 2.17.50_152_g82f9dcf [ 5271.733597] LNet: Added LNI 192.168.203.127@tcp [8/256/0/180] [ 5273.320175] Key type lgssc registered [ 5273.719231] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5277.145524] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5277.153327] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5278.334935] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5279.748491] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 5282.911139] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5283.053631] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5284.431275] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 5285.491784] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 5287.827054] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5287.960570] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5288.997458] LustreError: 321513:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5289.004670] LustreError: 321513:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 5289.005738] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:97) [ 5289.966162] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 5292.069621] LustreError: 321335:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5292.075887] LustreError: 321335:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 5292.997099] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5293.101209] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 5294.524789] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:65) [ 5295.223334] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 5299.539738] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 5303.335626] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 5313.508146] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5313.509427] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5313.514648] Lustre: Skipped 2 previous similar messages [ 5313.517633] Lustre: Skipped 1 previous similar message [ 5318.366136] Lustre: server umount lustre-MDT0000 complete [ 5318.627755] LustreError: 320606:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5318.634032] LustreError: 320606:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 3 previous similar messages [ 5319.638165] LustreError: 319860:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1772172592 with bad export cookie 11274083762217533005 [ 5319.640486] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5319.643044] LustreError: 319860:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 5319.764055] Lustre: server umount lustre-MDT0001 complete [ 5331.975935] Lustre: server umount lustre-OST0000 complete [ 5343.728677] Lustre: server umount lustre-OST0001 complete [ 5349.634876] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 5353.380157] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5353.529260] LustreError: 325063:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5353.551377] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5354.965322] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 5358.094724] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5359.660852] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 5360.718205] Lustre: 326169:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 5363.133649] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5363.284805] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5363.287333] Lustre: Skipped 1 previous similar message [ 5364.326299] LustreError: 326523:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5364.332949] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:129) [ 5365.325154] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 5368.399923] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5369.780910] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:97) [ 5370.512241] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 5373.905520] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 5375.238745] Lustre: 328013:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 5384.162823] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5384.162832] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5384.173196] Lustre: Skipped 1 previous similar message [ 5384.175674] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5384.178349] Lustre: Skipped 5 previous similar messages [ 5387.489677] Lustre: server umount lustre-MDT0000 complete [ 5388.831394] LustreError: 328017:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1772172661 with bad export cookie 11274083762217534664 [ 5388.832415] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5388.836114] LustreError: 328017:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 5388.953517] Lustre: server umount lustre-MDT0001 complete [ 5400.657594] Lustre: server umount lustre-OST0000 complete [ 5413.130706] Lustre: server umount lustre-OST0001 complete [ 5417.338243] Lustre: DEBUG MARKER: SKIP: conf-sanity test_114 skipping SLOW test 114 [ 5418.893299] Lustre: DEBUG MARKER: SKIP: conf-sanity test_115 skipping excluded test 115 [ 5420.416794] Lustre: DEBUG MARKER: == conf-sanity test 116: big size MDT support ============ 01:11:32 (1772172692) [ 5438.541945] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 5444.896061] loop0: detected capacity change from 0 to 1099511627776 [ 5445.307158] SGI XFS with ACLs, security attributes, quota, no debug enabled [ 5445.313996] *** VALIDATE xfs *** [ 5445.320666] XFS (loop0): Mounting V5 Filesystem [ 5445.336597] XFS (loop0): Ending clean mount [ 5446.168305] loop1: detected capacity change from 0 to 18691697672192 [ 5455.343953] hrtimer: interrupt took 4124075 ns [ 5514.420790] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_hostid [ 5521.791680] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 5548.951736] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5549.124698] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 5549.151708] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 5549.215830] Lustre: lustre-MDT0000: new disk, initializing [ 5549.272189] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5549.280236] Lustre: Skipped 1 previous similar message [ 5549.291946] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 5552.655058] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 5560.990184] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5561.104773] Lustre: 333092:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 5561.151499] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 5561.156692] Lustre: Skipped 1 previous similar message [ 5561.212480] Lustre: lustre-MDT0001: new disk, initializing [ 5561.360909] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 5561.373302] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 5564.561911] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 5571.202408] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5574.244777] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 5579.607017] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5579.797250] Lustre: lustre-OST0000: new disk, initializing [ 5579.800267] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 5581.685106] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 5581.699626] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 5581.784924] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 5583.773422] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 5589.457298] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5592.775900] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 5592.959902] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 5595.953281] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 5596.080351] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 5602.284771] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5602.286184] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 5602.292794] Lustre: Skipped 3 previous similar messages [ 5602.296401] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5602.305275] Lustre: Skipped 1 previous similar message [ 5603.754516] Lustre: server umount lustre-OST0000 complete [ 5607.395213] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5607.399450] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5607.405325] LustreError: Skipped 1 previous similar message [ 5607.406471] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5607.414237] Lustre: Skipped 2 previous similar messages [ 5612.525359] LustreError: 333103:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5612.533401] LustreError: 333103:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 5612.583107] Lustre: server umount lustre-MDT0000 complete [ 5614.982100] LustreError: 333084:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1772172887 with bad export cookie 11274083762217536218 [ 5614.983382] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5614.991236] LustreError: 333084:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 5615.190746] Lustre: server umount lustre-MDT0001 complete [ 5620.924058] XFS (loop0): Unmounting Filesystem [ 5624.432333] Lustre: DEBUG MARKER: == conf-sanity test 117: lctl get_param return errors properly ========================================================== 01:14:57 (1772172897) [ 5629.412914] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5629.744730] LustreError: 337243:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5629.763169] LustreError: 337243:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 5629.805728] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5629.809048] Lustre: Skipped 2 previous similar messages [ 5632.669688] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 5638.835262] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5642.155209] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 5646.489867] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5649.494786] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 5655.564507] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5660.083277] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 5664.344560] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5690.857848] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 5690.857940] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5690.863628] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5690.863638] Lustre: Skipped 1 previous similar message [ 5690.876534] LustreError: Skipped 1 previous similar message [ 5690.907191] Lustre: Skipped 1 previous similar message [ 5693.546681] Lustre: server umount lustre-OST0000 complete [ 5700.578766] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5700.596301] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5700.617606] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5700.620562] Lustre: Skipped 1 previous similar message [ 5702.960785] Lustre: server umount lustre-MDT0000 complete [ 5705.854551] LustreError: 339804:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1772172978 with bad export cookie 11274083762217537100 [ 5705.861426] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5705.867041] LustreError: 339804:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 5706.232794] Lustre: server umount lustre-MDT0001 complete [ 5714.819712] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing unload_modules_local [ 5716.711288] Key type lgssc unregistered [ 5716.918882] LNet: 340538:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5716.925327] LNetError: 340538:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5716.935887] LNet: Removed LNI 192.168.203.127@tcp [ 5717.497158] Key type .llcrypt unregistered [ 5717.502198] Key type ._llcrypt unregistered [ 5736.767194] Key type ._llcrypt registered [ 5736.769681] Key type .llcrypt registered [ 5736.854671] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 5737.633203] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5737.689091] alg: No test for adler32 (adler32-zlib) [ 5738.693960] Lustre: Lustre: Build Version: 2.17.50_152_g82f9dcf [ 5738.874225] LNet: Added LNI 192.168.203.127@tcp [8/256/0/180] [ 5740.513094] Key type lgssc registered [ 5741.274262] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5746.549707] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5746.560151] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5747.858042] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5750.610760] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 5756.318500] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5756.552427] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5759.023121] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 5762.302478] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5764.218584] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 5767.964548] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5768.165535] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5771.390351] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 5774.693227] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5788.641495] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [ 5788.646749] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5788.654421] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 5791.384759] Lustre: lustre-MDT0001: Not available for connect from 192.168.203.27@tcp (stopping) [ 5791.714917] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5794.537982] Lustre: server umount lustre-MDT0001 complete [ 5796.494475] LustreError: 342061:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.203.27@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5796.503726] LustreError: 342061:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 5799.622117] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5799.668243] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [ 5799.670978] Lustre: Found index 1 for lustre-MDT0001, updating log [ 5799.684893] Lustre: 342054:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 5799.843214] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5801.765411] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 5805.036659] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 5809.646471] LustreError: 345496:0:(obd_mount.c:212:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [ 5809.653466] LustreError: 345496:0:(tgt_mount.c:669:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [ 5809.659961] LustreError: 342058:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [ 5809.689973] LustreError: 345499:0:(obd_config.c:2136:class_config_llog_handler()) MGC192.168.203.127@tcp: cfg command failed: rc = -17 [ 5809.696465] Lustre: cmd=cf001 0:lustre-MDT0001-osp-MDT0000 1:osp 2:lustre-MDT0000-mdtlov_UUID [ 5809.696465] [ 6107.107751] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6107.108702] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [ 6107.112204] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 6107.116045] Lustre: Skipped 3 previous similar messages [ 6112.226234] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 6112.228121] Lustre: Skipped 2 previous similar messages [ 6117.345781] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 6117.347789] Lustre: Skipped 2 previous similar messages [ 6118.368105] Lustre: lustre-MDT0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 6118.421880] Lustre: server umount lustre-MDT0001 complete [ 6119.052084] LustreError: 343248:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.203.27@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6119.058416] LustreError: 343248:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 2 previous similar messages [ 6121.478997] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6121.509898] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [ 6121.511586] Lustre: Found index 1 for lustre-MDT0001, updating log [ 6121.523426] Lustre: 342054:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 6121.626387] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6122.842954] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 6127.082017] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 6129.128468] LustreError: 357715:0:(obd_mount.c:212:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [ 6129.130694] LustreError: 357715:0:(tgt_mount.c:669:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [ 6129.133063] LustreError: 342058:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [ 6129.134687] LustreError: 342058:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [ 6129.149978] LustreError: 357718:0:(obd_config.c:797:class_setup()) Device 8 already setup (type osp) [ 6129.153467] LustreError: 357718:0:(obd_config.c:902:class_detach()) OBD device 8 still set up [ 6129.156277] LustreError: 357718:0:(obd_config.c:2136:class_config_llog_handler()) MGC192.168.203.127@tcp: cfg command failed: rc = -17 [ 6129.159571] Lustre: cmd=cf003 0:lustre-MDT0001-osp-MDT0000 1:lustre-MDT0001_UUID 2:192.168.203.127@tcp [ 6129.159571] [ 6426.259655] Lustre: lustre-MDT0001: Not available for connect from 192.168.203.27@tcp (stopping) [ 6429.157102] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [ 6429.157642] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6429.163642] Lustre: Skipped 1 previous similar message [ 6432.021928] Lustre: server umount lustre-MDT0001 complete [ 6434.273212] LustreError: 342067:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6434.277477] LustreError: 342067:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 1 previous similar message [ 6435.462312] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6435.496417] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [ 6435.498419] Lustre: Found index 1 for lustre-MDT0001, updating log [ 6435.511324] Lustre: 342056:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 6435.636288] Lustre: lustre-MDT0001: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [ 6437.046679] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 6440.937191] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 6445.030270] LustreError: 370485:0:(obd_mount.c:212:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [ 6445.033037] LustreError: 370485:0:(tgt_mount.c:669:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [ 6445.036794] LustreError: 342058:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [ 6445.038993] LustreError: 342058:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [ 6445.057510] LustreError: 370494:0:(lod_lov.c:212:lod_add_device()) lustre-MDT0001-osp-MDT0000: cannot connect to next dev lustre-MDT0001_UUID (-114) [ 6445.063330] LustreError: 370494:0:(obd_config.c:2136:class_config_llog_handler()) MGC192.168.203.127@tcp: cfg command failed: rc = -114 [ 6445.067497] Lustre: cmd=cf014 0:lustre-MDT0000-mdtlov 1:lustre-MDT0001_UUID 2:1 3:1 [ 6445.067497] [ 6753.251106] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6753.251291] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 6753.252505] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6753.252513] Lustre: Skipped 4 previous similar messages [ 6753.256600] Lustre: Skipped 3 previous similar messages [ 6756.952215] Lustre: server umount lustre-MDT0000 complete [ 6758.170226] LustreError: 344934:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1772174031 with bad export cookie 960253814973023427 [ 6758.175306] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6758.368823] LustreError: 344235:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6763.488748] LustreError: 342062:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6764.332422] Lustre: server umount lustre-MDT0001 complete [ 6765.602155] Lustre: server umount lustre-OST0000 complete [ 6768.514708] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_hostid [ 6771.581547] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 6783.279896] Lustre: DEBUG MARKER: == conf-sanity test 120: cross-target rename should not create bad symlinks ========================================================== 01:34:16 (1772174056) [ 6785.459042] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6785.541669] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 6785.552457] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 6785.590888] Lustre: lustre-MDT0000: new disk, initializing [ 6785.613672] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6785.621599] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 6786.934335] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 6790.978714] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6791.016935] Lustre: 384896:0:(mgs_llog.c:1348:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 6791.039409] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 6791.040937] Lustre: Skipped 1 previous similar message [ 6791.071274] Lustre: lustre-MDT0001: new disk, initializing [ 6791.102612] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6791.114328] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 6791.118214] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 6792.356162] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 6795.387239] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 6796.563538] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 6798.717346] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6798.826396] Lustre: lustre-OST0000: new disk, initializing [ 6798.828232] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 6798.859167] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6799.267305] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 6799.272229] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 6799.302074] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 6800.624822] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug -1 all [ 6803.719391] Lustre: DEBUG MARKER: oleg327-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 6806.496863] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 6806.499038] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6806.502266] Lustre: Skipped 1 previous similar message [ 6806.504322] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6806.505881] Lustre: Skipped 3 previous similar messages [ 6812.317580] Lustre: server umount lustre-MDT0000 complete [ 6813.540102] LustreError: 384886:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1772174086 with bad export cookie 960253814973025380 [ 6813.542593] LustreError: 385686:0:(osp_object.c:617:osp_attr_get()) lustre-MDT0000-osp-MDT0001: osp_attr_get update error [0x200000401:0x2:0x0]: rc = -5 [ 6813.543861] LustreError: MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6813.544606] LustreError: 384886:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 8 previous similar messages [ 6813.669505] Lustre: server umount lustre-MDT0001 complete [ 6824.167773] Lustre: server umount lustre-OST0000 complete [ 6833.397752] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing set_hostid [ 6836.792543] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local [ 6847.563917] Lustre: DEBUG MARKER: == conf-sanity test complete, duration 6711 sec ========== 01:35:20 (1772174120) [ 6848.172779] Lustre: DEBUG MARKER: === conf-sanity: start cleanup 01:35:21 (1772174121) === [ 6849.316974] Lustre: DEBUG MARKER: === conf-sanity: finish cleanup 01:35:22 (1772174122) === [ 6863.251501] Lustre: DEBUG MARKER: oleg327-server.virtnet: executing unload_modules_local [ 6864.363248] Key type lgssc unregistered [ 6864.495387] LNet: 392829:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6864.499423] LNetError: 392829:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6864.510355] LNet: Removed LNI 192.168.203.127@tcp [ 6864.848133] Key type .llcrypt unregistered [ 6864.849289] Key type ._llcrypt unregistered