[ 0.000000] Linux version 4.18.0rh8.10-debug (green@maintenance) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-26) (GCC)) #2 SMP Mon Jul 14 01:24:22 EDT 2025 [ 0.000000] Command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffcdfff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffce000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x0000000146dfffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.8 present. [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 [ 0.000000] Hypervisor detected: KVM [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 511074258 cycles [ 0.000000] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns [ 0.000000] tsc: Detected 2399.998 MHz processor [ 0.000000] last_pfn = 0x146e00 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0xbffce max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000f54b0-0x000f54bf] [ 0.000000] RAMDISK: [mem 0xbcc54000-0xbffbffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F52D0 000014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 0x00000000BFFE247C 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 0x00000000BFFE2318 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 0x00000000BFFE0040 0022D8 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 0x00000000BFFE0000 000040 [ 0.000000] ACPI: APIC 0x00000000BFFE238C 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: HPET 0x00000000BFFE241C 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: WAET 0x00000000BFFE2454 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0xbffe2318-0xbffe238b] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe2317] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0xbffe238c-0xbffe241b] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0xbffe241c-0xbffe2453] [ 0.000000] ACPI: Reserving WAET table memory at [mem 0xbffe2454-0xbffe247b] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x0000000146dfffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x1465a3000-0x1465cdfff] [ 0.000000] Reserving 256MB of memory at 2752MB for crashkernel (System RAM: 4205MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009efff] [ 0.000000] node 0: [mem 0x0000000000100000-0x00000000bffcdfff] [ 0.000000] node 0: [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Zeroed struct page in unavailable ranges: 4756 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x0000000146dfffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] TSC deadline timer available [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] kvm-guest: KVM setup pv remote TLB flush [ 0.000000] kvm-guest: setup PV sched yield [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbffce000-0xbfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.000000] [mem 0xc0000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u524288 [ 0.000000] kvm-guest: PV spinlocks enabled [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1059606 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] audit: disabled (until reboot) [ 0.000000] software IO TLB: area num 4. [ 0.000000] Memory: 2829652K/4306352K available (18435K kernel code, 11221K rwdata, 7248K rodata, 2908K init, 18040K bss, 524580K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] ftrace: allocating 41240 entries in 162 pages [ 0.000000] ftrace: allocated 162 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU event tracing is enabled. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=4. [ 0.000000] rcu: RCU callback double-/use-after-free debug enabled. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 [ 0.000000] NR_IRQS: 524544, nr_irqs: 456, preallocated irqs: 16 [ 0.000000] random: get_random_bytes called from start_kernel+0x622/0x9a8 with crng_init=0 [ 0.001000] Console: colour *CGA 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns [ 0.001014] APIC: Switch to symmetric I/O mode setup [ 0.003225] x2apic enabled [ 0.004009] Switched APIC routing to physical x2apic. [ 0.005013] kvm-guest: setup PV IPIs [ 0.008000] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.008000] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 0.008025] Calibrating delay loop (skipped) preset value.. 4799.99 BogoMIPS (lpj=2399998) [ 0.009013] pid_max: default: 32768 minimum: 301 [ 0.010125] LSM: Security Framework initializing [ 0.011061] Yama: becoming mindful. [ 0.013011] SELinux: Initializing. [ 0.014072] *** VALIDATE selinux *** [ 0.023120] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, vmalloc) [ 0.027788] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc) [ 0.029148] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.030115] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.031109] *** VALIDATE tmpfs *** [ 0.032525] *** VALIDATE proc *** [ 0.034170] *** VALIDATE cgroup *** [ 0.035010] *** VALIDATE cgroup2 *** [ 0.036259] x86/cpu: User Mode Instruction Prevention (UMIP) activated [ 0.038139] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.039036] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 [ 0.040032] Spectre V2 : User space: Vulnerable [ 0.041011] Speculative Store Bypass: Vulnerable [ 0.043847] debug: unmapping init [mem 0xffffffffbb259000-0xffffffffbb260fff] [ 0.046345] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (family: 0x6, model: 0x3e, stepping: 0x4) [ 0.048437] Performance Events: IvyBridge events, full-width counters, Intel PMU driver. [ 0.049028] ... version: 2 [ 0.050013] ... bit width: 48 [ 0.051014] ... generic registers: 4 [ 0.052014] ... value mask: 0000ffffffffffff [ 0.053019] ... max period: 00007fffffffffff [ 0.054016] ... fixed-purpose events: 3 [ 0.055017] ... event mask: 000000070000000f [ 0.056304] rcu: Hierarchical SRCU implementation. [ 0.058523] smp: Bringing up secondary CPUs ... [ 0.059615] x86: Booting SMP configuration: [ 0.060028] .... node #0, CPUs: #1 #2 #3 [ 0.064300] smp: Brought up 1 node, 4 CPUs [ 0.066016] smpboot: Max logical packages: 1 [ 0.067013] smpboot: Total of 4 processors activated (19199.98 BogoMIPS) [ 0.143832] node 0 deferred pages initialised in 75ms [ 0.148116] devtmpfs: initialized [ 0.149307] x86/mm: Memory block size: 128MB [ 0.152557] gcov: version magic: 0x41383552 [ 0.154378] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.158086] futex hash table entries: 1024 (order: 4, 65536 bytes, vmalloc) [ 0.160350] pinctrl core: initialized pinctrl subsystem [ 0.163264] [ 0.163866] ************************************************************* [ 0.166015] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.168011] ** ** [ 0.170014] ** IOMMU DebugFS SUPPORT HAS BEEN ENABLED IN THIS KERNEL ** [ 0.173015] ** ** [ 0.175011] ** This means that this kernel is built to expose internal ** [ 0.177013] ** IOMMU data structures, which may compromise security on ** [ 0.180012] ** your system. ** [ 0.182013] ** ** [ 0.184014] ** If you see this message and you are not debugging the ** [ 0.187015] ** kernel, report this immediately to your vendor! ** [ 0.189013] ** ** [ 0.191014] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.194016] ************************************************************* [ 0.197902] NET: Registered protocol family 16 [ 0.199510] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations [ 0.202065] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.205065] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.208389] cpuidle: using governor menu [ 0.211034] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.213649] PCI: Using configuration type 1 for base access [ 0.216128] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.226119] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.227049] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.230781] cryptd: max_cpu_qlen set to 1000 [ 0.233313] ACPI: Added _OSI(Module Device) [ 0.235019] ACPI: Added _OSI(Processor Device) [ 0.237014] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.238015] ACPI: Added _OSI(Processor Aggregator Device) [ 0.243323] ACPI: 1 ACPI AML tables successfully acquired and loaded [ 0.249342] ACPI: Interpreter enabled [ 0.250000] ACPI: PM: (supports S0 S3 S4 S5) [ 0.253025] ACPI: Using IOAPIC for interrupt routing [ 0.255118] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.258426] ACPI: Enabled 2 GPEs in block 00 to 0F [ 0.268612] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.271040] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3] [ 0.273018] acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI] [ 0.276112] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.283689] acpiphp: Slot [2] registered [ 0.286139] acpiphp: Slot [5] registered [ 0.287126] acpiphp: Slot [6] registered [ 0.289161] acpiphp: Slot [7] registered [ 0.291093] acpiphp: Slot [8] registered [ 0.293129] acpiphp: Slot [9] registered [ 0.294120] acpiphp: Slot [10] registered [ 0.296141] acpiphp: Slot [3] registered [ 0.297099] acpiphp: Slot [4] registered [ 0.301098] acpiphp: Slot [11] registered [ 0.303111] acpiphp: Slot [12] registered [ 0.304190] acpiphp: Slot [13] registered [ 0.306154] acpiphp: Slot [14] registered [ 0.307111] acpiphp: Slot [15] registered [ 0.309119] acpiphp: Slot [16] registered [ 0.311113] acpiphp: Slot [17] registered [ 0.312131] acpiphp: Slot [18] registered [ 0.313116] acpiphp: Slot [19] registered [ 0.315178] acpiphp: Slot [20] registered [ 0.317115] acpiphp: Slot [21] registered [ 0.318119] acpiphp: Slot [22] registered [ 0.320240] acpiphp: Slot [23] registered [ 0.321125] acpiphp: Slot [24] registered [ 0.323113] acpiphp: Slot [25] registered [ 0.324195] acpiphp: Slot [26] registered [ 0.327402] acpiphp: Slot [27] registered [ 0.329235] acpiphp: Slot [28] registered [ 0.331405] acpiphp: Slot [29] registered [ 0.334324] acpiphp: Slot [30] registered [ 0.337266] acpiphp: Slot [31] registered [ 0.338231] PCI host bridge to bus 0000:00 [ 0.342078] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.344029] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.347026] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.349024] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 0.352089] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] [ 0.354030] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.356272] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.359039] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.362338] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 0.372908] pci 0000:00:01.1: reg 0x20: [io 0xc320-0xc32f] [ 0.378045] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.380020] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.383018] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.388023] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.390417] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 0.392485] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 0.395058] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 0.398217] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 [ 0.404028] pci 0000:00:02.0: reg 0x10: [io 0xc300-0xc31f] [ 0.415029] pci 0000:00:02.0: reg 0x20: [mem 0xe0000000000-0xe0000003fff 64bit pref] [ 0.418900] pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 0.426537] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 [ 0.438016] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] [ 0.445016] pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] [ 0.466023] pci 0000:00:05.0: reg 0x20: [mem 0xe0000004000-0xe0000007fff 64bit pref] [ 0.479296] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 [ 0.487024] pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] [ 0.495024] pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 0.524028] pci 0000:00:06.0: reg 0x20: [mem 0xe0000008000-0xe000000bfff 64bit pref] [ 0.534811] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 [ 0.541016] pci 0000:00:07.0: reg 0x10: [io 0xc100-0xc17f] [ 0.547015] pci 0000:00:07.0: reg 0x14: [mem 0xfebc2000-0xfebc2fff] [ 0.557014] pci 0000:00:07.0: reg 0x20: [mem 0xe000000c000-0xe000000ffff 64bit pref] [ 0.564580] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 [ 0.569017] pci 0000:00:08.0: reg 0x10: [io 0xc180-0xc1ff] [ 0.572016] pci 0000:00:08.0: reg 0x14: [mem 0xfebc3000-0xfebc3fff] [ 0.582015] pci 0000:00:08.0: reg 0x20: [mem 0xe0000010000-0xe0000013fff 64bit pref] [ 0.591118] pci 0000:00:09.0: [1af4:1001] type 00 class 0x010000 [ 0.597026] pci 0000:00:09.0: reg 0x10: [io 0xc200-0xc27f] [ 0.604024] pci 0000:00:09.0: reg 0x14: [mem 0xfebc4000-0xfebc4fff] [ 0.622030] pci 0000:00:09.0: reg 0x20: [mem 0xe0000014000-0xe0000017fff 64bit pref] [ 0.637964] pci 0000:00:0a.0: [1af4:1001] type 00 class 0x010000 [ 0.644020] pci 0000:00:0a.0: reg 0x10: [io 0xc280-0xc2ff] [ 0.648018] pci 0000:00:0a.0: reg 0x14: [mem 0xfebc5000-0xfebc5fff] [ 0.661014] pci 0000:00:0a.0: reg 0x20: [mem 0xe0000018000-0xe000001bfff 64bit pref] [ 0.669791] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 [ 0.672573] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 0.675376] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 [ 0.676332] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 0.678222] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 [ 0.683138] iommu: Default domain type: Passthrough [ 0.685604] SCSI subsystem initialized [ 0.687255] ACPI: bus type USB registered [ 0.689144] usbcore: registered new interface driver usbfs [ 0.691158] usbcore: registered new interface driver hub [ 0.693168] usbcore: registered new device driver usb [ 0.696225] pps_core: LinuxPPS API ver. 1 registered [ 0.698016] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 0.701091] PTP clock support registered [ 0.704036] EDAC MC: Ver: 3.0.0 [ 0.706099] PCI: Using ACPI for IRQ routing [ 0.707638] NetLabel: Initializing [ 0.709016] NetLabel: domain hash size = 128 [ 0.710025] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 0.712087] NetLabel: unlabeled traffic allowed by default [ 0.715005] vgaarb: loaded [ 0.716349] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 0.717016] hpet0: 3 comparators, 64-bit 100.000000 MHz counter [ 0.722000] clocksource: Switched to clocksource kvm-clock [ 0.841458] VFS: Disk quotas dquot_6.6.0 [ 0.842549] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 0.844099] *** VALIDATE ramfs *** [ 0.844782] *** VALIDATE hugetlbfs *** [ 0.846168] pnp: PnP ACPI init [ 0.847724] pnp: PnP ACPI: found 6 devices [ 0.865684] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 0.869059] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 0.871264] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 0.873547] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 0.876210] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 0.878914] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] [ 0.881651] NET: Registered protocol family 2 [ 0.884086] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, vmalloc) [ 0.888545] tcp_listen_portaddr_hash hash table entries: 4096 (order: 5, 163840 bytes, vmalloc) [ 0.892142] TCP established hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.897372] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc) [ 0.901039] TCP: Hash tables configured (established 65536 bind 65536) [ 0.904173] MPTCP token hash table entries: 8192 (order: 6, 393216 bytes, vmalloc) [ 0.907369] UDP hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.910176] UDP-Lite hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.912197] NET: Registered protocol family 1 [ 0.915034] RPC: Registered named UNIX socket transport module. [ 0.916615] RPC: Registered udp transport module. [ 0.918248] RPC: Registered tcp transport module. [ 0.919539] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 0.921775] NET: Registered protocol family 44 [ 0.923336] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 0.925351] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 0.927295] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 0.929595] PCI: CLS 0 bytes, default 64 [ 0.931333] Unpacking initramfs... [ 2.317802] debug: unmapping init [mem 0xffff95f33cc54000-0xffff95f33ffbffff] [ 2.323148] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 2.325328] software IO TLB: mapped [mem 0x00000000a8000000-0x00000000ac000000] (64MB) [ 2.327757] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 2.834481] Initialise system trusted keyrings [ 2.835908] Key type blacklist registered [ 2.837663] workingset: timestamp_bits=36 max_order=20 bucket_order=0 [ 2.847317] zbud: loaded [ 2.850425] *** VALIDATE nfs *** [ 2.851789] *** VALIDATE nfs4 *** [ 2.853175] pstore: using deflate compression [ 2.857207] Platform Keyring initialized [ 2.956307] NET: Registered protocol family 38 [ 2.958257] Key type asymmetric registered [ 2.959454] Asymmetric key parser 'x509' registered [ 2.960540] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 2.962747] io scheduler mq-deadline registered [ 2.963745] io scheduler kyber registered [ 2.964898] io scheduler bfq registered [ 2.966257] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 2.968114] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 2.972155] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 2.975345] ACPI: Power Button [PWRF] [ 2.979781] ACPI: \_SB_.LNKB: Enabled at IRQ 10 [ 2.987328] ACPI: \_SB_.LNKA: Enabled at IRQ 11 [ 3.004790] ACPI: \_SB_.LNKC: Enabled at IRQ 11 [ 3.011467] ACPI: \_SB_.LNKD: Enabled at IRQ 10 [ 3.025189] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 3.054850] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.081743] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.085881] Non-volatile memory driver v1.3 [ 3.087110] Linux agpgart interface v0.103 [ 3.118855] virtio_blk virtio1: [vda] 149760 512-byte logical blocks (76.7 MB/73.1 MiB) [ 3.122420] vda: detected capacity change from 0 to 76677120 [ 3.139608] virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) [ 3.141806] vdb: detected capacity change from 0 to 1073741824 [ 3.156409] virtio_blk virtio3: [vdc] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 3.159087] vdc: detected capacity change from 0 to 2621440000 [ 3.172867] virtio_blk virtio4: [vdd] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 3.175539] vdd: detected capacity change from 0 to 2621440000 [ 3.188532] virtio_blk virtio5: [vde] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 3.190985] vde: detected capacity change from 0 to 4294967296 [ 3.206137] virtio_blk virtio6: [vdf] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 3.209199] vdf: detected capacity change from 0 to 4294967296 [ 3.221321] libphy: Fixed MDIO Bus: probed [ 3.227988] usbcore: registered new interface driver usbserial_generic [ 3.231156] usbserial: USB Serial support registered for generic [ 3.232775] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 3.237294] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 3.238995] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 3.241516] mousedev: PS/2 mouse device common for all mice [ 3.246883] rtc_cmos 00:05: RTC can wake from S4 [ 3.248056] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 3.249926] rtc_cmos 00:05: registered as rtc0 [ 3.257272] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 3.259266] intel_pstate: CPU model not supported [ 3.262978] hid: raw HID events driver (C) Jiri Kosina [ 3.265281] usbcore: registered new interface driver usbhid [ 3.267978] usbhid: USB HID core driver [ 3.270223] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 [ 3.273816] drop_monitor: Initializing network drop monitor service [ 3.280191] Initializing XFRM netlink socket [ 3.281718] NET: Registered protocol family 10 [ 3.284299] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 [ 3.284596] Segment Routing with IPv6 [ 3.287885] NET: Registered protocol family 17 [ 3.290075] mpls_gso: MPLS GSO support [ 3.295257] RAS: Correctable Errors collector initialized. [ 3.297231] AVX version of gcm_enc/dec engaged. [ 3.298299] AES CTR mode by8 optimization enabled [ 3.371413] sched_clock: Marking stable (3371363159, 0)->(4311490256, -940127097) [ 3.374597] registered taskstats version 1 [ 3.376468] Loading compiled-in X.509 certificates [ 3.378344] zswap: loaded using pool lzo/zbud [ 3.397983] Key type big_key registered [ 3.409110] Key type encrypted registered [ 3.410283] ima: No TPM chip found, activating TPM-bypass! [ 3.411681] ima: Allocated hash algorithm: sha1 [ 3.412896] ima: No architecture policies found [ 3.414081] evm: Initialising EVM extended attributes: [ 3.415275] evm: security.selinux [ 3.416128] evm: security.ima [ 3.416789] evm: security.capability [ 3.417575] evm: HMAC attrs: 0x1 [ 3.419382] rtc_cmos 00:05: setting system clock to 2026-09-12 02:15:57 UTC (1789179357) [ 3.423933] debug: unmapping init [mem 0xffffffffbc203000-0xffffffffbc3fffff] [ 3.426412] debug: unmapping init [mem 0xffffffffbaf82000-0xffffffffbb258fff] [ 3.433087] Write protecting the kernel read-only data: 28672k [ 3.435280] debug: unmapping init [mem 0xffffffffb9603000-0xffffffffb97fffff] [ 3.437287] debug: unmapping init [mem 0xffffffffb9f14000-0xffffffffb9ffffff] [ 3.467910] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 3.477576] systemd[1]: Detected virtualization kvm. [ 3.479970] systemd[1]: Detected architecture x86-64. [ 3.482301] systemd[1]: Running in initial RAM disk. Welcome to Rocky Linux 8.10 (Green Obsidian) dracut-049-233.git20240115.el8 (Initramfs)! [ 3.508292] systemd[1]: No hostname configured. [ 3.510171] systemd[1]: Set hostname to . [ 3.512733] random: systemd: uninitialized urandom read (16 bytes read) [ 3.515454] systemd[1]: Initializing machine ID from random generator. [ 3.565547] random: ln: uninitialized urandom read (6 bytes read) [ 3.644473] random: systemd: uninitialized urandom read (16 bytes read) [ 3.646981] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 3.649786] systemd[1]: Reached target Local File Systems. [ OK ] Reached target Local File Systems. [ 3.652773] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Reached target Paths. [ OK ] Reached target Swap. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Timers. [ OK ] Reached target Slices. [ OK ] Reached target Initrd Root Device. [ OK ] Listening on udev Kernel Socket. [ OK ] Listening on Journal Socket. Starting Setup Virtual Console... [ OK ] Started Memstrack Anylazing Service. Starting Apply Kernel Variables... Starting Create list of required st…ce nodes for the current kernel... Starting Create Volatile Files and Directories... [ OK ] Listening on Journal Socket (/dev/log). Starting Journal Service... [ OK ] Reached target Sockets. [ OK ] Started Setup Virtual Console. [ OK ] Started Apply Kernel Variables. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Create Volatile Files and Directories. Starting Create Static Device Nodes in /dev... Starting dracut cmdline hook... [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started Journal Service. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ 4.204971] device-mapper: uevent: version 1.0.3 [ 4.206541] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting dracut pre-trigger hook... [ OK ] Started dracut pre-trigger hook. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. [ OK ] Reached target System Initialization. [ OK ] Reached target Basic System. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. Starting dracut initqueue hook... [ 4.886809] virtio_net virtio0 ens2: renamed from eth0 [ 4.913177] random: fast init done [ 5.042855] scsi host0: ata_piix [ 5.063257] scsi host1: ata_piix [ 5.067804] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc320 irq 14 [ 5.070383] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc328 irq 15 [ 9.178383] dracut-initqueue[595]: RTNETLINK answers: File exists [ 9.921614] random: crng init done [ 9.923392] random: 7 urandom warning(s) missed due to ratelimiting Starting nbd nbd0... [ OK ] Started nbd nbd0. [ OK ] Started dracut initqueue hook. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Mounting /sysroot... [ 10.218704] EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Timers. [ OK ] Stopped dracut pre-pivot and cleanup hook. Stopping Hardware RNG Entropy Gatherer Daemon... [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped Hardware RNG Entropy Gatherer Daemon. [ OK ] Stopped target Basic System. [ OK ] Stopped target Sockets. [ OK ] Stopped target Slices. [ OK ] Stopped target Paths. [ OK ] Stopped target System Initialization. [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped dracut pre-trigger hook. [ OK ] Stopped target Swap. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Local Encrypted Volumes. [ OK ] Stopped Dispatch Password Requests to Console Directory Watch. Stopping udev Kernel Device Manager... [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Reached target Switch Root. Starting Switch Root... [ 11.327178] printk: systemd: 26 output lines suppressed due to ratelimiting [ 11.611359] SELinux: Disabled at runtime. [ 11.671523] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 11.680839] systemd[1]: Detected virtualization kvm. [ 11.682853] systemd[1]: Detected architecture x86-64. Welcome to Rocky Linux 8.10 (Green Obsidian)! [ 12.127984] systemd[1]: initrd-switch-root.service: Succeeded. [ 12.131662] systemd[1]: Stopped Switch Root. [ OK ] Stopped Switch Root. [ 12.137153] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. [ 12.141798] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 12.146354] systemd[1]: Stopped Journal Service. [ OK ] Stopped Journal Service. [ 12.153607] systemd[1]: Starting Journal Service... Starting Journal Service... [ 12.168172] systemd[1]: Starting Apply Kernel Variables... Starting Apply Kernel Variables... Starting Remount Root and Kernel File Systems... Starting Create list of required st…ce nodes for the current kernel... [ OK ] Listening on Process Core Dump Socket. Activating swap /dev/disk/by-label/SWAP... [ OK ] Created slice system-serial\x2dgetty.slice. [FAILED] Failed to set up automount Arbitrar…rmats File System Automount Point. See 'systemctl status proc-sys-fs-binfmt_misc.automount' for details. [ OK ] Created slice system-getty.slice. Mounting Kernel Debug File System... [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ 12.256764] Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS [ OK ] Created slice User and Session Slice. [ OK ] Started Dispatch Password Requests to Console Directory Watch. Mounting Huge Pages File System... [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd Root File System. [ OK ] Reached target rpc_pipefs.target. [ OK ] Listening on udev Control Socket. [ OK ] Reached target Slices. [ OK ] Stopped target Initrd File Systems. [ OK ] Created slice system-sshd\x2dkeygen.slice. [ OK ] Listening on udev Kernel Socket. Starting udev Coldplug all Devices... [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Paths. Mounting POSIX Message Queue File System... [ OK ] Started Journal Service. [ OK ] Started Apply Kernel Variables. [FAILED] Failed to start Remount Root and Kernel File Systems. See 'systemctl status systemd-remount-fs.service' for details. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Activated swap /dev/disk/by-label/SWAP. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Reached target Swap. Starting Configure read-only root support... Starting Create Static Device Nodes in /dev... Starting Flush Journal to Persistent Storage... [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started Create Static Device Nodes in /dev. Starting udev Kernel Device Manager... [ OK ] Reached target Local File Systems (Pre). Mounting /mnt... Mounting /home/green/git/lustre-release... [ OK ] Mounted /mnt. [ OK ] Started udev Coldplug all Devices. [ 12.601209] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ OK ] Mounted /home/green/git/lustre-release. [ OK ] Started udev Kernel Device Manager. [ 12.845686] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 12.953503] input: PC Speaker as /devices/platform/pcspkr/input/input5 [ 13.028723] RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer [ 13.038342] EDAC sbridge: Ver: 1.1.2 [ 17.941458] Key type dns_resolver registered [* ] A start job is running for Configur…-only root support (5s / no limit) [** ] A start job is running for Configur…-only root support (6s / no limit)[ 18.961600] NFS: Registering the id_resolver key type [ 18.963500] Key type id_resolver registered [ 18.969123] Key type id_legacy registered [*** ] A start job is running for Configur…-only root support (7s / no limit) [ *** ] A start job is running for Configur…-only root support (7s / no limit) [ OK ] Started Configure read-only root support. [ OK ] Reached target Local File Systems. Starting Mark the need to relabel after reboot... Starting Rebuild Dynamic Linker Cache... Starting Create Volatile Files and Directories... Starting Load/Save Random Seed... [ OK ] Started Mark the need to relabel after reboot. [ OK ] Started Load/Save Random Seed. [ OK ] Started Create Volatile Files and Directories. Starting RPC Bind... Starting Update UTMP about System Boot/Shutdown... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Started RPC Bind. [ OK ] Started Rebuild Dynamic Linker Cache. Starting Update is Completed... [ OK ] Started Update is Completed. [ OK ] Reached target System Initialization. [ OK ] Started dnf makecache --timer. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Reached target Timers. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. Starting Login Service... [ OK ] Started D-Bus System Message Bus. Starting Network Manager... Starting Restore /run/initramfs on shutdown... [ OK ] Reached target sshd-keygen.target. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. [ OK ] Started irqbalance daemon. [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting GSSAPI Proxy Daemon... Starting Dynamic System Tuning Daemon... Starting OpenSSH server daemon... Starting Network Manager Wait Online... [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Started Login Service. Starting Hostname Service... [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Started OpenSSH server daemon. [ OK ] Started Permit User Sessions. [ OK ] Started Getty on tty1. [ OK ] Started Serial Getty on ttyS0. [ OK ] Started Serial Getty on ttyS1. [ OK ] Reached target Login Prompts. [ OK ] Started Command Scheduler. [ OK ] Started Hostname Service. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting System Logging Service... Starting Notify NFS peers of a restart... Starting Crash recovery kernel arming... [ OK ] Started Notify NFS peers of a restart. [ OK ] Started System Logging Service. Rocky Linux 8.10 (Green Obsidian) Kernel 4.18.0rh8.10-debug on an x86_64 oleg218-server login: [ 79.555100] hrtimer: interrupt took 3718881 ns [ 84.375045] libcfs: loading out-of-tree module taints kernel. [ 84.424403] Key type ._llcrypt registered [ 84.429335] Key type .llcrypt registered [ 84.517632] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_hostid [ 107.289395] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [ 109.085830] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 109.102174] alg: No test for adler32 (adler32-zlib) [ 110.833910] Lustre: Lustre: Build Version: 2.17.58_2_g7c2b8e4 [ 112.509358] LNet: Added LNI 192.168.202.118@tcp [8/256/0/180] [ 114.344582] Key type lgssc registered [ 116.741787] Lustre: Echo OBD driver; http://www.lustre.org/ [ 137.157069] ZFS: Loaded module v2.3.2-1, ZFS pool version 5000, ZFS filesystem version 5 [ 184.717850] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [ 200.298744] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 200.337418] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 201.687832] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 201.737517] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 201.937537] Lustre: lustre-MDT0000: new disk, initializing [ 202.078925] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 202.132959] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 207.159405] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 221.621824] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 221.731495] Lustre: 6522:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 221.790586] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 221.794355] Lustre: Skipped 1 previous similar message [ 221.863515] Lustre: lustre-MDT0001: new disk, initializing [ 221.967823] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 222.010471] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 222.037413] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 227.994772] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 233.530276] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 242.486540] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 242.773575] Lustre: lustre-OST0000: new disk, initializing [ 242.776267] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 242.780450] Lustre: 8462:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 242.813472] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 246.791090] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 246.807804] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 246.897953] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 251.861280] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 269.434603] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 269.604184] Lustre: lustre-OST0001: new disk, initializing [ 269.612180] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 269.619207] Lustre: 9536:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 269.730552] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 276.564610] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 276.574014] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 276.613074] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 277.114244] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 290.621044] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 298.202107] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 306.657115] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing check_logdir /tmp/testlogs/ [ 312.968338] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing yml_node [ 319.045303] Lustre: DEBUG MARKER: Client: 2.17.58.2 [ 322.761792] Lustre: DEBUG MARKER: MDS: 2.17.58.2 [ 326.851704] Lustre: DEBUG MARKER: OSS: 2.17.58.2 [ 328.887273] Lustre: DEBUG MARKER: -----============= acceptance-small: conf-sanity ============----- Fri Sep 11 22:21:22 EDT 2026 [ 348.758077] Lustre: DEBUG MARKER: excepting tests: 102 106 115 32newtarball [ 350.626467] Lustre: DEBUG MARKER: skipping tests SLOW=no: 45 69 106 111 114 [ 368.608339] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 368.615079] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 368.629037] Lustre: Skipped 1 previous similar message [ 368.634798] Lustre: Skipped 3 previous similar messages [ 373.729290] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 373.737233] Lustre: Skipped 3 previous similar messages [ 374.684401] Lustre: server umount lustre-MDT0000 complete [ 379.226302] LustreError: 6515:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789179733 with bad export cookie 13809416958395919985 [ 379.233462] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 379.239822] LustreError: 6515:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 383.970064] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 383.970658] LustreError: 6528:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 383.972116] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 384.000162] Lustre: Skipped 3 previous similar messages [ 384.024391] LustreError: 6528:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 6 previous similar messages [ 384.999934] LustreError: 10721:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 385.026940] LustreError: 10721:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 385.712602] Lustre: server umount lustre-MDT0001 complete [ 390.458817] Lustre: server umount lustre-OST0000 complete [ 395.106750] Lustre: server umount lustre-OST0001 complete [ 403.292702] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_hostid [ 413.758476] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [ 455.476761] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 455.849303] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 455.897643] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 456.001813] Lustre: lustre-MDT0000: new disk, initializing [ 456.096204] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 456.117927] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 461.659082] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 473.671618] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 473.807952] Lustre: 15092:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 473.863509] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 473.866960] Lustre: Skipped 1 previous similar message [ 473.921783] Lustre: lustre-MDT0001: new disk, initializing [ 474.013097] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 474.076077] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 474.093686] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 479.492539] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 489.398028] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 497.011309] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 505.012367] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 505.412837] Lustre: lustre-OST0000: new disk, initializing [ 505.419182] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 505.421989] Lustre: 17062:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 505.555730] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 507.113882] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 507.122820] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 507.353111] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 513.042465] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 527.865510] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 535.691710] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 536.107757] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 540.862944] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 541.042439] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 543.200647] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 543.201114] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 543.217622] LustreError: Skipped 1 previous similar message [ 543.224276] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 543.243987] Lustre: Skipped 1 previous similar message [ 543.268370] Lustre: Skipped 4 previous similar messages [ 548.333363] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 548.356420] Lustre: Skipped 1 previous similar message [ 549.543162] Lustre: server umount lustre-OST0000 complete [ 556.012201] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 556.030296] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 558.560802] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 558.567903] Lustre: Skipped 2 previous similar messages [ 560.847178] Lustre: server umount lustre-MDT0000 complete [ 563.684287] LustreError: 15104:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 563.711125] LustreError: 15104:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 565.179102] LustreError: 15084:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789179919 with bad export cookie 13809416958395921518 [ 565.180798] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 565.191367] LustreError: 15084:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 565.769969] Lustre: server umount lustre-MDT0001 complete [ 572.252242] Lustre: DEBUG MARKER: == conf-sanity test 76a: set permanent params with lctl across mounts ========================================================== 22:25:25 (1789179925) [ 580.655530] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 581.315829] LustreError: 19331:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 581.402331] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 586.584253] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 586.729383] LustreError: 19332:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 596.969904] LustreError: 19331:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 596.997733] LustreError: 19331:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 597.861339] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 604.334616] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 615.271890] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 622.443430] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 631.366513] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 639.865708] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 649.273885] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 658.990800] Lustre: Modifying parameter general.osc.*.max_dirty_mb=452 in log params [ 666.596698] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 666.599494] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 666.633892] Lustre: Skipped 3 previous similar messages [ 666.649573] Lustre: Skipped 2 previous similar messages [ 672.586142] Lustre: server umount lustre-MDT0000 complete [ 676.834841] LustreError: 19332:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 676.861404] LustreError: 19332:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 677.024907] LustreError: 19313:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789180031 with bad export cookie 13809416958395922400 [ 677.051440] LustreError: 19313:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 677.063138] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 677.487841] Lustre: server umount lustre-MDT0001 complete [ 691.288157] Lustre: server umount lustre-OST0000 complete [ 717.553765] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [ 730.303887] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 730.775631] LustreError: 23719:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 730.836078] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 730.842501] Lustre: Skipped 2 previous similar messages [ 735.977208] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 746.330979] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 751.673828] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 755.048975] Lustre: Setting parameter general.debug_raw_pointers=Y in log params [ 762.882521] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 770.442164] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 780.567484] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 780.763247] Lustre: lustre-OST0001: new disk, initializing [ 780.784127] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 780.799831] Lustre: 26035:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 782.382597] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 782.400418] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 782.560328] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 789.117296] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 800.582707] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 805.163962] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 823.796671] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 823.797095] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 823.851826] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 823.863525] Lustre: Skipped 6 previous similar messages [ 827.786727] Lustre: server umount lustre-MDT0000 complete [ 828.904969] LustreError: 23715:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 828.957436] LustreError: 23715:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 6 previous similar messages [ 832.470694] LustreError: 26034:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789180186 with bad export cookie 13809416958395923247 [ 832.471605] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 832.478274] LustreError: 26034:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 5 previous similar messages [ 832.943738] Lustre: server umount lustre-MDT0001 complete [ 847.310268] Lustre: server umount lustre-OST0000 complete [ 850.208263] Lustre: 3654:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789180188/real 1789180188] req@ffff95f3834cb800 x1876090648004864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789180204 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 850.233256] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 850.256035] Lustre: Skipped 3 previous similar messages [ 852.103505] Lustre: server umount lustre-OST0001 complete [ 871.843473] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [ 883.988169] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 885.075217] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 885.098683] Lustre: Skipped 3 previous similar messages [ 890.542449] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 905.608369] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 915.046481] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 918.372703] Lustre: 30216:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 926.897882] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 935.024895] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 945.269690] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 953.616930] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 962.486921] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 966.669842] Lustre: 32100:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 976.358975] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 976.381869] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 976.382723] Lustre: Skipped 3 previous similar messages [ 976.415676] Lustre: Skipped 3 previous similar messages [ 980.235187] Lustre: server umount lustre-MDT0000 complete [ 981.484654] LustreError: 30596:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 981.524104] LustreError: 30596:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 16 previous similar messages [ 984.651054] LustreError: 29044:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789180338 with bad export cookie 13809416958395924542 [ 984.670952] LustreError: 29044:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 984.693848] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 985.126214] Lustre: server umount lustre-MDT0001 complete [ 1000.334034] Lustre: server umount lustre-OST0000 complete [ 1002.474954] Lustre: 3654:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789180340/real 1789180340] req@ffff95f282068700 x1876090648060928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789180356 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 1004.392277] Lustre: server umount lustre-OST0001 complete [ 1013.474571] Lustre: DEBUG MARKER: == conf-sanity test 76b: verify params log setup correctly ========================================================== 22:32:46 (1789180366) [ 1044.773736] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [ 1055.702165] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1061.489225] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 1071.292455] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1078.763069] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 1083.686177] Lustre: 36052:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 1094.267751] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1101.754943] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 1111.232364] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1117.550664] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 1125.559671] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1130.207773] Lustre: 37933:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 1137.122278] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1137.136931] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1137.143880] Lustre: Skipped 3 previous similar messages [ 1137.159962] Lustre: Skipped 4 previous similar messages [ 1143.391407] Lustre: server umount lustre-MDT0000 complete [ 1147.540821] LustreError: 34885:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789180501 with bad export cookie 13809416958395925648 [ 1147.553149] LustreError: 34885:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 1147.554079] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1147.843544] Lustre: server umount lustre-MDT0001 complete [ 1163.051078] Lustre: server umount lustre-OST0000 complete [ 1177.555092] Lustre: server umount lustre-OST0001 complete [ 1186.838723] Lustre: DEBUG MARKER: == conf-sanity test 76c: verify changelog_mask is applied with lctl set_param -P ========================================================== 22:35:40 (1789180540) [ 1206.314702] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [ 1221.115495] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1221.994135] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1222.002494] Lustre: Skipped 7 previous similar messages [ 1227.289654] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 1237.692590] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1243.852372] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 1247.124111] Lustre: 41229:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 1254.472635] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1261.602293] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 1263.013501] LustreError: 41583:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1263.035385] LustreError: 41583:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 16 previous similar messages [ 1271.148672] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1278.272824] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 1286.127332] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1290.365628] Lustre: 43108:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 1291.310580] Lustre: Setting parameter general.mdd.*.changelog_mask=-CLOSE in log params [ 1291.320650] Lustre: Skipped 1 previous similar message [ 1294.816786] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1294.820647] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1294.826751] Lustre: Skipped 1 previous similar message [ 1300.948745] Lustre: server umount lustre-MDT0000 complete [ 1305.523150] LustreError: 40056:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789180659 with bad export cookie 13809416958395926754 [ 1305.535422] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1305.539896] LustreError: 40056:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 1312.089023] Lustre: server umount lustre-MDT0001 complete [ 1322.435072] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1337.236350] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 1340.908412] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 1347.054987] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1352.314818] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 1352.695887] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 1352.711136] Lustre: Skipped 1 previous similar message [ 1361.445816] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1363.242865] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 1371.130521] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 1373.115787] Lustre: DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec [ 1383.401660] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1386.870036] Lustre: server umount lustre-MDT0000 complete [ 1390.573726] LustreError: 40058:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789180744 with bad export cookie 13809416958395927881 [ 1390.578142] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1390.582176] LustreError: 40058:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 1390.884251] Lustre: server umount lustre-MDT0001 complete [ 1406.495742] Lustre: server umount lustre-OST0000 complete [ 1409.508506] Lustre: 3653:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789180747/real 1789180747] req@ffff95f2837d9880 x1876090648202880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789180763 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 1410.618455] Lustre: server umount lustre-OST0001 complete [ 1419.640313] Lustre: DEBUG MARKER: == conf-sanity test 76d: verify llite.*.xattr_cache can be set by 'lctl set_param -P' correctly ========================================================== 22:39:33 (1789180773) [ 1436.365635] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [ 1449.153098] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1455.329914] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 1467.771072] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1473.363417] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 1476.852101] Lustre: 48871:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 1484.697351] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1492.949643] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 1502.844235] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1509.262633] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 1517.222056] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1521.955856] Lustre: Setting parameter general.llite.*.xattr_cache=0 in log params [ 1536.241460] Lustre: server umount lustre-MDT0000 complete [ 1540.436794] LustreError: 47698:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789180894 with bad export cookie 13809416958395928679 [ 1540.441900] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1540.446318] LustreError: 47698:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 1540.842457] Lustre: server umount lustre-MDT0001 complete [ 1555.899536] Lustre: server umount lustre-OST0000 complete [ 1570.358235] Lustre: server umount lustre-OST0001 complete [ 1581.939903] Lustre: DEBUG MARKER: == conf-sanity test 77: comma-separated MGS NIDs and failover node NIDs ========================================================== 22:42:14 (1789180934) [ 1585.367356] Lustre: DEBUG MARKER: SKIP: conf-sanity test_77 mixed loopback and real device not working [ 1587.472973] Lustre: DEBUG MARKER: == conf-sanity test 78: run resize2fs on MDT and OST filesystems ========================================================== 22:42:20 (1789180940) [ 1601.791717] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_hostid [ 1614.911023] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [ 1642.774233] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1642.948100] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1643.006389] Lustre: lustre-MDT0000: new disk, initializing [ 1643.061868] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1648.702311] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 1658.750239] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1666.186187] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1666.423756] Lustre: lustre-OST0000: new disk, initializing [ 1666.426782] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1666.429780] Lustre: Skipped 1 previous similar message [ 1666.433950] Lustre: 54950:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1667.791349] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 1667.803777] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 1667.847140] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 1672.858687] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 1684.942636] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1689.257799] Lustre: DEBUG MARKER: create test files [ 1724.386034] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1724.411375] Lustre: Skipped 14 previous similar messages [ 1724.421684] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1724.426211] Lustre: Skipped 20 previous similar messages [ 1730.325379] Lustre: server umount lustre-OST0000 complete [ 1734.982589] Lustre: server umount lustre-MDT0000 complete [ 1747.226989] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing unload_modules_local [ 1750.443695] Key type lgssc unregistered [ 1750.784131] LNet: 56583:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1750.789775] LNetError: 56583:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1750.807547] LNet: Removed LNI 192.168.202.118@tcp [ 1751.938341] Key type .llcrypt unregistered [ 1751.941284] Key type ._llcrypt unregistered [ 1784.295616] Key type ._llcrypt registered [ 1784.299842] Key type .llcrypt registered [ 1784.478514] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [ 1786.282069] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1786.319162] alg: No test for adler32 (adler32-zlib) [ 1787.578381] Lustre: Lustre: Build Version: 2.17.58_2_g7c2b8e4 [ 1788.040812] LNet: Added LNI 192.168.202.118@tcp [8/256/0/180] [ 1789.847324] Key type lgssc registered [ 1791.022945] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1801.949663] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1801.989377] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1803.617614] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1809.758118] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 1820.947514] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1830.000129] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1830.552233] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1838.255771] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 1847.260941] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1848.951544] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:102 to 0x240000400:129) [ 1849.051558] Lustre: 59317:0:(osd_internal.h:1460:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 509 < left 544, rollback = 9 [ 1849.062809] Lustre: 59317:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 32/128/6, destroy: 0/0/0 [ 1849.070255] Lustre: 59317:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 1849.077624] Lustre: 59317:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/18/1, punch: 0/0/0, quota 1/3/0 [ 1849.084960] Lustre: 59317:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 1849.087587] Lustre: 59317:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 1854.057870] Lustre: DEBUG MARKER: check files after expanding the MDT and OST filesystems [ 1860.435102] Lustre: DEBUG MARKER: create more files after expanding the MDT and OST filesystems [ 1869.797779] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1869.806342] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1869.827377] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1874.324088] Lustre: server umount lustre-OST0000 complete [ 1878.521863] Lustre: server umount lustre-MDT0000 complete [ 1891.279337] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing unload_modules_local [ 1893.833628] Key type lgssc unregistered [ 1894.172390] LNet: 60929:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1894.179964] LNetError: 60929:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1895.214445] LNet: Removed LNI 192.168.202.118@tcp [ 1896.130351] Key type .llcrypt unregistered [ 1896.132888] Key type ._llcrypt unregistered [ 1932.082295] Key type ._llcrypt registered [ 1932.089628] Key type .llcrypt registered [ 1932.349474] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [ 1935.077713] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1935.271757] alg: No test for adler32 (adler32-zlib) [ 1936.639490] Lustre: Lustre: Build Version: 2.17.58_2_g7c2b8e4 [ 1936.956714] LNet: Added LNI 192.168.202.118@tcp [8/256/0/180] [ 1938.673385] Key type lgssc registered [ 1939.877987] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1949.976200] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1949.999154] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1951.482934] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1956.689225] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 1965.802596] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1973.184381] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1973.539894] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1976.632752] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:140 to 0x240000400:161) [ 1976.824875] Lustre: 63766:0:(osd_internal.h:1460:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 510 < left 544, rollback = 9 [ 1976.834644] Lustre: 63766:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 32/128/5, destroy: 0/0/0 [ 1976.844594] Lustre: 63766:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 1976.855541] Lustre: 63766:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/18/1, punch: 0/0/0, quota 1/3/0 [ 1976.872836] Lustre: 63766:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 1976.881552] Lustre: 63766:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 1980.894870] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 1989.545463] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1997.137862] Lustre: DEBUG MARKER: check files after shrinking the MDT and OST filesystems [ 2012.642827] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2012.644916] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2012.663887] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2014.238806] Lustre: server umount lustre-OST0000 complete [ 2019.489255] Lustre: server umount lustre-MDT0000 complete [ 2032.131491] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing unload_modules_local [ 2035.199667] Key type lgssc unregistered [ 2035.545303] LNet: 65326:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2035.561712] LNetError: 65326:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2035.581754] LNet: Removed LNI 192.168.202.118@tcp [ 2036.681149] Key type .llcrypt unregistered [ 2036.683634] Key type ._llcrypt unregistered [ 2059.104887] Key type ._llcrypt registered [ 2059.107150] Key type .llcrypt registered [ 2059.196907] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_hostid [ 2075.027492] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [ 2076.141950] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2076.252526] alg: No test for adler32 (adler32-zlib) [ 2077.319920] Lustre: Lustre: Build Version: 2.17.58_2_g7c2b8e4 [ 2077.633451] LNet: Added LNI 192.168.202.118@tcp [8/256/0/180] [ 2079.359247] Key type lgssc registered [ 2080.704343] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2124.469192] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2124.532228] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2125.885705] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2125.913596] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2125.983565] Lustre: lustre-MDT0000: new disk, initializing [ 2126.062236] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2126.093321] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2132.139749] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 2144.639306] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2144.739994] Lustre: 68480:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2144.785227] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 2144.789034] Lustre: Skipped 1 previous similar message [ 2144.868168] Lustre: lustre-MDT0001: new disk, initializing [ 2144.980164] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2145.028038] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 2145.040066] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2150.198304] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 2161.385828] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2168.071785] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2176.189983] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2176.556490] Lustre: lustre-OST0000: new disk, initializing [ 2176.561533] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 2176.566663] Lustre: 70449:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2176.656479] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2183.836738] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 2183.857438] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2184.046701] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2184.989166] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 2197.155645] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2203.331747] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2203.626697] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2208.938104] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2209.189696] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2214.883269] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2214.908502] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2214.943434] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2217.795995] Lustre: server umount lustre-OST0000 complete [ 2222.049227] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2222.066475] LustreError: Skipped 1 previous similar message [ 2222.076695] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2222.099158] Lustre: Skipped 1 previous similar message [ 2222.108214] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2222.123106] Lustre: Skipped 1 previous similar message [ 2225.129257] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2225.139948] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2225.151930] Lustre: Skipped 1 previous similar message [ 2230.240517] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2230.247815] Lustre: Skipped 1 previous similar message [ 2235.362686] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2235.371279] Lustre: Skipped 1 previous similar message [ 2236.383149] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2236.682266] Lustre: server umount lustre-MDT0000 complete [ 2241.745553] LustreError: 69284:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789181595 with bad export cookie 12828818925827021371 [ 2241.747616] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2241.757899] LustreError: 69284:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2242.354988] Lustre: server umount lustre-MDT0001 complete [ 2254.153907] Lustre: DEBUG MARKER: == conf-sanity test 79: format MDT/OST without mgs option (should return errors) ========================================================== 22:53:27 (1789181607) [ 2266.892607] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [ 2317.381774] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_hostid [ 2331.390235] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [ 2379.776767] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2380.170584] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2380.199751] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2380.291772] Lustre: lustre-MDT0000: new disk, initializing [ 2380.392970] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2380.406734] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2386.828477] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 2400.260858] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2400.461821] Lustre: 76479:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2400.569775] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 2400.575159] Lustre: Skipped 1 previous similar message [ 2400.670213] Lustre: lustre-MDT0001: new disk, initializing [ 2400.787417] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2400.874821] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 2400.890582] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2406.638548] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 2417.744965] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2424.697532] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2432.959244] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2433.242184] Lustre: lustre-OST0000: new disk, initializing [ 2433.250048] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 2433.258657] Lustre: 78450:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2433.352820] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2440.798342] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 2440.810601] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2440.966238] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2441.139276] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 2453.223479] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2459.401838] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2459.688553] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2466.150339] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2466.370581] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2471.907933] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2471.912668] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2471.922430] LustreError: Skipped 1 previous similar message [ 2471.924113] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2471.990988] Lustre: Skipped 1 previous similar message [ 2475.057979] LustreError: 78788:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2475.088767] LustreError: 78788:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 4 previous similar messages [ 2475.187775] Lustre: server umount lustre-OST0000 complete [ 2480.097202] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2486.558285] Lustre: server umount lustre-MDT0000 complete [ 2490.339315] LustreError: 76490:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2490.368732] LustreError: 76490:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 2490.724795] LustreError: 76469:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789181844 with bad export cookie 12828818925827022253 [ 2490.726516] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2490.746015] LustreError: 76469:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2491.165903] Lustre: server umount lustre-MDT0001 complete [ 2500.651888] Lustre: DEBUG MARKER: == conf-sanity test 80: mgc import reconnect race ======== 22:57:34 (1789181854) [ 2507.550575] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2508.073543] LustreError: 80863:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2508.141759] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2511.997140] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 2513.387122] LustreError: 80864:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2518.510475] LustreError: 80863:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2521.625175] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2526.414784] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 2535.309281] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2542.216296] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2548.923036] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2549.217245] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2549.225537] Lustre: Skipped 1 previous similar message [ 2555.707777] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 2564.128650] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2568.583439] Lustre: 83535:0:(genops.c:1774:obd_export_evict_by_uuid()) MGS: evicting fd336f7e-ac56-4585-ad57-2893ca337d35 at adminstrative request [ 2572.789298] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2572.808634] Lustre: *** cfs_fail_loc=906, val=2147483648*** [ 2581.988864] Lustre: MGS: Client fd336f7e-ac56-4585-ad57-2893ca337d35 (at 0@lo) reconnecting [ 2582.011118] Lustre: Evicted from MGS (at 0@lo) after server handle changed from 0xb2091ed7d1ba611f to 0xb2091ed7d1ba63bf [ 2582.068589] Lustre: MGC192.168.202.118@tcp: Connection restored to 0@lo (at 0@lo) [ 2606.924571] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2607.134222] Lustre: lustre-OST0001: new disk, initializing [ 2607.140886] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 2607.146942] Lustre: 83928:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2614.621586] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 2616.432516] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 2616.445615] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 2616.551627] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 2624.686759] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2632.161227] LustreError: lustre-OST0001-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2632.176198] Lustre: lustre-OST0001-osc-MDT0001: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2632.191539] Lustre: Skipped 1 previous similar message [ 2632.197223] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 2632.205452] Lustre: Skipped 6 previous similar messages [ 2642.399136] Lustre: lustre-OST0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2642.513912] Lustre: server umount lustre-OST0001 complete [ 2647.526741] LustreError: 82686:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2647.551090] LustreError: 82686:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 2652.822649] Lustre: server umount lustre-OST0000 complete [ 2660.321674] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2660.331344] LustreError: Skipped 1 previous similar message [ 2660.336206] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2660.353198] Lustre: Skipped 3 previous similar messages [ 2664.581804] Lustre: server umount lustre-MDT0000 complete [ 2668.015230] LustreError: 84784:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2668.056042] LustreError: 84784:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 5 previous similar messages [ 2668.811981] LustreError: 81598:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789182022 with bad export cookie 12828818925827023807 [ 2668.818117] LustreError: 81598:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 2668.818897] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2669.131910] Lustre: server umount lustre-MDT0001 complete [ 2680.063564] Lustre: DEBUG MARKER: == conf-sanity test 81: sparse OST indexing ============== 23:00:33 (1789182033) [ 2681.453845] Lustre: DEBUG MARKER: SKIP: conf-sanity test_81 needs >= 3 OSTs [ 2683.707528] Lustre: DEBUG MARKER: == conf-sanity test 82a: specify OSTs for file (succeed) or directory (succeed) ========================================================== 23:00:36 (1789182036) [ 2685.581161] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82a needs >= 3 OSTs [ 2687.959229] Lustre: DEBUG MARKER: == conf-sanity test 82b: specify OSTs for file with --pool and --ost-list options ========================================================== 23:00:40 (1789182040) [ 2689.681706] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82b needs >= 4 OSTs [ 2691.844167] Lustre: DEBUG MARKER: == conf-sanity test 82c: specify sparse OSTs for setstripe (should not crash) ========================================================== 23:00:45 (1789182045) [ 2693.774401] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82c needs >= 4 OSTs [ 2695.985451] Lustre: DEBUG MARKER: == conf-sanity test 83: ENOSPACE on OST doesn't cause message VFS: Busy inodes after unmount ... ========================================================== 23:00:49 (1789182049) [ 2697.863334] Lustre: DEBUG MARKER: mount the OST /dev/mapper/ost1_flakey as a ldiskfs filesystem [ 2705.673348] loop: module loaded [ 2705.687729] loop0: detected capacity change from 0 to 4294967296 [ 2705.781026] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 2708.003755] Lustre: DEBUG MARKER: run llverfs in partial mode on the OST ldiskfs /mnt/lustre-ost1 [ 2713.039183] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing run_llverfs /mnt/lustre-ost1 -vpl no [ 2718.307857] Lustre: DEBUG MARKER: unmount the OST /dev/mapper/ost1_flakey [ 2743.644842] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2743.687322] LustreError: 88070:0:(obd_config.c:845:class_setup()) setup lustre-OST0000-osd failed (-28) [ 2743.691854] LustreError: 88070:0:(obd_mount.c:259:lustre_start_simple()) lustre-OST0000-osd setup error -28 [ 2743.697113] LustreError: 88070:0:(tgt_mount.c:2585:server_fill_super()) Unable to start osd on /dev/mapper/ost1_flakey: -28 [ 2743.701072] LustreError: 88070:0:(super25.c:179:lustre_fill_super()) llite: Unable to mount : rc = -28 [ 2762.006078] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_hostid [ 2773.128332] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [ 2817.632822] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2817.843507] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2817.870848] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2817.938631] Lustre: lustre-MDT0000: new disk, initializing [ 2818.001871] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2818.006628] Lustre: Skipped 1 previous similar message [ 2818.018566] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2822.571518] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 2833.241729] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2833.334732] Lustre: 90939:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2833.567837] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2838.507264] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 2848.025504] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2853.989240] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2861.053135] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2861.387449] Lustre: 92912:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2869.180536] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 2870.372929] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2870.551270] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2879.895531] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2886.171648] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2886.579974] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2891.389783] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2891.671663] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2896.369975] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2896.370367] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2896.399027] Lustre: Skipped 1 previous similar message [ 2896.414349] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2896.434155] Lustre: Skipped 9 previous similar messages [ 2899.609115] Lustre: server umount lustre-OST0000 complete [ 2917.343314] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2917.750663] Lustre: server umount lustre-MDT0000 complete [ 2921.964337] LustreError: 90947:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2921.995322] LustreError: 90947:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 2922.052472] LustreError: 92909:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789182276 with bad export cookie 12828818925827024423 [ 2922.057515] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2922.070894] LustreError: 92909:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 2922.620386] Lustre: server umount lustre-MDT0001 complete [ 2930.655263] Lustre: DEBUG MARKER: == conf-sanity test 84: check recovery_hard_time ========= 23:04:44 (1789182284) [ 2937.488160] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2942.745869] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 2951.893633] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2952.356540] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-60 [ 2952.365736] Lustre: Skipped 3 previous similar messages [ 2956.298246] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 2963.546596] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2969.496772] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2976.403844] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2983.161634] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 2990.469179] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2995.899876] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2996.133656] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 3000.757084] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 3000.938642] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 3008.160157] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3008.320685] Lustre: lustre-OST0001: new disk, initializing [ 3008.323209] Lustre: Skipped 2 previous similar messages [ 3008.328464] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 3008.332656] Lustre: Skipped 3 previous similar messages [ 3008.335778] Lustre: 98691:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3015.194075] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 3016.787602] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 3016.809115] Lustre: Skipped 2 previous similar messages [ 3016.830781] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 3016.911377] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 3024.729153] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3029.787939] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid 50 [ 3030.056744] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 3034.649541] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [ 3034.887518] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 3053.202382] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 3078.899244] Lustre: Failing over lustre-MDT0000 [ 3080.160336] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3080.164385] LustreError: Skipped 2 previous similar messages [ 3080.166380] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3080.172338] Lustre: Skipped 3 previous similar messages [ 3080.175511] LustreError: 95323:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3080.185044] LustreError: 95323:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [ 3081.375632] Lustre: server umount lustre-MDT0000 complete [ 3099.103121] Lustre: 66697:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789182437/real 1789182437] req@00000000634aa5d5 x1876092708476928/t0(0) o400->MGC192.168.202.118@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1789182453 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 3099.138258] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3106.566948] LDISKFS-fs (dm-0): 4 truncates cleaned up [ 3106.569740] LDISKFS-fs (dm-0): recovery complete [ 3106.578818] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3109.347535] LustreError: 66696:0:(client.c:1404:ptlrpc_import_delay_req()) @@@ invalidate in flight req@00000000ac52d44b x1876092708484352/t0(0) o250->MGC192.168.202.118@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 3109.890220] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 3114.938622] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 3114.966889] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 3114.969825] Lustre: 95319:0:(ldlm_lib.c:2110:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 3115.027246] Lustre: lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 3115.150692] LustreError: 101538:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 3115.497091] LustreError: 101538:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 3115.502992] Lustre: 101538:0:(ldlm_lib.c:2110:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 3115.531326] Lustre: 101538:0:(ldlm_lib.c:2110:extend_recovery_timer()) Skipped 7 previous similar messages [ 3115.858984] LustreError: 101538:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 3115.864388] LustreError: 101538:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 1 previous similar message [ 3116.191241] LustreError: 101538:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 3116.194084] LustreError: 101538:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 1 previous similar message [ 3116.533257] Lustre: 101538:0:(ldlm_lib.c:2110:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 3116.548280] Lustre: 101538:0:(ldlm_lib.c:2110:extend_recovery_timer()) Skipped 2 previous similar messages [ 3116.889208] LustreError: 101538:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 3116.923239] LustreError: 101538:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 2 previous similar messages [ 3117.264615] LustreError: 101538:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 3117.276077] LustreError: 101538:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 2 previous similar messages [ 3118.579317] Lustre: 101538:0:(ldlm_lib.c:2110:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 3118.607169] Lustre: 101538:0:(ldlm_lib.c:2110:extend_recovery_timer()) Skipped 5 previous similar messages [ 3118.936801] LustreError: 101538:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 3118.958904] LustreError: 101538:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 5 previous similar messages [ 3119.287099] LustreError: 101538:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 3119.298962] LustreError: 101538:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 5 previous similar messages [ 3122.848382] Lustre: 101538:0:(ldlm_lib.c:2110:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 3122.864510] Lustre: 101538:0:(ldlm_lib.c:2110:extend_recovery_timer()) Skipped 12 previous similar messages [ 3123.205638] LustreError: 101538:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 3123.234082] LustreError: 101538:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 12 previous similar messages [ 3123.567847] LustreError: 101538:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 3123.572456] LustreError: 101538:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 12 previous similar messages [ 3131.032226] Lustre: 101538:0:(ldlm_lib.c:2110:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 3131.052918] Lustre: 101538:0:(ldlm_lib.c:2110:extend_recovery_timer()) Skipped 24 previous similar messages [ 3131.386379] LustreError: 101538:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 3131.398096] LustreError: 101538:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 24 previous similar messages [ 3131.735225] LustreError: 101538:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 3131.766197] LustreError: 101538:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 24 previous similar messages [ 3147.189647] Lustre: 101538:0:(ldlm_lib.c:2110:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 3147.221547] Lustre: 101538:0:(ldlm_lib.c:2110:extend_recovery_timer()) Skipped 49 previous similar messages [ 3147.561110] LustreError: 101538:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 3147.580399] LustreError: 101538:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 49 previous similar messages [ 3147.912105] LustreError: 101538:0:(ldlm_lib.c:2723:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 3147.924936] LustreError: 101538:0:(ldlm_lib.c:2723:replay_request_or_update()) Skipped 49 previous similar messages [ 3174.039301] Lustre: 101538:0:(ldlm_lib.c:2419:target_recovery_overseer()) lustre-MDT0000 recovery is aborted by hard timeout [ 3174.047570] Lustre: 101538:0:(ldlm_lib.c:2429:target_recovery_overseer()) recovery is aborted, evict exports in recovery [ 3174.058527] Lustre: 101538:0:(genops.c:1601:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client 0c3975e8-c405-4389-834e-ac38070c7b60@192.168.202.18@tcp [ 3174.079246] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 3174.109259] Lustre: 101538:0:(ldlm_lib.c:1939:abort_req_replay_queue()) @@@ aborted: req@000000008a684187 x1876092693582592/t0(8589934779) o101->0c3975e8-c405-4389-834e-ac38070c7b60@192.168.202.18@tcp:148/0 lens 592/0 e 0 to 0 dl 1789182538 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:0 [ 3174.163741] Lustre: lustre-MDT0000-osd: cancel update llog [0x200000400:0x1:0x0] [ 3174.173387] Lustre: lustre-MDT0000: Denying connection for new client 0c3975e8-c405-4389-834e-ac38070c7b60 (at 192.168.202.18@tcp), waiting for 3 known clients (2 recovered, 0 in progress, and 1 evicted) to recover in 0:00 [ 3174.211818] Lustre: lustre-MDT0001-osp-MDT0000: cancel update llog [0x240000401:0x1:0x0] [ 3174.269185] Lustre: lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 3174.279610] Lustre: lustre-MDT0000: Recovery over after 1:00, of 3 clients 2 recovered and 1 was evicted. [ 3174.284525] Lustre: Skipped 2 previous similar messages [ 3174.330064] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:80 to 0x280000401:577) [ 3174.337487] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:47 to 0x2c0000401:545) [ 3188.705271] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3188.711087] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3188.721071] Lustre: Skipped 8 previous similar messages [ 3194.185079] Lustre: server umount lustre-OST0000 complete [ 3212.265025] LustreError: 97764:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3212.287942] LustreError: 97764:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 43 previous similar messages [ 3213.280424] Lustre: lustre-OST0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 3213.621245] Lustre: server umount lustre-OST0001 complete [ 3220.448844] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3220.474957] Lustre: Skipped 7 previous similar messages [ 3224.887269] Lustre: server umount lustre-MDT0000 complete [ 3229.654910] LustreError: 95305:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789182583 with bad export cookie 12828818925827075635 [ 3229.672372] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3229.921332] Lustre: server umount lustre-MDT0001 complete [ 3242.403673] Lustre: DEBUG MARKER: == conf-sanity test 85: osd_ost init: fail ea_fid_set ==== 23:09:54 (1789182594) [ 3252.610385] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3252.624935] Lustre: *** cfs_fail_loc=197, val=0*** [ 3268.326851] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 3273.439465] LustreError: 103518:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.202.118@tcp: failed processing log, type 4: rc = -110 [ 3278.583330] Lustre: *** cfs_fail_loc=197, val=0*** [ 3278.591535] Lustre: Skipped 65 previous similar messages [ 3299.103402] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3299.106358] Lustre: Skipped 3 previous similar messages [ 3306.279860] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 3317.675368] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3321.351632] Lustre: server umount lustre-OST0000 complete [ 3334.936095] Lustre: DEBUG MARKER: == conf-sanity test 86: Replacing mkfs.lustre -G option == 23:11:27 (1789182687) [ 3357.608390] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3363.074470] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 3373.184871] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3377.074792] LustreError: 105169:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x200000009:0x1:0x0]: rc = -5 [ 3377.082249] LustreError: 105169:0:(lod_sub_object.c:917:lod_sub_prep_llog()) lustre-MDT0000-mdtlov: can't get id from catalogs: rc = -5 [ 3377.094844] LustreError: 105169:0:(lod_dev.c:511:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 19, retries 0, failed: rc = -5 [ 3377.428595] Lustre: server umount lustre-MDT0000 complete [ 3411.921919] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_hostid [ 3421.640680] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [ 3461.707050] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3461.966810] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3461.989592] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3462.059906] Lustre: lustre-MDT0000: new disk, initializing [ 3462.166272] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3468.096906] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 3482.465601] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3482.640479] Lustre: 109344:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 3483.095396] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 3488.658955] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 3500.272124] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3507.486596] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3515.297026] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3515.599781] Lustre: 111316:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3522.634870] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 3523.876186] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 3533.327350] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3539.441224] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 3539.716489] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 3545.355887] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 3545.665989] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 3549.674394] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3549.690155] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3549.697032] LustreError: Skipped 5 previous similar messages [ 3549.708642] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3549.708651] Lustre: Skipped 14 previous similar messages [ 3549.747421] Lustre: Skipped 2 previous similar messages [ 3554.179679] Lustre: server umount lustre-OST0000 complete [ 3564.899042] Lustre: server umount lustre-MDT0000 complete [ 3565.037297] LustreError: 110469:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3565.062696] LustreError: 110469:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 8 previous similar messages [ 3568.425484] LustreError: 109337:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789182922 with bad export cookie 12828818925827086317 [ 3568.439160] LustreError: 109337:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3568.444469] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3568.683334] Lustre: server umount lustre-MDT0001 complete [ 3577.315356] Lustre: DEBUG MARKER: == conf-sanity test 87: check if MDT inode can hold EAs with N stripes properly ========================================================== 23:15:30 (1789182930) [ 3586.679767] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing unload_modules_local [ 3590.009780] Key type lgssc unregistered [ 3590.373244] LNet: 113804:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3590.379508] LNetError: 113804:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3590.404729] LNet: Removed LNI 192.168.202.118@tcp [ 3591.480594] Key type .llcrypt unregistered [ 3591.486941] Key type ._llcrypt unregistered [ 3611.383561] Key type ._llcrypt registered [ 3611.386825] Key type .llcrypt registered [ 3611.493970] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_hostid [ 3627.057711] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [ 3628.133250] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3628.180421] alg: No test for adler32 (adler32-zlib) [ 3629.289805] Lustre: Lustre: Build Version: 2.17.58_2_g7c2b8e4 [ 3629.637386] LNet: Added LNI 192.168.202.118@tcp [8/256/0/180] [ 3631.431251] Key type lgssc registered [ 3632.652154] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3677.759708] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3677.790231] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3679.045272] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3679.094712] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3679.199495] Lustre: lustre-MDT0000: new disk, initializing [ 3679.298408] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3679.318618] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3684.169772] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 3696.314257] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3696.664445] Lustre: lustre-OST0000: Not available for connect from 0@lo (not set up) [ 3696.670519] Lustre: lustre-OST0000: new disk, initializing [ 3696.685176] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3696.691635] Lustre: Skipped 1 previous similar message [ 3696.696125] Lustre: 117981:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3696.829572] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3702.318650] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 3702.327800] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 3702.362273] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 3704.627341] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 3716.516544] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3716.686572] Lustre: lustre-OST0001: new disk, initializing [ 3716.690367] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 3716.697398] Lustre: 118842:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3716.782794] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 3723.469524] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 3725.932464] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost [ 3725.941659] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] [ 3725.968524] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 [ 3736.036165] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3736.058511] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3740.220296] Lustre: server umount lustre-MDT0000 complete [ 3747.996341] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null) [ 3754.330955] LustreError: 117165:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789183108 with bad export cookie 3172403397756021623 [ 3754.342325] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3754.347802] LustreError: 117165:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 3754.440986] Lustre: server umount lustre-OST0000 complete [ 3758.862893] Lustre: server umount lustre-OST0001 complete [ 3768.698986] Lustre: DEBUG MARKER: == conf-sanity test 88a: tunefs.lustre persists a --mountfsoptions-only change ========================================================== 23:18:42 (1789183122) [ 3793.048750] Lustre: DEBUG MARKER: == conf-sanity test 88b: check the default mount options can be overridden ========================================================== 23:19:06 (1789183146) [ 3802.783906] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [ 3828.315797] Lustre: DEBUG MARKER: == conf-sanity test 89: check tunefs --param and --erase-param{s} options ========================================================== 23:19:41 (1789183181) [ 3871.354201] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_hostid [ 3880.721382] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [ 3919.079732] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3919.442756] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3919.493751] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3919.577287] Lustre: lustre-MDT0000: new disk, initializing [ 3919.653766] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3919.665253] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3925.365698] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 3937.077219] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3937.249648] Lustre: 126610:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 3937.312825] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 3937.316813] Lustre: Skipped 1 previous similar message [ 3937.427326] Lustre: lustre-MDT0001: new disk, initializing [ 3937.586113] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3937.629713] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 3937.638935] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 3942.654426] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 3953.636658] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3960.166609] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3967.694289] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3967.993227] Lustre: lustre-OST0000: new disk, initializing [ 3967.996221] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3968.002955] Lustre: 128579:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3968.077704] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3976.291505] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 3976.305918] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 3976.502777] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 3976.635267] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 3987.884551] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount (FULL|IDLE) failover.node=192.0.2.254@tcp0,osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3995.054319] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 3995.415803] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 3999.155676] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 3999.392017] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 4002.273962] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4002.288391] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4002.292679] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4002.299261] Lustre: Skipped 2 previous similar messages [ 4002.311581] Lustre: Skipped 2 previous similar messages [ 4007.418437] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4007.431359] Lustre: Skipped 1 previous similar message [ 4007.971846] Lustre: server umount lustre-OST0000 complete [ 4012.515121] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4012.525430] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4012.528878] Lustre: Skipped 1 previous similar message [ 4012.543128] Lustre: Skipped 1 previous similar message [ 4018.988792] Lustre: server umount lustre-MDT0000 complete [ 4024.812945] LustreError: 126601:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789183378 with bad export cookie 3172403397756022848 [ 4024.830290] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4025.427813] Lustre: server umount lustre-MDT0001 complete [ 4038.976896] Lustre: DEBUG MARKER: == conf-sanity test 90a: check max_mod_rpcs_in_flight is enforced ========================================================== 23:23:11 (1789183391) [ 4046.699360] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4047.447362] LustreError: 130993:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4047.481361] LustreError: 130993:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [ 4047.594924] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4052.968822] LustreError: 130994:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4054.558622] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 4057.064022] LustreError: 130993:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4062.182898] LustreError: 130994:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4066.226122] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4071.718180] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 4079.418521] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 4085.672719] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 4092.624603] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4092.974387] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4092.979346] Lustre: Skipped 1 previous similar message [ 4099.230666] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 4108.164972] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 4116.183186] Lustre: *** cfs_fail_loc=159, val=0*** [ 4132.359495] Lustre: lustre-MDT0000: Client ddf346fd-4d34-49d3-83b5-e8489d4d64bb (at 192.168.202.18@tcp) reconnecting [ 4134.633263] Lustre: *** cfs_fail_loc=159, val=0*** [ 4134.637762] Lustre: Skipped 5 previous similar messages [ 4150.399703] Lustre: lustre-MDT0000: Client ddf346fd-4d34-49d3-83b5-e8489d4d64bb (at 192.168.202.18@tcp) reconnecting [ 4170.721136] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4170.736441] LustreError: Skipped 1 previous similar message [ 4170.743591] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4170.755976] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4170.769227] Lustre: Skipped 2 previous similar messages [ 4171.737193] Lustre: server umount lustre-OST0000 complete [ 4177.894936] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4177.913255] Lustre: Skipped 1 previous similar message [ 4182.385363] Lustre: server umount lustre-MDT0000 complete [ 4183.009764] LustreError: 132147:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4183.039934] LustreError: 132147:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 4186.075772] LustreError: 133717:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789183540 with bad export cookie 3172403397756023730 [ 4186.078633] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4186.083639] LustreError: 133717:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 5 previous similar messages [ 4196.542145] Lustre: server umount lustre-MDT0001 complete [ 4208.091574] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing unload_modules_local [ 4211.385049] Key type lgssc unregistered [ 4211.788766] LNet: 134776:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4211.798671] LNetError: 134776:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4211.814586] LNet: Removed LNI 192.168.202.118@tcp [ 4212.568812] Key type .llcrypt unregistered [ 4212.571308] Key type ._llcrypt unregistered [ 4236.001950] Key type ._llcrypt registered [ 4236.004697] Key type .llcrypt registered [ 4236.104641] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [ 4237.848884] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4237.891409] alg: No test for adler32 (adler32-zlib) [ 4238.950777] Lustre: Lustre: Build Version: 2.17.58_2_g7c2b8e4 [ 4239.173572] LNet: Added LNI 192.168.202.118@tcp [8/256/0/180] [ 4240.855373] Key type lgssc registered [ 4242.708451] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4253.452291] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4253.485465] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4255.119551] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4260.172557] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 4265.442305] LustreError: 136169:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4265.467739] LustreError: 136169:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 4269.597091] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4270.008366] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4276.007845] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 4285.148757] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 4291.362042] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 4298.692238] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4299.239660] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4300.284222] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:42 to 0x280000401:65) [ 4305.675926] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 4313.723350] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 4324.622229] Lustre: *** cfs_fail_loc=159, val=0*** [ 4340.248850] Lustre: lustre-MDT0000: Client c1c67c86-6882-4d29-be8f-5f595fe77f50 (at 192.168.202.18@tcp) reconnecting [ 4342.248311] Lustre: *** cfs_fail_loc=159, val=0*** [ 4342.253204] Lustre: Skipped 1 previous similar message [ 4358.655590] Lustre: lustre-MDT0001: Client c1c67c86-6882-4d29-be8f-5f595fe77f50 (at 192.168.202.18@tcp) reconnecting [ 4361.209270] Lustre: *** cfs_fail_loc=159, val=0*** [ 4361.228206] Lustre: Skipped 2 previous similar messages [ 4377.611180] Lustre: lustre-MDT0001: Client c1c67c86-6882-4d29-be8f-5f595fe77f50 (at 192.168.202.18@tcp) reconnecting [ 4382.519562] Lustre: 139208:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 4385.491835] Lustre: *** cfs_fail_loc=159, val=0*** [ 4385.493428] Lustre: Skipped 3 previous similar messages [ 4401.110357] Lustre: lustre-MDT0000: Client e76b3179-5aac-40a5-8d38-a4f6319dabe1 (at 192.168.202.18@tcp) reconnecting [ 4403.560036] Lustre: *** cfs_fail_loc=159, val=0*** [ 4403.577664] Lustre: Skipped 15 previous similar messages [ 4419.104121] Lustre: lustre-MDT0000: Client e76b3179-5aac-40a5-8d38-a4f6319dabe1 (at 192.168.202.18@tcp) reconnecting [ 4421.252868] Lustre: 139499:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 4427.236447] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4427.244393] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4427.249146] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4432.352721] LustreError: 139107:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4432.376300] LustreError: 139107:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 4432.471775] Lustre: server umount lustre-OST0000 complete [ 4437.473512] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4437.483361] Lustre: Skipped 1 previous similar message [ 4437.489668] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4437.496754] Lustre: Skipped 2 previous similar messages [ 4442.605681] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4442.630161] Lustre: Skipped 1 previous similar message [ 4443.200610] Lustre: server umount lustre-MDT0000 complete [ 4446.838967] LustreError: 136152:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789183800 with bad export cookie 2636730381372407605 [ 4446.842693] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4446.848613] LustreError: 136152:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4447.291726] Lustre: server umount lustre-MDT0001 complete [ 4460.301284] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing unload_modules_local [ 4464.348414] Key type lgssc unregistered [ 4464.614620] LNet: 140551:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4464.624679] LNetError: 140551:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4465.640662] LNet: Removed LNI 192.168.202.118@tcp [ 4466.834779] Key type .llcrypt unregistered [ 4466.836658] Key type ._llcrypt unregistered [ 4496.646257] Key type ._llcrypt registered [ 4496.649198] Key type .llcrypt registered [ 4496.794319] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [ 4498.566316] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4498.633293] alg: No test for adler32 (adler32-zlib) [ 4499.774488] Lustre: Lustre: Build Version: 2.17.58_2_g7c2b8e4 [ 4500.176633] LNet: Added LNI 192.168.202.118@tcp [8/256/0/180] [ 4501.896079] Key type lgssc registered [ 4503.269968] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4512.526913] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4512.548368] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4513.986183] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4519.008430] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 4524.518678] LustreError: 141964:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4524.536188] LustreError: 141964:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 4528.088144] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4528.413617] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4533.341109] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 4540.747151] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 4546.366631] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 4554.043538] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4554.342078] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4559.499146] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:129) [ 4560.898085] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 4570.323581] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 4573.850570] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:97) [ 4580.423924] Lustre: 144549:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 4586.367414] Lustre: 144597:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 4587.787425] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 in log params [ 4588.779285] Lustre: Setting parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=8 in log params [ 4592.731468] Lustre: 144744:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre/mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 (mode = 0) failed: rc = -17 [ 4593.803856] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=7 in log params [ 4594.905954] Lustre: 144854:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 4600.805757] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4600.809754] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4600.826483] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4604.896745] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4604.899234] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4604.911832] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4606.123686] Lustre: server umount lustre-OST0000 complete [ 4610.026590] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4610.034086] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4610.044037] Lustre: Skipped 1 previous similar message [ 4610.061059] Lustre: Skipped 2 previous similar messages [ 4615.141383] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4615.147548] Lustre: Skipped 1 previous similar message [ 4615.884554] Lustre: server umount lustre-MDT0000 complete [ 4619.955941] LustreError: 141945:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789183974 with bad export cookie 10417528014336988898 [ 4619.962351] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4619.971428] LustreError: 141945:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 4620.583613] Lustre: server umount lustre-MDT0001 complete [ 4632.691230] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing unload_modules_local [ 4635.686269] Key type lgssc unregistered [ 4635.950671] LNet: 145906:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4635.959851] LNetError: 145906:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4637.032990] LNet: Removed LNI 192.168.202.118@tcp [ 4637.940706] Key type .llcrypt unregistered [ 4637.943110] Key type ._llcrypt unregistered [ 4665.488827] Key type ._llcrypt registered [ 4665.491535] Key type .llcrypt registered [ 4665.637553] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [ 4666.617418] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4666.689636] alg: No test for adler32 (adler32-zlib) [ 4667.762288] Lustre: Lustre: Build Version: 2.17.58_2_g7c2b8e4 [ 4668.063845] LNet: Added LNI 192.168.202.118@tcp [8/256/0/180] [ 4669.719192] Key type lgssc registered [ 4671.147721] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4681.306149] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4681.326363] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4682.868340] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4687.375537] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 4692.458220] LustreError: 147324:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4692.464300] LustreError: 147324:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 4697.581359] LustreError: 147324:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4698.514548] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4699.070834] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4704.880865] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 4716.144399] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 4722.432245] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 4730.461443] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4731.032921] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4738.965917] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 4744.402491] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:129) [ 4746.868107] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 4752.578167] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:161) [ 4758.870787] Lustre: *** cfs_fail_loc=159, val=0*** [ 4774.394181] Lustre: lustre-MDT0000: Client d39fcee5-1c89-4459-81e3-2127873ca405 (at 192.168.202.18@tcp) reconnecting [ 4783.586304] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4783.605890] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4783.612307] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4783.624764] Lustre: Skipped 1 previous similar message [ 4783.672917] Lustre: Skipped 1 previous similar message [ 4787.062623] Lustre: server umount lustre-OST0000 complete [ 4791.264621] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4791.278299] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4791.306052] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4793.824412] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4793.844537] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4798.948228] LustreError: 149894:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4798.961938] LustreError: 149894:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 4799.642883] Lustre: server umount lustre-MDT0000 complete [ 4803.042156] LustreError: 147324:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4803.061082] LustreError: 147324:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 4804.240539] LustreError: 148065:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789184158 with bad export cookie 3495943658822139859 [ 4804.248636] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4804.260456] LustreError: 148065:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4804.813367] Lustre: server umount lustre-MDT0001 complete [ 4817.210452] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing unload_modules_local [ 4820.372407] Key type lgssc unregistered [ 4820.663971] LNet: 151007:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4820.670414] LNetError: 151007:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4820.690134] LNet: Removed LNI 192.168.202.118@tcp [ 4821.462566] Key type .llcrypt unregistered [ 4821.464952] Key type ._llcrypt unregistered [ 4846.029592] Key type ._llcrypt registered [ 4846.033326] Key type .llcrypt registered [ 4846.168632] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [ 4847.483359] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4847.588765] alg: No test for adler32 (adler32-zlib) [ 4848.656945] Lustre: Lustre: Build Version: 2.17.58_2_g7c2b8e4 [ 4848.953520] LNet: Added LNI 192.168.202.118@tcp [8/256/0/180] [ 4850.608519] Key type lgssc registered [ 4851.685183] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4859.523504] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4859.535690] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4860.905771] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4864.849232] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 4870.130844] LustreError: 152418:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4870.150762] LustreError: 152418:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 4873.908629] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4874.421887] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4879.673353] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 4888.590971] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 4894.212961] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 4902.203804] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4902.608214] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4905.719625] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:170 to 0x280000401:193) [ 4909.120893] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 4918.299354] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 4919.042021] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:161) [ 4938.904087] Lustre: lustre-OST0000: evicting 92e1607b-c270-4b3c-9186-77b0d0592be9 (at 192.168.202.18@tcp) by administrative request [ 4938.912499] Lustre: Skipped 1 previous similar message [ 4970.466474] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4970.481521] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4970.487417] Lustre: Skipped 1 previous similar message [ 4970.506995] Lustre: Skipped 1 previous similar message [ 4974.473938] Lustre: server umount lustre-OST0000 complete [ 4980.706560] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4980.713348] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4980.726488] Lustre: Skipped 1 previous similar message [ 4980.738897] Lustre: Skipped 1 previous similar message [ 4985.348812] Lustre: server umount lustre-MDT0000 complete [ 4985.826152] LustreError: 155340:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4985.859458] LustreError: 155340:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 4989.926878] LustreError: 153149:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4989.944255] LustreError: 153149:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 4989.966118] LustreError: 152398:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789184344 with bad export cookie 1292660845933187734 [ 4989.971140] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4989.982328] LustreError: 152398:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 4990.513973] Lustre: server umount lustre-MDT0001 complete [ 5003.560779] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing unload_modules_local [ 5006.961026] Key type lgssc unregistered [ 5007.343724] LNet: 156494:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5007.353847] LNetError: 156494:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5007.374704] LNet: Removed LNI 192.168.202.118@tcp [ 5008.202967] Key type .llcrypt unregistered [ 5008.205401] Key type ._llcrypt unregistered [ 5086.896223] Key type ._llcrypt registered [ 5086.899765] Key type .llcrypt registered [ 5087.052591] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [ 5088.453194] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5088.532161] alg: No test for adler32 (adler32-zlib) [ 5089.614450] Lustre: Lustre: Build Version: 2.17.58_2_g7c2b8e4 [ 5089.800980] LNet: Added LNI 192.168.202.118@tcp [8/256/0/180] [ 5091.431178] Key type lgssc registered [ 5092.423324] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5100.601571] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5100.619653] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5102.205348] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5106.866948] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 5112.815479] LustreError: 158985:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5112.855552] LustreError: 158985:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 5116.100661] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5116.393557] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5121.111700] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 5128.618671] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 5133.996660] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 5141.161206] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5141.489086] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5142.542605] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:193) [ 5147.702057] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:195 to 0x280000401:225) [ 5148.333929] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 5156.583591] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 5168.105612] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 5168.119655] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5168.126892] LustreError: Skipped 1 previous similar message [ 5168.135341] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5168.141958] Lustre: Skipped 1 previous similar message [ 5172.761485] Lustre: server umount lustre-OST0000 complete [ 5177.824520] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5177.835533] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5177.843872] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5177.850815] Lustre: Skipped 1 previous similar message [ 5183.065292] Lustre: server umount lustre-MDT0000 complete [ 5183.457684] LustreError: 158985:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5183.485795] LustreError: 158985:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 5188.503361] LustreError: 158965:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789184542 with bad export cookie 2423712218418434764 [ 5188.515759] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5189.328878] Lustre: server umount lustre-MDT0001 complete [ 5202.523956] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing unload_modules_local [ 5206.133665] Key type lgssc unregistered [ 5206.411960] LNet: 162527:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5206.423775] LNetError: 162527:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5206.439270] LNet: Removed LNI 192.168.202.118@tcp [ 5207.540179] Key type .llcrypt unregistered [ 5207.547937] Key type ._llcrypt unregistered [ 5235.094072] Key type ._llcrypt registered [ 5235.098350] Key type .llcrypt registered [ 5235.278993] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [ 5236.562870] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5236.582621] alg: No test for adler32 (adler32-zlib) [ 5237.626879] Lustre: Lustre: Build Version: 2.17.58_2_g7c2b8e4 [ 5237.877650] LNet: Added LNI 192.168.202.118@tcp [8/256/0/180] [ 5239.584305] Key type lgssc registered [ 5240.999367] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5256.128492] Lustre: DEBUG MARKER: == conf-sanity test 100: check lshowmount lists MGS, MDT, OST and 0@lo ========================================================== 23:43:29 (1789184609) [ 5273.812939] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_hostid [ 5284.048434] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [ 5323.380433] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5323.404664] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5324.738891] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 5324.790786] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 5324.903380] Lustre: lustre-MDT0000: new disk, initializing [ 5324.989045] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5325.018349] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 5331.145968] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 5342.098185] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5342.243838] Lustre: 166788:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 5342.318687] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 5342.322613] Lustre: Skipped 1 previous similar message [ 5342.417115] Lustre: lustre-MDT0001: new disk, initializing [ 5342.499299] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5342.523710] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 5342.527152] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 5347.214330] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 5356.653727] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 5362.407973] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 5368.408318] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5368.651528] Lustre: lustre-OST0000: new disk, initializing [ 5368.656811] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 5368.661434] Lustre: 168758:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 5368.768197] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5374.866417] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 5377.640608] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 5377.665712] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 5377.817203] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 5387.088708] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 5403.621477] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5403.627741] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 5403.639671] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5403.639978] LustreError: Skipped 1 previous similar message [ 5403.655022] Lustre: Skipped 1 previous similar message [ 5405.590933] Lustre: server umount lustre-OST0000 complete [ 5413.857888] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5413.877192] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5413.885182] Lustre: Skipped 2 previous similar messages [ 5416.152736] Lustre: server umount lustre-MDT0000 complete [ 5420.520907] LustreError: 166781:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789184774 with bad export cookie 12606289566664802831 [ 5420.521539] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5420.530087] LustreError: 166781:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 5420.820622] Lustre: server umount lustre-MDT0001 complete [ 5436.996887] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing unload_modules_local [ 5441.519485] Key type lgssc unregistered [ 5441.783652] LNet: 170665:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5441.791617] LNetError: 170665:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5441.812487] LNet: Removed LNI 192.168.202.118@tcp [ 5443.086557] Key type .llcrypt unregistered [ 5443.088711] Key type ._llcrypt unregistered [ 5466.980790] Key type ._llcrypt registered [ 5466.982638] Key type .llcrypt registered [ 5467.074111] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [ 5468.221851] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5468.247060] alg: No test for adler32 (adler32-zlib) [ 5469.209254] Lustre: Lustre: Build Version: 2.17.58_2_g7c2b8e4 [ 5469.449199] LNet: Added LNI 192.168.202.118@tcp [8/256/0/180] [ 5471.151180] Key type lgssc registered [ 5472.139331] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5480.942462] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5480.973410] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5482.395691] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5486.622670] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 5492.709540] LustreError: 172079:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5492.722520] LustreError: 172079:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 5495.822631] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5496.201440] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5500.848829] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 5508.167346] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 5515.415877] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 5524.312682] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5524.773983] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5527.857912] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:33) [ 5531.131883] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 5539.747409] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 5546.437512] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5546.457261] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5546.482338] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5546.496319] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5546.522855] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5547.565351] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5547.590572] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5547.608770] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5547.615552] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5547.636915] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5548.686759] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5548.700861] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5548.711975] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5548.718434] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5548.729593] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5549.577955] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5550.590094] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5551.577897] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5551.584594] Lustre: Skipped 2 previous similar messages [ 5551.606557] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5551.614189] Lustre: Skipped 2 previous similar messages [ 5551.620126] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5551.638953] Lustre: Skipped 2 previous similar messages [ 5551.647384] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5551.665599] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5551.668483] Lustre: Skipped 2 previous similar messages [ 5552.726521] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5553.756533] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5554.754602] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5555.748449] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5555.754972] Lustre: Skipped 3 previous similar messages [ 5555.782347] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5555.792851] Lustre: Skipped 3 previous similar messages [ 5555.796887] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5555.802934] Lustre: Skipped 3 previous similar messages [ 5555.806963] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5555.821393] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5555.825438] Lustre: Skipped 3 previous similar messages [ 5556.864304] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5557.824224] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5558.732792] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5559.786641] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5560.491436] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5561.509920] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5562.394931] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5563.487908] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5564.509357] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5564.514240] Lustre: Skipped 8 previous similar messages [ 5564.534065] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5564.547764] Lustre: Skipped 8 previous similar messages [ 5564.556406] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5564.567029] Lustre: Skipped 8 previous similar messages [ 5564.569647] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5564.584716] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5564.590631] Lustre: Skipped 8 previous similar messages [ 5565.525451] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5566.453190] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5567.311750] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5568.071592] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5568.856796] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5569.476850] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5570.387073] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5571.276137] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5572.313283] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5573.129706] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5573.980035] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5574.918313] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5575.783262] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5576.492185] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5577.410173] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5578.430924] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5579.483663] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5580.277173] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5581.045933] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5581.050640] Lustre: Skipped 18 previous similar messages [ 5581.072663] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5581.085755] Lustre: Skipped 18 previous similar messages [ 5581.089320] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5581.097298] Lustre: Skipped 18 previous similar messages [ 5581.101337] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5581.113645] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5581.123213] Lustre: Skipped 18 previous similar messages [ 5581.861916] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5582.639114] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5583.458993] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5584.339591] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5585.125336] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5586.066483] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5586.947636] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5587.717439] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5588.541351] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5589.384985] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5590.199877] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5590.963328] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5591.795450] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5592.501571] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5593.174245] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5594.063166] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5594.874503] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5595.816637] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5596.594403] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5597.450087] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5598.208651] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5598.867866] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5599.550489] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5600.414121] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5601.021040] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5601.828420] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5602.469481] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5603.414158] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5604.269032] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5605.133394] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5605.879604] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5606.681559] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5607.534643] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5608.428945] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5609.150722] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5610.238651] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5611.218494] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5612.274120] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5613.203733] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5613.208866] Lustre: Skipped 38 previous similar messages [ 5613.226802] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5613.238595] Lustre: Skipped 38 previous similar messages [ 5613.242769] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5613.248824] Lustre: Skipped 38 previous similar messages [ 5613.253342] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5613.265977] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5613.272256] Lustre: Skipped 38 previous similar messages [ 5614.363912] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5615.212506] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5616.334668] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5617.537930] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5618.548523] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5619.347924] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5620.380441] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5621.441966] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5622.371824] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5623.437581] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5624.487619] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5625.456628] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5626.672315] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5627.542234] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5628.357888] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5629.216620] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5630.263968] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5630.998778] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5631.947445] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5632.838158] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5633.964307] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5634.850856] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5636.012595] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5636.932524] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5637.604652] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5638.187770] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5638.936544] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5639.882260] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5640.820479] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5641.639631] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5642.498611] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5643.355655] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5644.152608] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5644.936329] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5645.887617] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5646.843331] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5647.856189] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5648.888518] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5650.004043] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5650.977970] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5651.935346] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5652.696054] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5653.737436] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5654.708918] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5655.534289] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5656.565925] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5657.438756] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5658.244491] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5658.995141] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5659.812342] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5660.651208] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5661.430511] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5662.212629] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5663.086803] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5664.209754] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5665.064216] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5666.093543] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5666.890726] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5667.864359] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5668.687841] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5669.482494] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5670.350216] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5671.344190] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5672.361979] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5673.422623] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5674.276568] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5675.362758] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5676.110446] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5677.048721] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5677.931858] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5677.939670] Lustre: Skipped 69 previous similar messages [ 5677.966775] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5677.987178] Lustre: Skipped 69 previous similar messages [ 5677.996453] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5678.004712] Lustre: Skipped 69 previous similar messages [ 5678.007112] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5678.028779] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5678.047783] Lustre: Skipped 69 previous similar messages [ 5678.983219] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5679.673285] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5680.489834] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5681.290892] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5682.147811] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5683.045392] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5683.968739] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5684.788309] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5685.527418] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5686.261625] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5687.082057] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5687.864217] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5688.732081] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5689.485185] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5690.289418] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5691.052786] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5691.840093] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5692.562128] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5693.450588] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5694.336684] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5695.225323] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5696.207196] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5697.134237] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5698.211795] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5699.100195] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5700.116840] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5701.038634] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5701.781646] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5702.556841] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5703.596116] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5704.549288] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5705.305803] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5706.012406] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5706.746181] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5707.385777] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5708.076059] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5708.924202] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5709.903163] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5710.822682] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5711.711847] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5712.585192] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5713.461223] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5714.234840] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5715.082605] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5716.010967] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5716.873595] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5717.793609] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5718.876029] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5719.759892] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5720.562890] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5721.351591] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5722.116290] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5722.709033] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5723.666041] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5724.640358] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5725.461271] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5726.251570] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5727.031497] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5727.850913] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5728.622233] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5729.523387] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5730.359838] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5731.184233] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5732.012062] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5732.752196] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5733.603309] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5734.438069] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5735.376402] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5736.333560] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5737.342391] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5738.447364] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5739.576788] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5740.514084] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5741.247407] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5741.959275] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5742.831307] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5743.700697] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5744.872347] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5745.811736] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5746.724105] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5747.677715] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5748.567632] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5749.373054] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5750.348084] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5751.497392] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5752.534645] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5753.684436] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5754.772513] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5755.809213] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5756.921819] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5758.138233] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5759.252443] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5760.122565] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5761.339818] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5762.339405] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5763.400935] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5764.233805] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5765.369359] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5766.340846] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5767.292625] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5768.151579] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5769.161794] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5770.094293] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5771.211383] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5772.199095] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5773.436484] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5774.484354] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5775.545588] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5776.440848] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5777.463252] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5778.387367] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5779.403354] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5780.300701] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5781.328347] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5782.380473] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5783.252412] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5784.376702] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5785.613975] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5786.780630] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5788.039247] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5789.227915] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5790.190720] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5791.114855] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5792.071213] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5793.064393] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5794.030404] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5794.927879] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5795.816156] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5796.713220] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5797.644815] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5798.542311] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5799.501506] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5800.342259] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5801.130975] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5802.010338] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5802.929687] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5803.889666] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5804.855181] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5805.610731] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5806.375310] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5806.379977] Lustre: Skipped 139 previous similar messages [ 5806.400881] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5806.408619] Lustre: Skipped 139 previous similar messages [ 5806.413042] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5806.417591] Lustre: Skipped 139 previous similar messages [ 5806.420234] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5806.427971] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5806.434166] Lustre: Skipped 139 previous similar messages [ 5807.201678] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5808.018655] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5808.844718] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5809.797125] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5810.625285] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5811.326082] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5812.162564] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5813.053606] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5813.920256] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5814.906531] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5815.772495] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5816.576264] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5817.380321] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5818.354186] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5819.198211] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5820.107456] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5820.911797] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5821.741442] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5822.733490] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5823.586617] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5824.493633] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5825.464111] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5826.312081] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5827.361915] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5828.083965] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5828.888714] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5829.776924] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5830.908876] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5831.861385] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5832.935125] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5833.781292] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5834.780533] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5835.688491] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5836.826920] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5837.759487] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5838.643277] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5839.498300] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5840.487403] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5841.311446] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5842.368788] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5843.379741] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5844.477512] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5845.503826] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5846.355435] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5847.217802] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5848.056401] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5848.892824] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5849.741986] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5850.606957] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5851.524169] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5852.466555] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5853.347052] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5854.353864] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5855.209588] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5855.996761] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5856.788726] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5857.659647] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5858.527622] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5859.420278] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5860.325722] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5861.114540] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5862.046739] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5862.922807] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5864.055617] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5864.971504] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5866.115419] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5867.050160] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5868.124286] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5869.162116] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5870.099696] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5871.123261] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5872.092337] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5873.108211] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5874.256169] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5875.467904] LustreError: 172099:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 5875.479650] LustreError: 172099:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 5875.487200] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5876.276673] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5877.051269] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5877.911700] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5878.780504] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5879.464957] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5880.364704] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5881.215665] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5881.992337] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5882.778844] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5883.750580] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5884.608542] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5885.615441] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5886.772471] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5887.614626] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5888.700265] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5889.455150] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5890.452100] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5891.218162] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5891.914186] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5892.962957] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5894.229580] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5895.127023] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5896.016340] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5896.825982] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5897.857829] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5898.864775] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5899.841338] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5900.608979] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5901.525964] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5902.423738] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5903.192163] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5904.025971] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5905.039932] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5906.410513] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5907.668188] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5908.835947] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5909.722201] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5910.404805] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5911.607641] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5913.124566] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5914.044895] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5915.384250] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5916.360328] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5917.269766] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5918.425184] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5919.534172] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5920.792652] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5921.565894] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5922.628610] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5923.523343] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5924.585951] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5925.483809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5926.435920] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5927.473519] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5928.579052] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5929.674508] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5931.102946] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5931.965361] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5933.178942] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5934.310906] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5935.069738] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5936.093889] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5937.048865] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5938.302136] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5939.185890] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5940.227772] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5941.134067] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5942.376833] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5943.472765] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5944.370758] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5945.806480] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5947.119392] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5947.942789] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5948.546253] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5949.693548] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5950.834976] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5952.199733] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5953.519777] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5954.999980] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5956.133424] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5957.495665] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5958.765256] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5959.563703] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5960.592223] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5961.665455] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5962.654276] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5963.731542] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5964.813434] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5965.458543] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5965.983625] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5966.437454] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5967.104579] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5968.409556] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5969.253388] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5970.404303] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5971.370978] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5972.628205] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5973.683599] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5975.109070] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5976.207106] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5976.843638] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5977.964662] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5978.893246] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5979.817566] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5980.816887] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5982.074164] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5983.228377] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5984.448465] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5985.732347] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5986.752651] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5987.724065] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5988.613492] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5989.719515] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5990.735367] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5991.592467] LustreError: 172099:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 5991.610357] LustreError: 172099:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 5991.631052] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5993.041932] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5994.071463] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5995.347071] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5996.773089] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5998.254327] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6000.019329] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6001.533223] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6002.600415] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6003.746971] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6004.886498] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6005.955233] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6007.081514] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6008.154381] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6009.380454] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6010.501415] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6011.873743] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6012.971862] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6014.323856] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6015.442543] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6016.393178] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6017.477327] LustreError: 172099:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 6017.488144] LustreError: 172099:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 6017.501373] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6018.724386] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6019.665785] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6020.719305] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6021.668332] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6022.668289] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6023.568575] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6024.581894] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6025.698883] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6026.688649] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6027.975348] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6028.842268] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6029.855653] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6030.856806] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6031.942145] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6032.920218] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6034.037077] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6034.926755] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6035.941088] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6036.819779] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6037.848959] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6038.899704] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6039.957062] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6041.012763] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6042.000722] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6043.237783] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6044.251576] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6045.422168] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6046.578884] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6047.765427] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6048.654229] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6049.689230] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6050.842786] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6051.968759] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6053.208488] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6054.426661] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6055.347648] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6056.263559] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6057.376541] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6058.437470] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6059.484811] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6060.656390] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6061.613847] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6062.644125] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 6062.652818] Lustre: Skipped 253 previous similar messages [ 6062.680646] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6062.689259] Lustre: Skipped 253 previous similar messages [ 6062.692451] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 6062.696978] Lustre: Skipped 253 previous similar messages [ 6062.700953] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6062.709799] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 6062.715689] Lustre: Skipped 253 previous similar messages [ 6063.709546] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6064.742842] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6065.836885] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6066.909440] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6067.928523] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6068.988432] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6069.751761] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6070.788378] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6071.642174] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6072.799606] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6073.659631] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6074.610422] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6075.658181] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6076.745358] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6078.040728] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6079.147468] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6080.101767] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6081.149291] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6082.292377] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6083.488739] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6084.735724] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6085.942160] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6087.009389] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6088.144086] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6089.295947] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6090.320647] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6091.446359] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6092.396903] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6093.323124] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6094.428676] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6095.346897] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6096.352392] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6097.237479] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6098.278660] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6099.131447] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6100.206196] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6101.180524] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6102.235582] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6103.355475] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6104.275845] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6105.338481] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6106.411285] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6107.757091] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6108.744550] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6109.873166] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6110.828663] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6111.990236] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6112.888847] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6114.115151] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6115.227181] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6116.244522] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6117.296037] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6118.344548] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6119.442782] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6120.662252] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6121.752087] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6122.858457] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6123.856793] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6124.794716] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6125.768238] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6126.890076] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6127.903187] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6129.027909] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6130.151636] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6131.095155] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6132.319850] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6133.315755] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6134.486168] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6135.512959] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6136.441987] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6137.734442] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6138.823462] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6139.840682] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6140.803547] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6141.815796] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6142.901867] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6143.924697] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6144.881191] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6145.975792] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6147.031661] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6148.143872] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6149.323901] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6150.354487] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6151.327455] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6152.353658] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6153.435740] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6154.793896] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6155.703743] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6156.826551] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6157.797408] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6158.889621] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6159.979414] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6161.271510] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6162.317362] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6163.378513] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6164.296551] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6165.219712] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6166.169372] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6167.270097] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6168.219302] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6169.320876] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6170.167141] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6171.028360] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6171.732805] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6172.371725] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6173.405847] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6174.214487] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6175.019813] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6176.052295] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6177.283167] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6178.437650] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6179.751048] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6181.154180] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6182.611121] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6183.599160] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6184.622922] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6185.461044] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6186.448974] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6187.393275] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6188.300046] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6189.152209] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6190.105426] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6190.930368] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6191.984624] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6193.205765] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6194.427561] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6195.402884] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6196.466913] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6197.734282] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6199.007280] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6200.257366] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6201.412525] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6202.477507] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6203.697382] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6204.617753] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6205.796636] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6206.985636] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6208.156087] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6208.966292] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6210.080897] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6211.145339] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6212.294699] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6213.268146] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6214.265800] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6215.237090] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6216.282942] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6217.151536] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6218.048715] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6218.999534] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6220.047306] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6220.732726] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6221.483121] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6222.448946] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6223.306931] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6224.141135] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6225.035954] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6225.926045] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6227.086151] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6228.181242] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6228.928190] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6229.708976] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6230.486332] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6231.489639] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6232.562123] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6233.385742] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6234.352128] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6235.240405] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6236.383910] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6237.305802] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6238.349721] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6239.308157] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6240.324928] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6241.181093] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6242.041951] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6242.852062] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6244.017238] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6244.851909] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6245.705900] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6246.453588] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6247.571032] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6248.525295] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6249.462949] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6250.390969] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6251.326900] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6252.370615] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6253.436800] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6254.493433] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6255.581355] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6256.487605] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6257.448149] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6258.430805] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6259.482558] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6260.405800] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6261.325932] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6262.116732] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6263.082169] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6263.869025] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6265.007248] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6266.031186] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6267.191414] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6268.119184] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6269.124666] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6270.239445] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6271.488861] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6272.445070] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6273.358885] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6274.242827] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6275.426202] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6276.689186] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6277.847305] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6279.059929] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6279.920646] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6280.870670] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6281.691575] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6282.720907] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6283.793085] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6284.757289] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6285.570899] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6286.642541] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6287.691856] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6288.765611] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6290.016983] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6290.998177] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6292.012766] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6293.042318] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6294.218340] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6295.365887] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6296.376886] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6297.513739] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6298.864247] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6300.257623] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6301.610356] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6302.692029] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6303.849524] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6304.782807] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6305.787941] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6307.368502] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6308.216524] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6309.212711] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6310.482422] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6311.358315] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6312.297400] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6313.187333] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6314.289844] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6315.167176] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6316.340578] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6317.405195] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6318.393362] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6319.231680] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6320.224785] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6321.008419] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6321.857129] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6322.754566] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6323.741365] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6324.573988] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6325.533565] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6326.339272] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6327.286693] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6328.231610] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6329.227642] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6330.082933] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6331.016642] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6331.947392] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6332.863694] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6333.668494] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6334.818618] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6335.905415] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6336.866133] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6337.790890] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6338.727983] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6339.710090] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6340.898993] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6342.030994] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6343.127467] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6344.136562] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6345.101630] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6346.036111] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6347.099807] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6348.124447] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6349.157257] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6350.107775] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6351.182681] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6352.236600] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6353.286933] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6354.296796] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6355.462579] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6356.588149] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6357.694443] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6358.733043] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6359.619223] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6360.596418] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6361.599561] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6362.385835] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6363.321212] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6364.210980] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6365.297787] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6366.489441] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6367.471041] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6368.492431] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6369.552381] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6370.555850] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6371.595336] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6372.644218] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6373.728654] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6374.734463] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6375.672974] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6376.728088] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6377.695771] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6378.781609] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6379.829883] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6380.972509] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6382.147676] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6383.439256] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6384.509690] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6385.554024] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6386.434887] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6387.318928] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6388.438981] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6389.522765] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6390.438251] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6391.345636] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6392.412054] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6393.125700] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6393.900871] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6394.911523] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6395.863298] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6396.900769] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6397.778567] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6398.774877] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6400.050466] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6401.185068] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6402.364713] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6403.741313] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6404.958352] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6406.053603] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6407.583185] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6409.153791] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6410.360044] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6411.762281] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6412.731750] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6414.142179] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6415.613439] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6416.879201] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6418.246339] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6419.572495] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6420.464674] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6421.744373] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6422.750366] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6423.894580] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6425.140494] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6426.170069] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6427.053163] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6428.014289] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6429.192622] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6430.185496] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6431.331638] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6432.437943] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6433.506986] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6434.563988] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6435.509060] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6436.665042] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6437.613421] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6438.748296] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6439.935749] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6441.020780] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6442.293777] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6443.301789] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6444.378612] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6445.502164] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6446.253243] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6447.125047] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6448.146973] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6449.023823] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6449.848945] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6451.259490] LustreError: 172099:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 6451.275059] LustreError: 172099:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 6451.296089] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6452.285097] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6453.277691] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6454.148518] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6455.076209] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6455.774664] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6456.770644] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6457.820936] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6458.785587] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6460.120985] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6461.351094] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6463.040145] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6464.398504] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6465.721976] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6466.762759] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6468.376177] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6469.552099] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6471.015709] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6472.408951] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6474.002664] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6475.056299] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6475.996809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6476.876250] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6477.851393] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6478.999640] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6480.417388] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6481.305975] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6482.421964] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6483.328621] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6484.422238] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6485.361772] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6486.318940] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6487.343798] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6488.338552] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6489.274051] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6490.523385] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6491.575249] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6492.663313] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6493.761628] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6494.826126] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6495.743081] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6496.922383] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6497.876495] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6498.844612] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6499.599314] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6500.668668] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6501.624947] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6502.669115] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6503.778335] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6504.649776] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6505.726488] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6506.688934] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6507.831451] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6508.777559] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6509.823551] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6510.657705] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6511.678341] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6512.717775] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6513.829947] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6514.654276] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6515.592779] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6516.566776] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6517.378725] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6518.161072] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6519.144602] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6520.246274] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6521.067290] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6522.028648] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6522.859644] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6523.645116] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6524.803633] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6525.695858] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6526.772678] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6527.643850] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6528.673824] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6529.829315] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6530.742224] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6532.016894] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6533.201883] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6534.434328] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6535.400311] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6536.488066] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6537.496294] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6538.561729] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6539.678088] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6952.135126] LustreError: 173900:0:(ofd_dev.c:1780:ofd_create_hdl()) lustre-OST0000: unable to precreate: rc = -28 [ 6952.146586] LustreError: 172099:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -28 [ 7445.984968] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 7445.994471] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7446.009986] Lustre: Skipped 459 previous similar messages [ 7446.016976] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7449.063358] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 7449.065213] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7449.083172] Lustre: Skipped 1 previous similar message [ 7450.892102] Lustre: server umount lustre-OST0000 complete [ 7454.194923] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7459.297481] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7459.300378] Lustre: Skipped 2 previous similar messages [ 7460.215851] Lustre: server umount lustre-MDT0000 complete [ 7463.105240] LustreError: 172060:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789186817 with bad export cookie 13675174966736205348 [ 7463.113520] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7463.123933] LustreError: 172060:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 7463.390901] Lustre: server umount lustre-MDT0001 complete [ 7471.252486] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing unload_modules_local [ 7473.759720] Key type lgssc unregistered [ 7474.005508] LNet: 227331:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7474.012547] LNetError: 227331:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7474.027669] LNet: Removed LNI 192.168.202.118@tcp [ 7474.641703] Key type .llcrypt unregistered [ 7474.644507] Key type ._llcrypt unregistered [ 7492.517668] Key type ._llcrypt registered [ 7492.519360] Key type .llcrypt registered [ 7492.582234] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [ 7493.138776] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7493.253031] alg: No test for adler32 (adler32-zlib) [ 7494.299365] Lustre: Lustre: Build Version: 2.17.58_2_g7c2b8e4 [ 7494.527819] LNet: Added LNI 192.168.202.118@tcp [8/256/0/180] [ 7496.135159] Key type lgssc registered [ 7496.941480] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7503.016870] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7503.029537] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7504.625273] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7508.328820] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 7514.090226] LustreError: 228722:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7514.117377] LustreError: 228722:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 7516.111661] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7516.514672] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7520.133989] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 7526.129891] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 7530.810211] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 7535.866236] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7536.083891] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7540.259724] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 7545.832515] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 7549.431619] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49665 to 0x280000401:49696) [ 7554.223763] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 7555.524051] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7555.536523] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 7555.542935] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7555.558413] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 7555.561828] LustreError: 228742:0:(osp_precreate.c:1268:osp_precreate_thread()) cfs_fail_timeout id 2107 sleeping for 20000ms [ 7560.673717] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7560.684248] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7560.686463] Lustre: Skipped 1 previous similar message [ 7561.692636] Lustre: lustre-OST0000: Not available for connect from 192.168.202.18@tcp (stopping) [ 7561.703158] Lustre: Skipped 1 previous similar message [ 7563.230910] Lustre: server umount lustre-OST0000 complete [ 7575.575208] LustreError: 228742:0:(osp_precreate.c:1268:osp_precreate_thread()) cfs_fail_timeout id 2107 awake [ 7595.097726] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7595.350048] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7600.016667] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 7600.488494] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7600.494446] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 7600.494804] LustreError: lustre-OST0000-osc-MDT0001: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 7604.880659] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 7605.980477] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec [ 7610.227132] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff915a38350800.ost_server_uuid 50 [ 7611.525275] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff915a38350800.ost_server_uuid in FULL state after 0 sec [ 7615.969548] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7615.974202] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 7615.974632] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7615.989498] Lustre: Skipped 1 previous similar message [ 7620.530434] Lustre: server umount lustre-OST0000 complete [ 7624.160728] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7624.168796] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7624.187206] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7624.192550] Lustre: Skipped 1 previous similar message [ 7630.093742] Lustre: server umount lustre-MDT0000 complete [ 7631.331219] LustreError: 228723:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7631.353243] LustreError: 228723:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 7633.624395] LustreError: 228702:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789186987 with bad export cookie 8718514389484860542 [ 7633.629305] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7633.639805] LustreError: 228702:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 7633.979829] Lustre: server umount lustre-MDT0001 complete [ 7642.583528] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing unload_modules_local [ 7644.642319] Key type lgssc unregistered [ 7644.873662] LNet: 233927:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7644.878861] LNetError: 233927:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7644.891440] LNet: Removed LNI 192.168.202.118@tcp [ 7645.565115] Key type .llcrypt unregistered [ 7645.569324] Key type ._llcrypt unregistered [ 7669.156396] Key type ._llcrypt registered [ 7669.158698] Key type .llcrypt registered [ 7669.237155] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [ 7669.929831] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7669.972298] alg: No test for adler32 (adler32-zlib) [ 7670.971474] Lustre: Lustre: Build Version: 2.17.58_2_g7c2b8e4 [ 7671.199607] LNet: Added LNI 192.168.202.118@tcp [8/256/0/180] [ 7672.831177] Key type lgssc registered [ 7673.720234] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7680.283850] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7680.297220] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7681.662252] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7685.022992] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 7691.194122] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7691.232556] LustreError: 235632:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7691.254585] LustreError: 235632:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 7691.471769] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7694.601996] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 7696.900435] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 7702.149257] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7702.480639] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7706.614852] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49728) [ 7707.071503] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 7713.707107] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7713.869785] Lustre: lustre-OST0001: new disk, initializing [ 7713.873892] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 7713.880811] Lustre: 237942:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 7713.985663] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 7719.222382] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 7719.473621] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 7719.486520] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 7719.579696] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 7728.215578] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 7735.693863] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 7750.639873] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7750.641400] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7750.656822] Lustre: Skipped 2 previous similar messages [ 7750.662654] Lustre: Skipped 1 previous similar message [ 7754.892796] Lustre: server umount lustre-MDT0000 complete [ 7755.750356] LustreError: 235627:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7755.761720] LustreError: 235627:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [ 7757.421852] LustreError: 235611:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789187111 with bad export cookie 15282137389191130827 [ 7757.428764] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7757.434023] LustreError: 235611:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 7757.648851] Lustre: server umount lustre-MDT0001 complete [ 7770.139356] Lustre: server umount lustre-OST0000 complete [ 7783.573514] Lustre: server umount lustre-OST0001 complete [ 7797.499599] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [ 7804.547580] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7804.937748] LustreError: 241048:0:(ldlm_lib.c:1190:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7805.004465] Lustre: mylustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7808.775388] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 7810.017205] LustreError: 241049:0:(ldlm_lib.c:1190:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7814.823042] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7815.037272] Lustre: mylustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7817.281200] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 7819.298929] Lustre: 242191:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 7823.846253] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7825.124695] LustreError: 242647:0:(ldlm_lib.c:1190:target_handle_connect()) mylustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7825.129152] Lustre: mylustre-OST0000: new connection from mylustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:99 to 0x280000400:129) [ 7828.399946] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 7831.539717] Lustre: mylustre-OST0000: new connection from mylustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49760) [ 7834.851038] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7835.088137] Lustre: mylustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 7835.090900] Lustre: Skipped 1 previous similar message [ 7840.271481] Lustre: mylustre-OST0001: new connection from mylustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:3 to 0x2c0000400:33) [ 7840.406394] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 7846.529237] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 7849.223572] Lustre: 244060:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 7858.853234] Lustre: server umount mylustre-MDT0000 complete [ 7860.711834] Lustre: mylustre-MDT0000-osp-MDT0001: Connection to mylustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7860.715405] LustreError: 243873:0:(ldlm_lib.c:1190:target_handle_connect()) mylustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7860.724024] Lustre: Skipped 4 previous similar messages [ 7860.735116] LustreError: 243873:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 5 previous similar messages [ 7861.453044] LustreError: 241024:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789187215 with bad export cookie 15282137389191133690 [ 7861.458548] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7861.462970] LustreError: 241024:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 5 previous similar messages [ 7861.715476] Lustre: server umount mylustre-MDT0001 complete [ 7874.099806] Lustre: server umount mylustre-OST0000 complete [ 7886.140569] Lustre: server umount mylustre-OST0001 complete [ 7898.562924] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [ 7905.164491] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7905.478906] LustreError: 246364:0:(ldlm_lib.c:1190:target_handle_connect()) tfs-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7905.539978] Lustre: tfs-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7908.786506] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 7914.283960] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7916.854633] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 7918.607377] Lustre: 247507:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 7922.496045] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7924.730627] Lustre: tfs-OST0000: new connection from tfs-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:131 to 0x280000400:161) [ 7926.849450] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 7930.860339] Lustre: tfs-OST0000: new connection from tfs-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49792) [ 7933.112952] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7937.492481] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 7938.546717] Lustre: tfs-OST0001: new connection from tfs-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:3 to 0x2c0000400:65) [ 7942.995258] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 7945.069645] Lustre: 249374:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 7950.306217] LustreError: tfs-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7950.317274] Lustre: tfs-MDT0000-osp-MDT0001: Connection to tfs-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7950.328135] Lustre: tfs-MDT0000: Not available for connect from 0@lo (stopping) [ 7950.335451] Lustre: Skipped 2 previous similar messages [ 7953.895088] Lustre: tfs-MDT0000: Not available for connect from 0@lo (stopping) [ 7953.896125] Lustre: tfs-MDT0000-lwp-MDT0001: Connection to tfs-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7953.905547] Lustre: Skipped 1 previous similar message [ 7955.434413] Lustre: server umount tfs-MDT0000 complete [ 7958.001116] LustreError: 246341:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789187312 with bad export cookie 15282137389191135867 [ 7958.011741] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7958.017473] LustreError: 246341:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 7958.221788] Lustre: server umount tfs-MDT0001 complete [ 7971.556895] Lustre: server umount tfs-OST0000 complete [ 7983.932583] Lustre: server umount tfs-OST0001 complete [ 7995.902843] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [ 8001.197934] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8001.478614] LustreError: 251622:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8001.494992] LustreError: 251622:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 5 previous similar messages [ 8001.529210] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8001.533236] Lustre: Skipped 3 previous similar messages [ 8003.751254] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 8008.924351] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8011.449590] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 8013.407425] Lustre: 252766:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 8017.471470] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8019.755689] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:131 to 0x280000400:193) [ 8021.122593] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 8026.097317] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49824) [ 8026.795653] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8030.490482] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 8032.250713] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:3 to 0x2c0000400:97) [ 8035.423471] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 8037.327444] Lustre: 254633:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 8041.042600] Lustre: DEBUG MARKER: == conf-sanity test 104a: Make sure user defined options are reflected in mount ========================================================== 00:29:55 (1789187395) [ 8055.267172] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8055.279243] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8055.289765] Lustre: Skipped 1 previous similar message [ 8055.293951] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8055.297773] Lustre: Skipped 3 previous similar messages [ 8060.600647] Lustre: server umount lustre-MDT0000 complete [ 8063.510868] LustreError: 251598:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789187417 with bad export cookie 15282137389191137785 [ 8063.516439] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8063.518232] LustreError: 251598:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 8068.065915] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8068.066211] LustreError: 251617:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8068.072960] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 8068.072972] Lustre: Skipped 4 previous similar messages [ 8068.079235] Lustre: Skipped 4 previous similar messages [ 8068.099254] LustreError: 251617:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 10 previous similar messages [ 8069.826136] Lustre: server umount lustre-MDT0001 complete [ 8078.306294] Lustre: server umount lustre-OST0000 complete [ 8095.199159] Lustre: lustre-OST0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 8095.291754] Lustre: server umount lustre-OST0001 complete [ 8097.901952] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_hostid [ 8101.844581] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [ 8119.149839] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8119.251263] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 8119.270205] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 8119.318619] Lustre: lustre-MDT0000: new disk, initializing [ 8119.391881] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 8121.595616] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 8127.448143] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8127.533353] Lustre: 257811:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8127.568191] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 8127.570638] Lustre: Skipped 1 previous similar message [ 8127.615895] Lustre: lustre-MDT0001: new disk, initializing [ 8127.689244] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 8127.699619] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 8130.189454] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 8136.879824] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8137.056277] Lustre: lustre-OST0000: new disk, initializing [ 8137.059648] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 8137.065156] Lustre: 259393:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8137.140562] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8137.142832] Lustre: Skipped 5 previous similar messages [ 8138.443400] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 8138.451386] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 8138.509922] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 8140.738584] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 8148.615091] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8148.770295] Lustre: lustre-OST0001: new disk, initializing [ 8148.772202] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 8148.776664] Lustre: 260263:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8150.488615] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 8150.495781] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 8150.571245] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 8152.973360] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 8160.636797] Lustre: DEBUG MARKER: == conf-sanity test 104b: Mount uses last flock argument ========================================================== 00:31:54 (1789187514) [ 8168.878150] Lustre: DEBUG MARKER: == conf-sanity test 105: check file creation for ro and rw bind mnt pt ========================================================== 00:32:02 (1789187522) [ 8184.800441] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 8184.801619] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8184.807215] LustreError: Skipped 1 previous similar message [ 8184.810196] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8184.822353] Lustre: Skipped 1 previous similar message [ 8184.840336] Lustre: Skipped 2 previous similar messages [ 8187.467612] Lustre: server umount lustre-OST0000 complete [ 8195.720616] Lustre: server umount lustre-MDT0000 complete [ 8196.579517] LustreError: 260789:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8196.587987] LustreError: 260789:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 4 previous similar messages [ 8198.055624] LustreError: 258606:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789187552 with bad export cookie 15282137389191139563 [ 8198.060682] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8198.063648] LustreError: 258606:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 8201.699523] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 8201.704718] Lustre: Skipped 5 previous similar messages [ 8204.294992] Lustre: server umount lustre-MDT0001 complete [ 8210.413981] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing unload_modules_local [ 8284.584608] Lustre: server umount lustre-OST0001 complete [ 8287.447101] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_hostid [ 8296.165869] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [ 8317.337679] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8317.497518] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 8317.518879] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 8317.576709] Lustre: lustre-MDT0000: new disk, initializing [ 8317.635015] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 8320.177982] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 8327.290873] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8327.378343] Lustre: 265091:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8327.561940] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 8330.236348] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 8336.720148] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 8340.816674] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 8345.727117] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8345.896808] Lustre: lustre-OST0000: new disk, initializing [ 8345.899427] Lustre: Skipped 1 previous similar message [ 8345.902077] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 8345.904848] Lustre: Skipped 2 previous similar messages [ 8345.909338] Lustre: 267058:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8347.678660] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 8347.688511] Lustre: Skipped 1 previous similar message [ 8347.691534] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 8347.800598] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 8350.832382] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 8358.023601] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 8362.985670] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 8362.989420] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8362.996384] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8363.001261] Lustre: Skipped 5 previous similar messages [ 8363.014712] Lustre: Skipped 1 previous similar message [ 8368.357657] Lustre: server umount lustre-OST0000 complete [ 8376.577111] Lustre: server umount lustre-MDT0000 complete [ 8378.570189] LustreError: 265083:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789187732 with bad export cookie 15282137389191141033 [ 8378.578445] LustreError: 265083:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 8378.579174] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8378.773452] Lustre: server umount lustre-MDT0001 complete [ 8386.238229] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing unload_modules_local [ 8387.759362] Key type lgssc unregistered [ 8387.962986] LNet: 268817:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8387.966066] LNetError: 268817:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8387.981435] LNet: Removed LNI 192.168.202.118@tcp [ 8388.421151] Key type .llcrypt unregistered [ 8388.423049] Key type ._llcrypt unregistered [ 8403.885748] Key type ._llcrypt registered [ 8403.888526] Key type .llcrypt registered [ 8403.960691] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [ 8404.675379] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8404.790440] alg: No test for adler32 (adler32-zlib) [ 8405.801922] Lustre: Lustre: Build Version: 2.17.58_2_g7c2b8e4 [ 8406.005091] LNet: Added LNI 192.168.202.118@tcp [8/256/0/180] [ 8407.631884] Key type lgssc registered [ 8408.397818] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8413.473508] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 8413.488629] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8414.766673] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8417.517825] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 8423.532860] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8423.801225] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8426.870303] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 8431.553558] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 8434.497978] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 8438.699806] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8438.896410] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8439.919158] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:33) [ 8443.043204] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 8447.427071] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 8448.017624] Lustre: Setting parameter lustre-OST0000.ost.unknown_param=50 in log lustre-OST0000 [ 8450.528186] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 8450.531509] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8450.537388] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8453.603501] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 8453.605180] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8453.605353] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8453.616970] Lustre: Skipped 1 previous similar message [ 8455.244600] Lustre: server umount lustre-OST0000 complete [ 8458.720339] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8458.723452] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8458.726608] Lustre: Skipped 1 previous similar message [ 8463.731067] Lustre: server umount lustre-MDT0000 complete [ 8463.840143] LustreError: 271470:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8463.852300] LustreError: 271470:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [ 8466.021380] LustreError: 270250:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789187820 with bad export cookie 13270883545026574438 [ 8466.022171] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8466.031671] LustreError: 270250:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 8466.261918] Lustre: server umount lustre-MDT0001 complete [ 8472.978959] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing unload_modules_local [ 8474.635339] Key type lgssc unregistered [ 8474.798703] LNet: 273847:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8474.804641] LNetError: 273847:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8474.816407] LNet: Removed LNI 192.168.202.118@tcp [ 8475.342468] Key type .llcrypt unregistered [ 8475.345163] Key type ._llcrypt unregistered [ 8485.664944] Key type ._llcrypt registered [ 8485.667206] Key type .llcrypt registered [ 8485.738588] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [ 8486.375055] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8486.390341] alg: No test for adler32 (adler32-zlib) [ 8487.347815] Lustre: Lustre: Build Version: 2.17.58_2_g7c2b8e4 [ 8487.538720] LNet: Added LNI 192.168.202.118@tcp [8/256/0/180] [ 8489.167183] Key type lgssc registered [ 8489.752379] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8495.249879] Lustre: lustre-OST0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 8495.259738] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8510.751548] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 8515.871327] LustreError: 275016:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.202.118@tcp: failed processing log, type 4: rc = -110 [ 8542.495608] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8546.561082] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 8550.850690] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 8552.524257] Lustre: server umount lustre-OST0000 complete [ 8561.934792] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing unload_modules_local [ 8563.567633] Key type lgssc unregistered [ 8563.775352] LNet: 276646:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8563.786464] LNetError: 276646:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8563.817123] LNet: Removed LNI 192.168.202.118@tcp [ 8564.393858] Key type .llcrypt unregistered [ 8564.396906] Key type ._llcrypt unregistered [ 8587.745452] Key type ._llcrypt registered [ 8587.747557] Key type .llcrypt registered [ 8587.821221] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [ 8588.552157] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8588.598528] alg: No test for adler32 (adler32-zlib) [ 8589.558090] Lustre: Lustre: Build Version: 2.17.58_2_g7c2b8e4 [ 8589.749561] LNet: Added LNI 192.168.202.118@tcp [8/256/0/180] [ 8591.367171] Key type lgssc registered [ 8592.052703] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8600.386960] loop0: detected capacity change from 0 to 204800000 [ 8600.514624] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8600.524459] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8600.772311] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8601.409461] loop0: detected capacity change from 0 to 204800000 [ 8601.517256] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8601.523577] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8601.681650] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8602.197557] loop0: detected capacity change from 0 to 204800000 [ 8602.273805] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8602.281099] blk_update_request: operation not supported error, dev loop0, sector 8224 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8602.336699] blk_update_request: operation not supported error, dev loop0, sector 58264 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8602.926379] loop0: detected capacity change from 0 to 204800000 [ 8603.014434] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 8603.601755] loop0: detected capacity change from 0 to 204800000 [ 8603.615746] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 8605.967931] loop0: detected capacity change from 0 to 204800000 [ 8605.984964] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 8608.408444] loop0: detected capacity change from 0 to 204800000 [ 8608.424460] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 8610.544967] loop0: detected capacity change from 0 to 204800000 [ 8610.572282] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 8612.716141] loop0: detected capacity change from 0 to 204800000 [ 8612.753433] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 8612.786278] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8612.857671] Lustre: 280030:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 8612.867523] Lustre: 280030:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index 'nodemap' with [0x200000003:0x3:0x0]: rc = 0 [ 8612.873916] Lustre: 280030:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000003:0xb:0x0]: rc = 0 [ 8612.879379] Lustre: 280030:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000-MDT0000' with [0x200000005:0x2:0x0]: rc = 0 [ 8612.886131] Lustre: 280030:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000-MDT0000' with [0x200000005:0x3:0x0]: rc = 0 [ 8612.891795] Lustre: 280030:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000003:0xc:0x0]: rc = 0 [ 8612.896821] Lustre: 280030:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000003:0xa:0x0]: rc = 0 [ 8612.902246] Lustre: 280030:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000-MDT0000' with [0x200000005:0x1:0x0]: rc = 0 [ 8612.907888] Lustre: 280030:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2020000' with [0x200000006:0x2020000:0x0]: rc = 0 [ 8612.912727] Lustre: 280030:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1020000' with [0x200000006:0x1020000:0x0]: rc = 0 [ 8612.918565] Lustre: 280030:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x20000' with [0x200000006:0x20000:0x0]: rc = 0 [ 8612.923971] Lustre: 280030:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000006:0x1010000:0x0]: rc = 0 [ 8612.929405] Lustre: 280030:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000006:0x2010000:0x0]: rc = 0 [ 8612.935559] Lustre: 280030:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000006:0x10000:0x0]: rc = 0 [ 8616.521826] Lustre: server umount MGS complete [ 8617.035991] loop0: detected capacity change from 0 to 204800000 [ 8617.077119] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8617.286195] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8617.315091] Lustre: lustre-MDT0000: Aborting client recovery [ 8617.825888] loop1: detected capacity change from 0 to 204800000 [ 8617.877611] LDISKFS-fs (loop1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8617.933807] Lustre: 280459:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 8617.938712] Lustre: 280459:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x1010000' with [0x200000003:0x5:0x0]: rc = 0 [ 8617.947606] Lustre: 280459:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x2010000-MDT0001' with [0x200000005:0x3:0x0]: rc = 0 [ 8617.955141] Lustre: 280459:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x10000-MDT0001' with [0x200000005:0x1:0x0]: rc = 0 [ 8617.961368] Lustre: 280459:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x1010000-MDT0001' with [0x200000005:0x2:0x0]: rc = 0 [ 8617.973255] Lustre: 280459:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x2010000' with [0x200000003:0x6:0x0]: rc = 0 [ 8617.979252] Lustre: 280459:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x10000' with [0x200000003:0x4:0x0]: rc = 0 [ 8617.990767] Lustre: Found index 1 for lustre-MDT0001, updating log [ 8618.087626] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8618.114569] Lustre: lustre-MDT0001: Aborting client recovery [ 8618.613666] loop2: detected capacity change from 0 to 204800000 [ 8618.667585] LDISKFS-fs (loop2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8618.718948] Lustre: 280537:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 8618.734665] Lustre: 280537:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x2020000-OST0000' with [0x200000005:0x3:0x0]: rc = 0 [ 8618.752419] Lustre: 280537:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x1020000-OST0000' with [0x200000005:0x2:0x0]: rc = 0 [ 8618.765524] Lustre: 280537:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x20000-OST0000' with [0x200000005:0x1:0x0]: rc = 0 [ 8618.772582] Lustre: 280537:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 8618.779663] Lustre: 280537:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 8618.785677] Lustre: 280537:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 8618.852731] Lustre: Found index 0 for lustre-OST0000, updating log [ 8618.869305] Lustre: 280556:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8618.921821] Lustre: lustre-OST0000: Aborting recovery [ 8619.423346] loop3: detected capacity change from 0 to 204800000 [ 8619.487085] LDISKFS-fs (loop3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8619.527964] Lustre: 280621:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 8619.534329] Lustre: 280621:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x20000-OST0001' with [0x200000005:0x1:0x0]: rc = 0 [ 8619.540594] Lustre: 280621:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 8619.548524] Lustre: 280621:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 8619.556065] Lustre: 280621:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x1020000-OST0001' with [0x200000005:0x2:0x0]: rc = 0 [ 8619.559962] Lustre: 280621:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 8619.563547] Lustre: 280621:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x2020000-OST0001' with [0x200000005:0x3:0x0]: rc = 0 [ 8619.582909] Lustre: 280627:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8619.616766] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 8619.620587] Lustre: Skipped 1 previous similar message [ 8619.633489] Lustre: lustre-OST0001: Aborting recovery [ 8625.170177] LustreError: 280403:0:(lod_dev.c:511:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 8, retries 0, failed: rc = -108 [ 8627.171080] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 8627.182746] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 8627.188103] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000bd0 [ 8627.204582] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000bd0 [ 8628.194681] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:5 to 0x280000400:33) [ 8628.195597] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:5 to 0x2c0000400:33) [ 8632.259937] LustreError: 280370:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0000: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0000 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0000/identity_upcall, time 2973us: rc = -2 [ 8632.762248] LustreError: 280367:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0001: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0001 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0001/identity_upcall, time 567us: rc = -2 [ 8632.782120] LustreError: 280367:0:(mdt_identity.c:115:mdt_identity_do_upcall()) Skipped 34 previous similar messages [ 8648.671609] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8648.673232] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8648.677032] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8648.688026] Lustre: Skipped 2 previous similar messages [ 8648.693458] Lustre: Skipped 3 previous similar messages [ 8653.791966] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8653.795664] Lustre: Skipped 3 previous similar messages [ 8658.399940] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 8658.537995] Lustre: server umount lustre-MDT0000 complete [ 8658.918854] LustreError: 280372:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8658.929938] LustreError: 280372:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 5 previous similar messages [ 8659.112457] LustreError: 280555:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789188013 with bad export cookie 16825652114580797671 [ 8659.117769] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8659.127734] LustreError: 280555:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 8664.031907] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8664.032069] LustreError: 280369:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8664.032462] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 8664.041874] Lustre: Skipped 2 previous similar messages [ 8664.052803] LustreError: 280369:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 8665.422767] Lustre: server umount lustre-MDT0001 complete [ 8672.100686] Lustre: server umount lustre-OST0000 complete [ 8678.707620] Lustre: server umount lustre-OST0001 complete [ 8683.050598] Lustre: DEBUG MARKER: == conf-sanity test 109a: test lctl clear_conf fsname ==== 00:40:37 (1789188037) [ 8697.303715] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_hostid [ 8703.307920] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [ 8722.860900] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8722.997302] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 8723.028834] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 8723.073994] Lustre: lustre-MDT0000: new disk, initializing [ 8723.164969] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8723.181841] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 8725.369622] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 8731.596000] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8731.677709] Lustre: 284691:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8731.712908] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 8731.716396] Lustre: Skipped 1 previous similar message [ 8731.764654] Lustre: lustre-MDT0001: new disk, initializing [ 8731.825549] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8731.850734] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 8731.857987] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 8734.156806] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 8740.628719] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 8744.491819] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 8748.869033] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8749.087712] Lustre: lustre-OST0000: new disk, initializing [ 8749.090748] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 8749.097395] Lustre: 286659:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8749.152871] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8752.638444] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 8757.777813] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 8757.783258] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 8757.878137] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 8757.894068] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 8760.937615] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 8765.643521] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 8774.755319] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 8814.051791] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 8814.052719] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8814.055864] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8814.059804] Lustre: Skipped 1 previous similar message [ 8814.062154] Lustre: Skipped 1 previous similar message [ 8818.601162] Lustre: server umount lustre-OST0000 complete [ 8824.288791] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8824.288959] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8824.290756] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8824.290762] Lustre: Skipped 1 previous similar message [ 8824.302071] Lustre: Skipped 1 previous similar message [ 8827.129194] Lustre: server umount lustre-MDT0000 complete [ 8828.844512] LustreError: 288481:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789188182 with bad export cookie 16825652114580800387 [ 8828.847028] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8828.849957] LustreError: 288481:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 8829.007988] Lustre: server umount lustre-MDT0001 complete [ 8833.203539] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8835.039338] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 8837.014764] Lustre: server umount MGS complete [ 8841.413106] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8841.606485] LustreError: 290565:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8841.614741] LustreError: 290578:0:(qmt_pool.c:1639:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 8841.640921] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8843.199611] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 8846.816741] LustreError: 290566:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8847.130388] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8849.239214] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 8852.783536] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 8855.316624] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 8858.672923] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8861.394921] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 8864.706915] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 8896.993647] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 8897.003305] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8897.015176] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8897.017543] Lustre: Skipped 1 previous similar message [ 8900.961219] Lustre: server umount lustre-OST0000 complete [ 8908.907442] Lustre: server umount lustre-MDT0000 complete [ 8910.602140] LustreError: 290593:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789188264 with bad export cookie 16825652114580802235 [ 8910.604144] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8910.608839] LustreError: 290593:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 8910.806622] Lustre: server umount lustre-MDT0001 complete [ 8915.942944] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing unload_modules_local [ 8917.433916] Key type lgssc unregistered [ 8917.602521] LNet: 294508:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8917.606485] LNetError: 294508:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8917.616057] LNet: Removed LNI 192.168.202.118@tcp [ 8918.064856] Key type .llcrypt unregistered [ 8918.066664] Key type ._llcrypt unregistered [ 8934.594175] Key type ._llcrypt registered [ 8934.595624] Key type .llcrypt registered [ 8934.640128] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_hostid [ 8941.550444] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [ 8941.888539] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8941.919095] alg: No test for adler32 (adler32-zlib) [ 8942.828455] Lustre: Lustre: Build Version: 2.17.58_2_g7c2b8e4 [ 8942.960891] LNet: Added LNI 192.168.202.118@tcp [8/256/0/180] [ 8944.575161] Key type lgssc registered [ 8945.048401] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8959.580834] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 8959.592196] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8960.679907] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 8960.693474] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 8960.731787] Lustre: lustre-MDT0000: new disk, initializing [ 8960.768234] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8960.778061] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 8962.334560] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 8967.934047] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8968.005044] Lustre: 298436:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8968.050437] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 8968.053361] Lustre: Skipped 1 previous similar message [ 8968.095054] Lustre: lustre-MDT0001: new disk, initializing [ 8968.143202] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8968.159643] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 8968.167398] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 8970.044652] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 8975.000269] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 8977.656350] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 8981.009925] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8981.153735] Lustre: lustre-OST0000: new disk, initializing [ 8981.156345] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 8981.161046] Lustre: 300405:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8981.196780] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8982.846553] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 8982.851722] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 8982.888979] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 8983.499980] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 8987.982194] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 8991.890793] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 9003.447966] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 9010.111237] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 9015.934238] Lustre: Modifying parameter lustre-client.llite.max_read_ahead_mb=64 in log lustre-client [ 9049.569707] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 9049.572406] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9049.574909] LustreError: Skipped 1 previous similar message [ 9049.575952] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9049.582501] Lustre: Skipped 1 previous similar message [ 9054.692315] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9054.696850] Lustre: Skipped 2 previous similar messages [ 9059.810404] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9059.818131] Lustre: Skipped 1 previous similar message [ 9062.367164] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 9062.470391] Lustre: server umount lustre-OST0000 complete [ 9064.932390] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9064.936257] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9064.942568] Lustre: Skipped 1 previous similar message [ 9064.947967] Lustre: Skipped 1 previous similar message [ 9070.048259] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9070.053766] Lustre: Skipped 1 previous similar message [ 9070.767872] Lustre: server umount lustre-MDT0000 complete [ 9072.627393] LustreError: 299230:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789188426 with bad export cookie 16643560745211301249 [ 9072.634348] LustreError: 299230:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 9072.635837] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9072.795476] Lustre: server umount lustre-MDT0001 complete [ 9077.746187] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9079.586307] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 9081.980517] Lustre: server umount MGS complete [ 9088.322415] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9088.592281] LustreError: 304504:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9088.609715] LustreError: 304504:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 9088.615591] LustreError: 304518:0:(qmt_pool.c:1639:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 9088.674627] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9090.635478] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 9094.113839] LustreError: 304505:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9095.368719] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9095.557199] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9097.688419] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 9101.696604] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 9104.355556] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 9107.648410] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9107.808953] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9110.594388] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 9114.127550] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 9128.416090] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 9128.419240] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9128.425214] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9130.466940] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 9130.469524] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9134.112823] Lustre: server umount lustre-OST0000 complete [ 9136.607777] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 9136.610891] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9141.931759] Lustre: server umount lustre-MDT0000 complete [ 9143.597365] LustreError: 307226:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789188497 with bad export cookie 16643560745211303097 [ 9143.602479] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9143.603528] LustreError: 307226:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 9143.734576] Lustre: server umount lustre-MDT0001 complete [ 9148.178247] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing unload_modules_local [ 9149.465794] Key type lgssc unregistered [ 9149.624536] LNet: 308441:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 9149.634763] LNetError: 308441:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 9149.649926] LNet: Removed LNI 192.168.202.118@tcp [ 9150.002619] Key type .llcrypt unregistered [ 9150.004372] Key type ._llcrypt unregistered [ 9159.110407] Key type ._llcrypt registered [ 9159.112015] Key type .llcrypt registered [ 9159.171236] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_hostid [ 9166.292669] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [ 9166.697639] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 9166.714368] alg: No test for adler32 (adler32-zlib) [ 9167.588382] Lustre: Lustre: Build Version: 2.17.58_2_g7c2b8e4 [ 9167.717181] LNet: Added LNI 192.168.202.118@tcp [8/256/0/180] [ 9169.343123] Key type lgssc registered [ 9169.889794] Lustre: Echo OBD driver; http://www.lustre.org/ [ 9181.389729] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [ 9188.600275] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 9188.635802] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9189.749253] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 9189.783277] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 9189.833377] Lustre: lustre-MDT0000: new disk, initializing [ 9189.887162] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9189.897948] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 9191.973483] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 9197.729633] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9197.864975] Lustre: lustre-OST0000: new disk, initializing [ 9197.867559] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 9197.870790] Lustre: Skipped 1 previous similar message [ 9197.874033] Lustre: 312464:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 9197.912542] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9200.749190] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 9205.265671] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 9205.268547] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 9205.280667] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 9481.695893] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9481.701509] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9486.816268] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9487.540953] Lustre: server umount lustre-MDT0000 complete [ 9489.099450] LustreError: 312462:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789188843 with bad export cookie 9770075912838640208 [ 9489.100713] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9489.107185] LustreError: 312462:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 9489.185228] Lustre: server umount lustre-OST0000 complete [ 9499.317960] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_hostid [ 9502.855676] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [ 9516.195284] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9516.274686] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 9516.286160] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 9516.322767] Lustre: lustre-MDT0000: new disk, initializing [ 9516.352583] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9516.360971] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 9517.736564] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 9522.206437] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9522.249949] Lustre: 316704:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 9522.278922] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 9522.281656] Lustre: Skipped 1 previous similar message [ 9522.316768] Lustre: lustre-MDT0001: new disk, initializing [ 9522.355022] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9522.368733] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 9522.372944] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 9523.894211] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 9527.834630] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 9529.805107] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 9532.267360] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9532.368613] Lustre: lustre-OST0000: new disk, initializing [ 9532.370733] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 9532.375110] Lustre: 318671:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 9532.409861] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9534.819209] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 9536.323712] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 9536.328528] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 9536.363537] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 9539.022378] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 9540.608232] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 9540.702928] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 9542.280183] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 9542.380324] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 9546.722727] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 9546.722946] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9546.726316] LustreError: Skipped 1 previous similar message [ 9546.732560] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9546.735880] Lustre: Skipped 1 previous similar message [ 9549.206343] Lustre: server umount lustre-OST0000 complete [ 9551.840786] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9551.841364] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9551.846124] Lustre: Skipped 2 previous similar messages [ 9556.830315] Lustre: server umount lustre-MDT0000 complete [ 9558.303368] LustreError: 316696:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789188912 with bad export cookie 9770075912841580999 [ 9558.306073] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9558.309103] LustreError: 316696:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 9558.425580] Lustre: server umount lustre-MDT0001 complete [ 9559.660539] Lustre: DEBUG MARKER: SKIP: conf-sanity test_111 skipping SLOW test 111 [ 9560.293531] Lustre: DEBUG MARKER: == conf-sanity test 112a: mount OST with no_create option ========================================================== 00:55:14 (1789188914) [ 9562.923906] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9563.170409] LustreError: 320982:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9563.178267] LustreError: 320982:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [ 9563.200400] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9564.724125] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 9568.017449] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9569.727211] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 9572.357482] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 9574.393489] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 9576.956500] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9579.311896] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 9582.221273] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 9585.007603] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9585.078200] Lustre: lustre-OST0001: new disk, initializing [ 9585.080270] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 9585.084848] Lustre: 323817:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 9585.118480] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 9585.121695] Lustre: Skipped 2 previous similar messages [ 9587.325774] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 9591.304851] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 9591.308706] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 9591.326727] LustreError: 324584:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 9591.418607] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 9591.497198] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 9592.356577] LustreError: 324592:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [ 9592.362282] LustreError: 324592:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 2 previous similar messages [ 9593.382373] LustreError: 324592:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [ 9593.387355] LustreError: 324592:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 1 previous similar message [ 9593.467934] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff915a4117c800.ost_server_uuid 50 [ 9594.013325] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff915a4117c800.ost_server_uuid in FULL state after 0 sec [ 9595.426104] LustreError: 324584:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 9595.430308] LustreError: 324584:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 3 previous similar messages [ 9596.027653] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff915a4117c800.ost_server_uuid 50 [ 9596.619368] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-ffff915a4117c800.ost_server_uuid in FULL state after 0 sec [ 9597.481710] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 9610.693505] Lustre: lustre-OST0001: Not available for connect from 192.168.202.18@tcp (stopping) [ 9610.696375] Lustre: Skipped 1 previous similar message [ 9611.747754] Lustre: lustre-OST0001-osc-MDT0001: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9611.752464] Lustre: Skipped 1 previous similar message [ 9614.534962] Lustre: server umount lustre-OST0001 complete [ 9616.865938] LustreError: 322805:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9616.866031] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9616.872570] LustreError: 322805:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 9616.880193] Lustre: Skipped 1 previous similar message [ 9621.985789] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9621.986778] LustreError: 322803:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9621.990124] Lustre: Skipped 5 previous similar messages [ 9621.996149] LustreError: 322803:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 9622.418564] Lustre: server umount lustre-OST0000 complete [ 9624.544129] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 9627.105428] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9627.110398] Lustre: Skipped 1 previous similar message [ 9638.367115] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 9638.428099] Lustre: server umount lustre-MDT0000 complete [ 9639.809139] LustreError: 320963:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789188993 with bad export cookie 9770075912841581881 [ 9639.812288] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9639.814025] LustreError: 320963:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 9639.939597] Lustre: server umount lustre-MDT0001 complete [ 9643.762335] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing unload_modules_local [ 9644.888042] Key type lgssc unregistered [ 9645.026433] LNet: 326497:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 9645.029803] LNetError: 326497:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 9645.037625] LNet: Removed LNI 192.168.202.118@tcp [ 9645.362431] Key type .llcrypt unregistered [ 9645.363782] Key type ._llcrypt unregistered [ 9655.246995] Key type ._llcrypt registered [ 9655.248446] Key type .llcrypt registered [ 9655.285525] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [ 9655.699411] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 9655.707213] alg: No test for adler32 (adler32-zlib) [ 9656.569580] Lustre: Lustre: Build Version: 2.17.58_2_g7c2b8e4 [ 9656.664210] LNet: Added LNI 192.168.202.118@tcp [8/256/0/180] [ 9658.247177] Key type lgssc registered [ 9658.636511] Lustre: Echo OBD driver; http://www.lustre.org/ [ 9661.324521] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 9661.331835] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9662.479296] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9663.994626] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 9666.660030] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 9669.261931] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9669.445058] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9671.000835] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 9674.408086] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9674.526057] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9676.625570] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 9679.097462] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 9679.652756] LustreError: 330299:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9679.659980] LustreError: 330299:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 9681.714486] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9681.801291] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 9684.042743] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 9686.875589] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 9686.956428] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:33) [ 9686.956793] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:65) [ 9690.721923] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing wait_import_state (FULL|IDLE) os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [ 9690.796705] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 9768.935874] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9768.936769] LustreError: lustre-OST0001-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 9768.941176] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 9768.942325] LustreError: Skipped 1 previous similar message [ 9774.050110] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 9774.051895] Lustre: Skipped 2 previous similar messages [ 9779.172770] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 9779.174868] Lustre: Skipped 1 previous similar message [ 9781.215507] Lustre: lustre-OST0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 9781.251906] Lustre: server umount lustre-OST0001 complete [ 9784.289679] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9784.290758] LustreError: 331244:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9784.291516] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 9784.292138] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9784.294684] Lustre: Skipped 2 previous similar messages [ 9784.298866] LustreError: 331244:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 9789.011058] Lustre: server umount lustre-OST0000 complete [ 9792.479679] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 9792.481786] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9792.485597] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9792.487246] Lustre: Skipped 1 previous similar message [ 9794.529086] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9796.378981] Lustre: server umount lustre-MDT0000 complete [ 9797.561208] LustreError: 327885:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789189151 with bad export cookie 7488163341178352795 [ 9797.564603] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9797.566836] LustreError: 327885:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 9797.677873] Lustre: server umount lustre-MDT0001 complete [ 9801.127177] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing unload_modules_local [ 9802.101824] Key type lgssc unregistered [ 9802.228392] LNet: 332839:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 9802.231110] LNetError: 332839:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 9802.237242] LNet: Removed LNI 192.168.202.118@tcp [ 9802.529690] Key type .llcrypt unregistered [ 9802.530962] Key type ._llcrypt unregistered [ 9819.376864] Key type ._llcrypt registered [ 9819.378241] Key type .llcrypt registered [ 9819.412569] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [ 9819.734751] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 9819.796667] alg: No test for adler32 (adler32-zlib) [ 9820.647521] Lustre: Lustre: Build Version: 2.17.58_2_g7c2b8e4 [ 9820.733793] LNet: Added LNI 192.168.202.118@tcp [8/256/0/180] [ 9822.311146] Key type lgssc registered [ 9822.640819] Lustre: Echo OBD driver; http://www.lustre.org/ [ 9825.685616] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 9825.691108] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9826.829432] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9828.163207] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 9831.066326] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9831.216979] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9832.573418] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 9833.501681] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 9835.723242] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9835.840704] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9836.899164] LustreError: 336586:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9836.903120] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:97) [ 9836.907858] LustreError: 336586:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [ 9837.895707] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 9840.857311] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9840.946678] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 9841.965077] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:65) [ 9842.997888] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 9847.194474] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 9851.858528] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 9856.991783] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 9856.994117] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9856.998099] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9857.505486] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9857.506470] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9857.512345] Lustre: Skipped 2 previous similar messages [ 9861.474387] Lustre: server umount lustre-MDT0000 complete [ 9862.624523] LustreError: 335098:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9862.631254] LustreError: 335098:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 3 previous similar messages [ 9862.797075] LustreError: 338105:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789189216 with bad export cookie 13403360255624485881 [ 9862.800416] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9862.800620] LustreError: 338105:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 9862.916682] Lustre: server umount lustre-MDT0001 complete [ 9874.945856] Lustre: server umount lustre-OST0000 complete [ 9886.490348] Lustre: server umount lustre-OST0001 complete [ 9891.962817] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [ 9895.632584] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9895.778458] LustreError: 340358:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9895.793824] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9897.252402] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 9900.325218] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9901.911572] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 9902.946159] Lustre: 341499:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 9905.202702] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9905.325706] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9905.328464] Lustre: Skipped 1 previous similar message [ 9906.339499] LustreError: 341852:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9906.342806] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:129) [ 9907.421817] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 9910.433901] LustreError: 341854:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9910.440951] LustreError: 341854:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 9910.655835] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9912.726450] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 9915.838745] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 9915.881747] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:97) [ 9917.138951] Lustre: 343379:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 9920.995096] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9920.996593] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9921.001276] Lustre: Skipped 3 previous similar messages [ 9921.005077] Lustre: Skipped 5 previous similar messages [ 9921.006939] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 9924.318175] Lustre: server umount lustre-MDT0000 complete [ 9925.625323] LustreError: 340338:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789189279 with bad export cookie 13403360255624487540 [ 9925.628838] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9925.631125] LustreError: 340338:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 9926.112484] LustreError: 340355:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9926.113194] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9926.114226] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 9926.118753] LustreError: 340355:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [ 9926.124313] Lustre: Skipped 1 previous similar message [ 9927.135284] LustreError: 341094:0:(client.c:1394:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff95f3a543ad80 x1876100827397376/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 [ 9927.197918] Lustre: server umount lustre-MDT0001 complete [ 9934.655337] Lustre: server umount lustre-OST0000 complete [ 9936.009652] Lustre: server umount lustre-OST0001 complete [ 9937.261947] Lustre: DEBUG MARKER: SKIP: conf-sanity test_114 skipping SLOW test 114 [ 9937.808451] Lustre: DEBUG MARKER: SKIP: conf-sanity test_115 skipping excluded test 115 [ 9938.415463] Lustre: DEBUG MARKER: == conf-sanity test 116: big size MDT support ============ 01:01:32 (1789189292) [ 9945.799038] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [ 9948.905830] loop0: detected capacity change from 0 to 1099511627776 [ 9949.051384] SGI XFS with ACLs, security attributes, quota, no debug enabled [ 9949.054430] *** VALIDATE xfs *** [ 9949.059839] XFS (loop0): Mounting V5 Filesystem [ 9949.068019] XFS (loop0): Ending clean mount [ 9949.495222] loop1: detected capacity change from 0 to 18691697672192 [ 9969.625498] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_hostid [ 9972.797455] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [ 9983.897930] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9983.971675] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 9983.979984] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 9984.013656] Lustre: lustre-MDT0000: new disk, initializing [ 9984.034665] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9984.037503] Lustre: Skipped 1 previous similar message [ 9984.043049] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 9985.286614] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 9989.619223] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9989.658897] Lustre: 348491:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 9989.680474] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 9989.683019] Lustre: Skipped 1 previous similar message [ 9989.714256] Lustre: lustre-MDT0001: new disk, initializing [ 9989.757495] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 9989.761409] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 9990.975236] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [ 9994.592679] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 9996.272374] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 9998.404784] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9998.501714] Lustre: lustre-OST0000: new disk, initializing [ 9998.503292] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 9998.505529] Lustre: 350459:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 9999.865736] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 9999.870119] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 9999.908563] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [10000.405095] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [10003.897689] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [10005.260156] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [10005.332113] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [10006.688816] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [10006.760692] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [10010.082555] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10010.082607] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [10010.083416] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [10010.083421] Lustre: Skipped 1 previous similar message [10010.086862] Lustre: Skipped 1 previous similar message [10010.089268] LustreError: Skipped 1 previous similar message [10013.522967] Lustre: server umount lustre-OST0000 complete [10020.320477] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10020.322796] Lustre: Skipped 4 previous similar messages [10020.952095] Lustre: server umount lustre-MDT0000 complete [10022.160106] LustreError: 348486:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789189376 with bad export cookie 13403360255624489073 [10022.163261] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [10022.164641] LustreError: 348486:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [10022.278411] Lustre: server umount lustre-MDT0001 complete [10025.051061] XFS (loop0): Unmounting Filesystem [10026.512690] Lustre: DEBUG MARKER: == conf-sanity test 117: lctl get_param return errors properly ========================================================== 01:03:01 (1789189381) [10028.773361] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10028.937183] LustreError: 353013:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10028.963065] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10028.966400] Lustre: Skipped 2 previous similar messages [10030.465982] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [10033.311611] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10034.774976] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [10037.055395] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [10038.808959] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [10040.989373] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10042.929197] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [10045.391324] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [10059.744892] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [10059.745570] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10059.746297] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [10059.755184] Lustre: Skipped 3 previous similar messages [10061.472779] Lustre: server umount lustre-OST0000 complete [10064.355342] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [10064.932236] Lustre: server umount lustre-MDT0000 complete [10066.299312] LustreError: 352993:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789189420 with bad export cookie 13403360255624489955 [10066.302292] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [10066.303557] LustreError: 352993:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [10066.420198] Lustre: server umount lustre-MDT0001 complete [10070.519070] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing unload_modules_local [10071.594369] Key type lgssc unregistered [10071.736512] LNet: 356660:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [10071.740636] LNetError: 356660:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [10071.755583] LNet: Removed LNI 192.168.202.118@tcp [10072.109131] Key type .llcrypt unregistered [10072.110279] Key type ._llcrypt unregistered [10082.970646] Key type ._llcrypt registered [10082.971776] Key type .llcrypt registered [10083.013283] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [10083.322048] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [10083.338359] alg: No test for adler32 (adler32-zlib) [10084.199669] Lustre: Lustre: Build Version: 2.17.58_2_g7c2b8e4 [10084.290338] LNet: Added LNI 192.168.202.118@tcp [8/256/0/180] [10085.871194] Key type lgssc registered [10086.276662] Lustre: Echo OBD driver; http://www.lustre.org/ [10088.883947] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [10088.891253] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10090.060074] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10091.673348] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [10094.829556] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10094.976035] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [10096.362641] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [10098.901497] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [10100.728779] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [10103.078537] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10103.192248] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [10105.265499] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [10107.797716] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [10123.714908] Lustre: lustre-MDT0001: Not available for connect from 192.168.202.18@tcp (stopping) [10125.794493] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10125.794584] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [10125.798608] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [10125.802276] Lustre: Skipped 1 previous similar message [10127.251470] Lustre: server umount lustre-MDT0001 complete [10128.827882] LustreError: 358207:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.202.18@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [10128.833803] LustreError: 358207:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 2 previous similar messages [10130.859036] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10130.892976] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [10130.894899] Lustre: Found index 1 for lustre-MDT0001, updating log [10130.907815] Lustre: 358201:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [10130.912634] LustreError: 358230:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10130.920116] LustreError: 358230:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [10131.022218] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [10132.416316] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [10136.037271] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [10137.572800] LustreError: 361943:0:(obd_mount.c:234:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [10137.575299] LustreError: 361943:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [10137.578219] LustreError: 358203:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [10137.594240] LustreError: 361946:0:(obd_config.c:2102:class_config_llog_handler()) MGC192.168.202.118@tcp: cfg command failed: rc = -17 [10137.598290] Lustre: cmd=cf001 0:lustre-MDT0001-osp-MDT0000 1:osp 2:lustre-MDT0000-mdtlov_UUID [10137.598290] [10436.034363] Lustre: lustre-MDT0001: Not available for connect from 192.168.202.18@tcp (stopping) [10438.112822] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10438.113155] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [10438.114181] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [10438.117241] Lustre: Skipped 2 previous similar messages [10441.677949] Lustre: server umount lustre-MDT0001 complete [10443.232264] LustreError: 358230:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10443.238511] LustreError: 358230:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [10445.155596] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10445.191082] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [10445.194061] Lustre: Found index 1 for lustre-MDT0001, updating log [10445.209306] Lustre: 358201:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [10445.313152] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [10446.545752] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [10450.405115] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [10451.431201] LustreError: 374626:0:(obd_mount.c:234:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [10451.433651] LustreError: 374626:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [10451.436453] LustreError: 358203:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [10451.439532] LustreError: 358203:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [10451.461679] LustreError: 374632:0:(obd_config.c:761:class_setup()) osp: device 8 already setup: rc = -17 [10451.464919] LustreError: 374632:0:(obd_config.c:866:class_detach()) OBD device 8 still set up [10451.468570] LustreError: 374632:0:(obd_config.c:2102:class_config_llog_handler()) MGC192.168.202.118@tcp: cfg command failed: rc = -17 [10451.473090] Lustre: cmd=cf003 0:lustre-MDT0001-osp-MDT0000 1:lustre-MDT0001_UUID 2:192.168.202.118@tcp [10451.473090] [10752.481290] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10752.482393] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [10752.485838] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [10752.489982] Lustre: Skipped 3 previous similar messages [10755.668334] Lustre: server umount lustre-MDT0001 complete [10757.600246] LustreError: 358212:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10757.604676] LustreError: 358212:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [10758.948716] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10758.997207] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [10758.999626] Lustre: Found index 1 for lustre-MDT0001, updating log [10759.014452] Lustre: 358200:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [10759.128088] Lustre: lustre-MDT0001: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [10760.432944] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [10764.260973] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [10766.822949] LustreError: 387412:0:(obd_mount.c:234:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [10766.825675] LustreError: 387412:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [10766.828280] LustreError: 358203:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [10766.830220] LustreError: 358203:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [10766.849089] LustreError: 387422:0:(lod_lov.c:208:lod_add_device()) lustre-MDT0001-osp-MDT0000: cannot connect to next dev lustre-MDT0001_UUID (-114) [10766.856357] LustreError: 387422:0:(obd_config.c:2102:class_config_llog_handler()) MGC192.168.202.118@tcp: cfg command failed: rc = -114 [10766.860058] Lustre: cmd=cf014 0:lustre-MDT0000-mdtlov 1:lustre-MDT0001_UUID 2:1 3:1 [10766.860058] [11076.578021] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [11076.578799] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11076.582114] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [11076.582121] Lustre: Skipped 1 previous similar message [11076.596408] Lustre: Skipped 2 previous similar messages [11089.375145] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [11089.438668] Lustre: server umount lustre-MDT0000 complete [11090.775301] LustreError: 358191:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789190444 with bad export cookie 9846459022338676842 [11090.777597] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [11090.781121] LustreError: 358191:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [11091.936340] LustreError: 360050:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11091.936712] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11091.949822] LustreError: 360050:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [11091.953733] Lustre: Skipped 1 previous similar message [11095.968428] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [11095.970736] Lustre: Skipped 9 previous similar messages [11100.069150] LustreError: 360388:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11100.075985] LustreError: 360388:0:(ldlm_lib.c:1190:target_handle_connect()) Skipped 1 previous similar message [11105.247166] Lustre: lustre-MDT0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [11105.351421] Lustre: server umount lustre-MDT0001 complete [11107.162059] Lustre: server umount lustre-OST0000 complete [11111.291892] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_hostid [11115.011659] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [11129.387593] Lustre: DEBUG MARKER: == conf-sanity test 120: cross-target rename should not create bad symlinks ========================================================== 01:21:23 (1789190483) [11131.910964] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11132.000974] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [11132.013828] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [11132.052942] Lustre: lustre-MDT0000: new disk, initializing [11132.080763] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [11132.087300] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [11133.675957] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [11138.557037] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11138.607661] Lustre: 401457:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [11138.636558] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [11138.638961] Lustre: Skipped 1 previous similar message [11138.678540] Lustre: lustre-MDT0001: new disk, initializing [11138.729345] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [11138.744441] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [11138.748674] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [11140.501694] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [11144.906199] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [11147.234818] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [11150.106452] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11150.226063] Lustre: lustre-OST0000: new disk, initializing [11150.228137] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [11150.231266] Lustre: 403425:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [11150.270830] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [11152.522371] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug -1 all [11156.443147] Lustre: DEBUG MARKER: oleg218-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [11157.497825] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [11157.501591] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [11157.532640] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [11164.639891] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [11164.643274] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11164.648367] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [11164.650261] Lustre: Skipped 2 previous similar messages [11170.717883] Lustre: server umount lustre-MDT0000 complete [11172.032198] LustreError: 402254:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789190526 with bad export cookie 9846459022338678781 [11172.034531] LustreError: MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [11172.034958] LustreError: 402268:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0000-osp-MDT0001: osp_attr_get update error [0x200000401:0x2:0x0]: rc = -5 [11172.037156] LustreError: 402254:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [11172.162108] Lustre: server umount lustre-MDT0001 complete [11183.770597] Lustre: server umount lustre-OST0000 complete [11193.173630] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing set_hostid [11196.432871] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local [11206.432292] Lustre: DEBUG MARKER: == conf-sanity test complete, duration 10876 sec ========= 01:22:40 (1789190560) [11206.970850] Lustre: DEBUG MARKER: === conf-sanity: start cleanup 01:22:41 (1789190561) === [11207.998505] Lustre: DEBUG MARKER: === conf-sanity: finish cleanup 01:22:42 (1789190562) === [11220.747307] Lustre: DEBUG MARKER: oleg218-server.virtnet: executing unload_modules_local [11221.738610] Key type lgssc unregistered [11221.864364] LNet: 409781:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [11221.866734] LNetError: 409781:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [11221.874319] LNet: Removed LNI 192.168.202.118@tcp [11222.177753] Key type .llcrypt unregistered [11222.179097] Key type ._llcrypt unregistered