[ 0.000000] Linux version 4.18.0rh8.10-debug (green@maintenance) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-26) (GCC)) #2 SMP Mon Jul 14 01:24:22 EDT 2025 [ 0.000000] Command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffcdfff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffce000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x0000000146dfffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.8 present. [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 [ 0.000000] Hypervisor detected: KVM [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 472786799 cycles [ 0.000000] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns [ 0.000000] tsc: Detected 2400.000 MHz processor [ 0.000000] last_pfn = 0x146e00 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0xbffce max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000f54b0-0x000f54bf] [ 0.000000] RAMDISK: [mem 0xbcc54000-0xbffbffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F52D0 000014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 0x00000000BFFE247C 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 0x00000000BFFE2318 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 0x00000000BFFE0040 0022D8 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 0x00000000BFFE0000 000040 [ 0.000000] ACPI: APIC 0x00000000BFFE238C 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: HPET 0x00000000BFFE241C 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: WAET 0x00000000BFFE2454 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0xbffe2318-0xbffe238b] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe2317] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0xbffe238c-0xbffe241b] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0xbffe241c-0xbffe2453] [ 0.000000] ACPI: Reserving WAET table memory at [mem 0xbffe2454-0xbffe247b] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x0000000146dfffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x1465a3000-0x1465cdfff] [ 0.000000] Reserving 256MB of memory at 2752MB for crashkernel (System RAM: 4205MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009efff] [ 0.000000] node 0: [mem 0x0000000000100000-0x00000000bffcdfff] [ 0.000000] node 0: [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Zeroed struct page in unavailable ranges: 4756 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x0000000146dfffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] TSC deadline timer available [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] kvm-guest: KVM setup pv remote TLB flush [ 0.000000] kvm-guest: setup PV sched yield [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbffce000-0xbfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.000000] [mem 0xc0000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u524288 [ 0.000000] kvm-guest: PV spinlocks enabled [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1059606 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] audit: disabled (until reboot) [ 0.000000] software IO TLB: area num 4. [ 0.000000] Memory: 2887048K/4306352K available (18435K kernel code, 11221K rwdata, 7248K rodata, 2908K init, 18040K bss, 524580K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] ftrace: allocating 41240 entries in 162 pages [ 0.000000] ftrace: allocated 162 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU event tracing is enabled. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=4. [ 0.000000] rcu: RCU callback double-/use-after-free debug enabled. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 [ 0.000000] NR_IRQS: 524544, nr_irqs: 456, preallocated irqs: 16 [ 0.000000] random: get_random_bytes called from start_kernel+0x622/0x9a8 with crng_init=0 [ 0.001000] Console: colour *CGA 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns [ 0.001012] APIC: Switch to symmetric I/O mode setup [ 0.002364] x2apic enabled [ 0.003010] Switched APIC routing to physical x2apic. [ 0.004016] kvm-guest: setup PV IPIs [ 0.007484] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.008000] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x22983777dd9, max_idle_ns: 440795300422 ns [ 0.008022] Calibrating delay loop (skipped) preset value.. 4800.00 BogoMIPS (lpj=2400000) [ 0.009014] pid_max: default: 32768 minimum: 301 [ 0.011140] LSM: Security Framework initializing [ 0.012054] Yama: becoming mindful. [ 0.013041] SELinux: Initializing. [ 0.014074] *** VALIDATE selinux *** [ 0.022782] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, vmalloc) [ 0.027632] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc) [ 0.028162] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.029095] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.030119] *** VALIDATE tmpfs *** [ 0.032297] *** VALIDATE proc *** [ 0.033245] *** VALIDATE cgroup *** [ 0.034010] *** VALIDATE cgroup2 *** [ 0.035263] x86/cpu: User Mode Instruction Prevention (UMIP) activated [ 0.037173] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.038011] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 [ 0.039031] Spectre V2 : User space: Vulnerable [ 0.040010] Speculative Store Bypass: Vulnerable [ 0.042826] debug: unmapping init [mem 0xffffffffa7059000-0xffffffffa7060fff] [ 0.045000] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (family: 0x6, model: 0x3e, stepping: 0x4) [ 0.045686] Performance Events: IvyBridge events, full-width counters, Intel PMU driver. [ 0.046019] ... version: 2 [ 0.047015] ... bit width: 48 [ 0.048016] ... generic registers: 4 [ 0.049018] ... value mask: 0000ffffffffffff [ 0.050018] ... max period: 00007fffffffffff [ 0.051017] ... fixed-purpose events: 3 [ 0.052020] ... event mask: 000000070000000f [ 0.053281] rcu: Hierarchical SRCU implementation. [ 0.055637] smp: Bringing up secondary CPUs ... [ 0.056620] x86: Booting SMP configuration: [ 0.057024] .... node #0, CPUs: #1 #2 #3 [ 0.060226] smp: Brought up 1 node, 4 CPUs [ 0.062014] smpboot: Max logical packages: 1 [ 0.063026] smpboot: Total of 4 processors activated (19200.00 BogoMIPS) [ 0.130786] node 0 deferred pages initialised in 64ms [ 0.133596] devtmpfs: initialized [ 0.135292] x86/mm: Memory block size: 128MB [ 0.138580] gcov: version magic: 0x41383552 [ 0.140229] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.142099] futex hash table entries: 1024 (order: 4, 65536 bytes, vmalloc) [ 0.144336] pinctrl core: initialized pinctrl subsystem [ 0.146190] [ 0.146848] ************************************************************* [ 0.149014] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.151007] ** ** [ 0.152007] ** IOMMU DebugFS SUPPORT HAS BEEN ENABLED IN THIS KERNEL ** [ 0.153008] ** ** [ 0.155018] ** This means that this kernel is built to expose internal ** [ 0.157013] ** IOMMU data structures, which may compromise security on ** [ 0.159012] ** your system. ** [ 0.161014] ** ** [ 0.162008] ** If you see this message and you are not debugging the ** [ 0.164008] ** kernel, report this immediately to your vendor! ** [ 0.165007] ** ** [ 0.166008] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.168007] ************************************************************* [ 0.169524] NET: Registered protocol family 16 [ 0.170337] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations [ 0.172037] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.173048] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.176022] cpuidle: using governor menu [ 0.178000] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.179451] PCI: Using configuration type 1 for base access [ 0.180091] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.187125] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.189027] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.193059] cryptd: max_cpu_qlen set to 1000 [ 0.196256] ACPI: Added _OSI(Module Device) [ 0.197130] ACPI: Added _OSI(Processor Device) [ 0.199014] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.201012] ACPI: Added _OSI(Processor Aggregator Device) [ 0.205184] ACPI: 1 ACPI AML tables successfully acquired and loaded [ 0.212594] ACPI: Interpreter enabled [ 0.215041] ACPI: PM: (supports S0 S3 S4 S5) [ 0.216013] ACPI: Using IOAPIC for interrupt routing [ 0.217136] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.220383] ACPI: Enabled 2 GPEs in block 00 to 0F [ 0.230720] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.233043] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3] [ 0.236024] acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI] [ 0.238087] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.242312] acpiphp: Slot [2] registered [ 0.243105] acpiphp: Slot [5] registered [ 0.245162] acpiphp: Slot [6] registered [ 0.246076] acpiphp: Slot [7] registered [ 0.247206] acpiphp: Slot [8] registered [ 0.248066] acpiphp: Slot [9] registered [ 0.249000] acpiphp: Slot [10] registered [ 0.249000] acpiphp: Slot [3] registered [ 0.251072] acpiphp: Slot [4] registered [ 0.252125] acpiphp: Slot [11] registered [ 0.253000] acpiphp: Slot [12] registered [ 0.254130] acpiphp: Slot [13] registered [ 0.255097] acpiphp: Slot [14] registered [ 0.256084] acpiphp: Slot [15] registered [ 0.258106] acpiphp: Slot [16] registered [ 0.259115] acpiphp: Slot [17] registered [ 0.260111] acpiphp: Slot [18] registered [ 0.262103] acpiphp: Slot [19] registered [ 0.263090] acpiphp: Slot [20] registered [ 0.265196] acpiphp: Slot [21] registered [ 0.266072] acpiphp: Slot [22] registered [ 0.266901] acpiphp: Slot [23] registered [ 0.267096] acpiphp: Slot [24] registered [ 0.267848] acpiphp: Slot [25] registered [ 0.269049] acpiphp: Slot [26] registered [ 0.269892] acpiphp: Slot [27] registered [ 0.271057] acpiphp: Slot [28] registered [ 0.272022] acpiphp: Slot [29] registered [ 0.273100] acpiphp: Slot [30] registered [ 0.274077] acpiphp: Slot [31] registered [ 0.275046] PCI host bridge to bus 0000:00 [ 0.276034] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.278028] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.280032] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.283025] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 0.285021] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] [ 0.288025] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.290200] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.293091] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.297382] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 0.307742] pci 0000:00:01.1: reg 0x20: [io 0xc320-0xc32f] [ 0.312062] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.316021] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.318018] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.320022] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.323644] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 0.325628] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 0.327027] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 0.329603] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 [ 0.333016] pci 0000:00:02.0: reg 0x10: [io 0xc300-0xc31f] [ 0.346933] pci 0000:00:02.0: reg 0x20: [mem 0xe0000000000-0xe0000003fff 64bit pref] [ 0.351014] pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 0.355642] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 [ 0.364018] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] [ 0.372021] pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] [ 0.388031] pci 0000:00:05.0: reg 0x20: [mem 0xe0000004000-0xe0000007fff 64bit pref] [ 0.396608] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 [ 0.405016] pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] [ 0.417843] pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 0.447018] pci 0000:00:06.0: reg 0x20: [mem 0xe0000008000-0xe000000bfff 64bit pref] [ 0.462641] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 [ 0.469071] pci 0000:00:07.0: reg 0x10: [io 0xc100-0xc17f] [ 0.476022] pci 0000:00:07.0: reg 0x14: [mem 0xfebc2000-0xfebc2fff] [ 0.524017] pci 0000:00:07.0: reg 0x20: [mem 0xe000000c000-0xe000000ffff 64bit pref] [ 0.533354] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 [ 0.542021] pci 0000:00:08.0: reg 0x10: [io 0xc180-0xc1ff] [ 0.549018] pci 0000:00:08.0: reg 0x14: [mem 0xfebc3000-0xfebc3fff] [ 0.569022] pci 0000:00:08.0: reg 0x20: [mem 0xe0000010000-0xe0000013fff 64bit pref] [ 0.582519] pci 0000:00:09.0: [1af4:1001] type 00 class 0x010000 [ 0.593019] pci 0000:00:09.0: reg 0x10: [io 0xc200-0xc27f] [ 0.600016] pci 0000:00:09.0: reg 0x14: [mem 0xfebc4000-0xfebc4fff] [ 0.614018] pci 0000:00:09.0: reg 0x20: [mem 0xe0000014000-0xe0000017fff 64bit pref] [ 0.627479] pci 0000:00:0a.0: [1af4:1001] type 00 class 0x010000 [ 0.635023] pci 0000:00:0a.0: reg 0x10: [io 0xc280-0xc2ff] [ 0.642022] pci 0000:00:0a.0: reg 0x14: [mem 0xfebc5000-0xfebc5fff] [ 0.657017] pci 0000:00:0a.0: reg 0x20: [mem 0xe0000018000-0xe000001bfff 64bit pref] [ 0.668642] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 [ 0.671311] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 0.673281] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 [ 0.674244] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 0.677291] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 [ 0.682081] iommu: Default domain type: Passthrough [ 0.683439] SCSI subsystem initialized [ 0.685125] ACPI: bus type USB registered [ 0.686096] usbcore: registered new interface driver usbfs [ 0.688107] usbcore: registered new interface driver hub [ 0.690097] usbcore: registered new device driver usb [ 0.692141] pps_core: LinuxPPS API ver. 1 registered [ 0.694011] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 0.697061] PTP clock support registered [ 0.699059] EDAC MC: Ver: 3.0.0 [ 0.700461] PCI: Using ACPI for IRQ routing [ 0.702928] NetLabel: Initializing [ 0.704016] NetLabel: domain hash size = 128 [ 0.706010] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 0.708092] NetLabel: unlabeled traffic allowed by default [ 0.710146] vgaarb: loaded [ 0.712246] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 0.714015] hpet0: 3 comparators, 64-bit 100.000000 MHz counter [ 0.721143] clocksource: Switched to clocksource kvm-clock [ 0.835378] VFS: Disk quotas dquot_6.6.0 [ 0.837026] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 0.839214] *** VALIDATE ramfs *** [ 0.840054] *** VALIDATE hugetlbfs *** [ 0.841616] pnp: PnP ACPI init [ 0.844110] pnp: PnP ACPI: found 6 devices [ 0.860302] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 0.863374] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 0.865460] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 0.867626] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 0.870146] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 0.872374] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] [ 0.875230] NET: Registered protocol family 2 [ 0.877559] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, vmalloc) [ 0.882487] tcp_listen_portaddr_hash hash table entries: 4096 (order: 5, 163840 bytes, vmalloc) [ 0.884797] TCP established hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.888922] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc) [ 0.893034] TCP: Hash tables configured (established 65536 bind 65536) [ 0.897457] MPTCP token hash table entries: 8192 (order: 6, 393216 bytes, vmalloc) [ 0.901733] UDP hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.905179] UDP-Lite hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.908057] NET: Registered protocol family 1 [ 0.911113] RPC: Registered named UNIX socket transport module. [ 0.913344] RPC: Registered udp transport module. [ 0.915197] RPC: Registered tcp transport module. [ 0.916736] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 0.918776] NET: Registered protocol family 44 [ 0.920328] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 0.922636] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 0.925024] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 0.927588] PCI: CLS 0 bytes, default 64 [ 0.930087] Unpacking initramfs... [ 2.346081] debug: unmapping init [mem 0xffff88d47cc54000-0xffff88d47ffbffff] [ 2.350552] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 2.353310] software IO TLB: mapped [mem 0x00000000a8000000-0x00000000ac000000] (64MB) [ 2.356900] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x22983777dd9, max_idle_ns: 440795300422 ns [ 2.908455] Initialise system trusted keyrings [ 2.910096] Key type blacklist registered [ 2.911936] workingset: timestamp_bits=36 max_order=20 bucket_order=0 [ 2.921227] zbud: loaded [ 2.924178] *** VALIDATE nfs *** [ 2.925354] *** VALIDATE nfs4 *** [ 2.926570] pstore: using deflate compression [ 2.930098] Platform Keyring initialized [ 3.025840] NET: Registered protocol family 38 [ 3.027773] Key type asymmetric registered [ 3.029274] Asymmetric key parser 'x509' registered [ 3.031324] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 3.034321] io scheduler mq-deadline registered [ 3.035704] io scheduler kyber registered [ 3.036683] io scheduler bfq registered [ 3.038112] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 3.040696] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.043466] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 3.045719] ACPI: Power Button [PWRF] [ 3.050721] ACPI: \_SB_.LNKB: Enabled at IRQ 10 [ 3.056707] ACPI: \_SB_.LNKA: Enabled at IRQ 11 [ 3.068839] ACPI: \_SB_.LNKC: Enabled at IRQ 11 [ 3.076721] ACPI: \_SB_.LNKD: Enabled at IRQ 10 [ 3.088449] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 3.114024] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.139398] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.143595] Non-volatile memory driver v1.3 [ 3.145124] Linux agpgart interface v0.103 [ 3.173957] virtio_blk virtio1: [vda] 145960 512-byte logical blocks (74.7 MB/71.3 MiB) [ 3.175691] vda: detected capacity change from 0 to 74731520 [ 3.189206] virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) [ 3.191713] vdb: detected capacity change from 0 to 1073741824 [ 3.205755] virtio_blk virtio3: [vdc] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 3.208752] vdc: detected capacity change from 0 to 2621440000 [ 3.224264] virtio_blk virtio4: [vdd] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 3.227019] vdd: detected capacity change from 0 to 2621440000 [ 3.242946] virtio_blk virtio5: [vde] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 3.245624] vde: detected capacity change from 0 to 4294967296 [ 3.260580] virtio_blk virtio6: [vdf] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 3.263028] vdf: detected capacity change from 0 to 4294967296 [ 3.276623] libphy: Fixed MDIO Bus: probed [ 3.292291] usbcore: registered new interface driver usbserial_generic [ 3.294859] usbserial: USB Serial support registered for generic [ 3.296566] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 3.302340] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 3.303641] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 3.305485] mousedev: PS/2 mouse device common for all mice [ 3.307515] rtc_cmos 00:05: RTC can wake from S4 [ 3.309939] rtc_cmos 00:05: registered as rtc0 [ 3.311628] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 3.313792] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 3.315968] intel_pstate: CPU model not supported [ 3.318775] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 [ 3.320597] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 [ 3.325862] hid: raw HID events driver (C) Jiri Kosina [ 3.327640] usbcore: registered new interface driver usbhid [ 3.329995] usbhid: USB HID core driver [ 3.331476] drop_monitor: Initializing network drop monitor service [ 3.333456] Initializing XFRM netlink socket [ 3.334993] NET: Registered protocol family 10 [ 3.337486] Segment Routing with IPv6 [ 3.338649] NET: Registered protocol family 17 [ 3.340278] mpls_gso: MPLS GSO support [ 3.346663] RAS: Correctable Errors collector initialized. [ 3.348496] AVX version of gcm_enc/dec engaged. [ 3.349731] AES CTR mode by8 optimization enabled [ 3.418735] sched_clock: Marking stable (3418707730, 0)->(4307879452, -889171722) [ 3.421759] registered taskstats version 1 [ 3.423336] Loading compiled-in X.509 certificates [ 3.425019] zswap: loaded using pool lzo/zbud [ 3.442254] Key type big_key registered [ 3.454032] Key type encrypted registered [ 3.454940] ima: No TPM chip found, activating TPM-bypass! [ 3.456104] ima: Allocated hash algorithm: sha1 [ 3.457216] ima: No architecture policies found [ 3.458355] evm: Initialising EVM extended attributes: [ 3.459467] evm: security.selinux [ 3.460271] evm: security.ima [ 3.460986] evm: security.capability [ 3.461683] evm: HMAC attrs: 0x1 [ 3.463321] rtc_cmos 00:05: setting system clock to 2026-09-08 21:35:37 UTC (1788903337) [ 3.467407] debug: unmapping init [mem 0xffffffffa8003000-0xffffffffa81fffff] [ 3.469242] debug: unmapping init [mem 0xffffffffa6d82000-0xffffffffa7058fff] [ 3.481630] Write protecting the kernel read-only data: 28672k [ 3.484029] debug: unmapping init [mem 0xffffffffa5403000-0xffffffffa55fffff] [ 3.485717] debug: unmapping init [mem 0xffffffffa5d14000-0xffffffffa5dfffff] [ 3.510613] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 3.516402] systemd[1]: Detected virtualization kvm. [ 3.517947] systemd[1]: Detected architecture x86-64. [ 3.519198] systemd[1]: Running in initial RAM disk. Welcome to Rocky Linux 8.10 (Green Obsidian) dracut-049-233.git20240115.el8 (Initramfs)! [ 3.544072] systemd[1]: No hostname configured. [ 3.545115] systemd[1]: Set hostname to . [ 3.546352] random: systemd: uninitialized urandom read (16 bytes read) [ 3.547970] systemd[1]: Initializing machine ID from random generator. [ 3.584529] random: ln: uninitialized urandom read (6 bytes read) [ 3.679669] random: systemd: uninitialized urandom read (16 bytes read) [ 3.682636] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 3.688709] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 3.693682] systemd[1]: Reached target Swap. [ OK ] Reached target Swap. [ OK ] Listening on udev Control Socket. [ OK ] Reached target Timers. [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Paths. [ OK ] Reached target Initrd Root Device. [ OK ] Listening on Journal Socket. [ OK ] Reached target Sockets. Starting Setup Virtual Console... [ OK ] Reached target Slices. [ OK ] Started Memstrack Anylazing Service. Starting Journal Service... Starting Create list of required st…ce nodes for the current kernel... [ OK ] Reached target Local File Systems. Starting Create Volatile Files and Directories... Starting Apply Kernel Variables... [ OK ] Started Setup Virtual Console. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Apply Kernel Variables. Starting Create Static Device Nodes in /dev... Starting dracut cmdline hook... [ OK ] Started Create Volatile Files and Directories. [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started Journal Service. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ 4.200404] device-mapper: uevent: version 1.0.3 [ 4.202609] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting dracut pre-trigger hook... [ OK ] Started dracut pre-trigger hook. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. [ 4.836303] random: fast init done [ OK ] Reached target System Initialization. [ OK ] Reached target Basic System. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. Starting dracut initqueue hook... [ 4.945812] virtio_net virtio0 ens2: renamed from eth0 [ 4.999660] scsi host0: ata_piix [ 5.066484] scsi host1: ata_piix [ 5.068148] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc320 irq 14 [ 5.070890] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc328 irq 15 [ 8.935539] dracut-initqueue[587]: RTNETLINK answers: File exists [ 9.965333] random: crng init done [ 9.966887] random: 7 urandom warning(s) missed due to ratelimiting Starting nbd nbd0... [ OK ] Started nbd nbd0. [ OK ] Started dracut initqueue hook. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Mounting /sysroot... [ 10.489636] EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped dracut pre-pivot and cleanup hook. Stopping Hardware RNG Entropy Gatherer Daemon... [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Timers. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped Hardware RNG Entropy Gatherer Daemon. [ OK ] Stopped target Basic System. [ OK ] Stopped target Sockets. [ OK ] Stopped target Slices. [ OK ] Stopped target Paths. [ OK ] Stopped target System Initialization. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped dracut pre-trigger hook. Stopping udev Kernel Device Manager... [ OK ] Stopped target Local Encrypted Volumes. [ OK ] Stopped Dispatch Password Requests to Console Directory Watch. [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Swap. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Reached target Switch Root. Starting Switch Root... [ 11.750809] printk: systemd: 26 output lines suppressed due to ratelimiting [ 12.026469] SELinux: Disabled at runtime. [ 12.093813] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 12.100298] systemd[1]: Detected virtualization kvm. [ 12.102906] systemd[1]: Detected architecture x86-64. Welcome to Rocky Linux 8.10 (Green Obsidian)! [ 12.604648] systemd[1]: initrd-switch-root.service: Succeeded. [ 12.607700] systemd[1]: Stopped Switch Root. [ OK ] Stopped Switch Root. [ 12.611794] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. [ 12.615055] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 12.619351] systemd[1]: Stopped Journal Service. [ OK ] Stopped Journal Service. [ 12.627858] systemd[1]: Starting Journal Service... Starting Journal Service... [ 12.633337] systemd[1]: Created slice system-serial\x2dgetty.slice. [ OK ] Created slice system-serial\x2dgetty.slice. [ OK ] Listening on initctl Compatibility Named Pipe. Mounting POSIX Message Queue File System... [ OK ] Listening on RPCbind Server Activation Socket. Starting Remount Root and Kernel File Systems... [ OK ] Created slice User and Session Slice. [ OK ] Started Forward Password Requests to Wall Directory Watch. Mounting Kernel Debug File System... [ OK ] Stopped target Switch Root. Mounting Huge Pages File System... [ OK ] Created slice system-getty.slice. [ OK ] Stopped target Initrd File Systems. [ OK ] Stopped target Initrd Root File System. [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Reached target Paths. [ OK ] Created slice system-sshd\x2dkeygen.slice. Activating swap /dev/disk/by-label/SWAP... [ OK ] Reached target RPC Port Mapper. [FAILED] Failed to set up automount Arbitrar…rmats File System Automount Point. See 'systemctl status proc-sys-fs-binfmt_misc.automount' for details. Starting Apply Kernel Variables... [ OK ] Reached target Local Encrypted Volumes. [ 12.763377] Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS [ OK ] Listening on udev Control Socket. [ OK ] Reached target Slices. [ OK ] Reached target rpc_pipefs.target. Starting Create list of required st…ce nodes for the current kernel... [ OK ] Listening on udev Kernel Socket. Starting udev Coldplug all Devices... [ OK ] Listening on Process Core Dump Socket. [ OK ] Started Journal Service. [ OK ] Mounted POSIX Message Queue File System. [FAILED] Failed to start Remount Root and Kernel File Systems. See 'systemctl status systemd-remount-fs.service' for details. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Huge Pages File System. [ OK ] Activated swap /dev/disk/by-label/SWAP. [ OK ] Started Apply Kernel Variables. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Reached target Swap. Starting Configure read-only root support... Starting Create Static Device Nodes in /dev... Starting Flush Journal to Persistent Storage... [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Reached target Local File Systems (Pre). Mounting /mnt... Mounting /home/green/git/lustre-release... Starting udev Kernel Device Manager... [ OK ] Mounted /mnt. [ 13.153272] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ OK ] Mounted /home/green/git/lustre-release. [ OK ] Started udev Coldplug all Devices. [ OK ] Started udev Kernel Device Manager. [ 13.597089] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 13.670747] input: PC Speaker as /devices/platform/pcspkr/input/input5 [ 13.776226] RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer [ 13.792173] EDAC sbridge: Ver: 1.1.2 [ 15.367581] Key type dns_resolver registered [ 15.650458] NFS: Registering the id_resolver key type [ 15.652456] Key type id_resolver registered [ 15.654237] Key type id_legacy registered [ OK ] Started Configure read-only root support. Starting Load/Save Random Seed... [ OK ] Reached target Local File Systems. Starting Mark the need to relabel after reboot... Starting Rebuild Dynamic Linker Cache... Starting Create Volatile Files and Directories... [ OK ] Started Load/Save Random Seed. [ OK ] Started Mark the need to relabel after reboot. [ OK ] Started Create Volatile Files and Directories. Starting RPC Bind... Starting Update UTMP about System Boot/Shutdown... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Started RPC Bind. [ OK ] Started Rebuild Dynamic Linker Cache. Starting Update is Completed... [ OK ] Started Update is Completed. [ OK ] Reached target System Initialization. [ OK ] Started dnf makecache --timer. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. [ OK ] Started irqbalance daemon. Starting Restore /run/initramfs on shutdown... [ OK ] Started D-Bus System Message Bus. Starting Login Service... [ OK ] Reached target sshd-keygen.target. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Reached target Timers. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. Starting Network Manager... [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Login Service. [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting Dynamic System Tuning Daemon... Starting OpenSSH server daemon... Starting GSSAPI Proxy Daemon... Starting Network Manager Wait Online... [ OK ] Started OpenSSH server daemon. Starting Hostname Service... [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Started Permit User Sessions. [ OK ] Started Getty on tty1. [ OK ] Started Command Scheduler. [ OK ] Started Serial Getty on ttyS0. [ OK ] Started Serial Getty on ttyS1. [ OK ] Reached target Login Prompts. [ OK ] Started Hostname Service. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting System Logging Service... Starting Crash recovery kernel arming... Starting Notify NFS peers of a restart... [ OK ] Started Notify NFS peers of a restart. [ OK ] Started System Logging Service. Starting Authorization Manager... [ OK ] Started Authorization Manager. [ OK ] Started Dynamic System Tuning Daemon. [ OK ] Reached target Multi-User System. [ OK ] Reached target Graphical Interface. Starting Update UTMP about System Runlevel Changes... [ OK ] Started Update UTMP about System Runlevel Changes. Rocky Linux 8.10 (Green Obsidian) Kernel 4.18.0rh8.10-debug on an x86_64 oleg130-server login: [ 44.207269] libcfs: loading out-of-tree module taints kernel. [ 44.229480] Key type ._llcrypt registered [ 44.231263] Key type .llcrypt registered [ 44.286102] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_hostid [ 61.966453] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 63.821284] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 63.843279] alg: No test for adler32 (adler32-zlib) [ 65.544736] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 66.861491] LNet: Added LNI 192.168.201.130@tcp [8/256/0/180] [ 68.808243] Key type lgssc registered [ 70.783686] Lustre: Echo OBD driver; http://www.lustre.org/ [ 83.478040] hrtimer: interrupt took 7030152 ns [ 89.467835] ZFS: Loaded module v2.3.2-1, ZFS pool version 5000, ZFS filesystem version 5 [ 128.021460] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 140.051862] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 140.088194] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 141.372358] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 141.402858] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 141.470563] Lustre: lustre-MDT0000: new disk, initializing [ 141.538648] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 141.559728] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 145.894671] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 156.465237] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 156.567847] Lustre: 6524:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 156.589936] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 156.593677] Lustre: Skipped 1 previous similar message [ 156.651514] Lustre: lustre-MDT0001: new disk, initializing [ 156.707124] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 156.731429] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 156.736877] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 159.760650] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 163.480720] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 168.786314] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 168.935958] Lustre: lustre-OST0000: new disk, initializing [ 168.938071] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 168.942844] Lustre: 8461:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 168.980271] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 172.517346] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 173.560037] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 173.565246] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 173.592160] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 181.314324] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 181.404852] Lustre: lustre-OST0001: new disk, initializing [ 181.407700] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 181.411037] Lustre: 9534:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 181.444615] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 181.802223] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 181.806440] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 181.834594] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 184.228577] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 192.812871] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 196.763501] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 200.400816] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing check_logdir /tmp/testlogs/ [ 203.142400] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing yml_node [ 205.577697] Lustre: DEBUG MARKER: Client: 2.17.55.26 [ 206.884492] Lustre: DEBUG MARKER: MDS: 2.17.55.26 [ 208.244653] Lustre: DEBUG MARKER: OSS: 2.17.55.26 [ 209.177209] Lustre: DEBUG MARKER: -----============= acceptance-small: conf-sanity ============----- Tue Sep 8 17:39:02 EDT 2026 [ 217.076085] Lustre: DEBUG MARKER: excepting tests: 102 106 115 32newtarball [ 217.748788] Lustre: DEBUG MARKER: skipping tests SLOW=no: 45 69 106 111 114 [ 232.930022] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 232.930431] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 232.936367] Lustre: Skipped 3 previous similar messages [ 232.939491] Lustre: Skipped 2 previous similar messages [ 238.468771] Lustre: server umount lustre-MDT0000 complete [ 240.394448] LustreError: 6515:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788903574 with bad export cookie 8843280874130424044 [ 240.394810] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 240.403938] LustreError: 6515:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 243.169507] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 243.169996] LustreError: 6532:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 243.170753] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 243.181023] Lustre: Skipped 1 previous similar message [ 243.186618] LustreError: 6532:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 6 previous similar messages [ 245.216598] LustreError: 6531:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 245.216637] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 245.222841] LustreError: 6531:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 245.224483] Lustre: Skipped 2 previous similar messages [ 246.629239] Lustre: server umount lustre-MDT0001 complete [ 248.525767] Lustre: server umount lustre-OST0000 complete [ 250.442833] Lustre: server umount lustre-OST0001 complete [ 253.413544] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_hostid [ 257.633618] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 272.977321] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 273.102248] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 273.129831] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 273.181771] Lustre: lustre-MDT0000: new disk, initializing [ 273.225202] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 273.233714] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 275.114106] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 280.198712] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 280.248624] Lustre: 15075:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 280.359988] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 282.027532] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 286.397807] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 288.585403] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 291.440242] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 291.578578] Lustre: lustre-OST0000: new disk, initializing [ 291.580096] Lustre: Skipped 1 previous similar message [ 291.583400] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 291.586099] Lustre: Skipped 2 previous similar messages [ 291.588474] Lustre: 17044:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 291.625039] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 291.627713] Lustre: Skipped 1 previous similar message [ 293.518682] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 293.522301] Lustre: Skipped 1 previous similar message [ 293.525069] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 293.576879] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 293.968460] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 298.069676] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 299.684542] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 299.762475] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 301.196975] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 301.272839] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 304.100350] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 304.102030] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 304.103036] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 304.105515] Lustre: Skipped 1 previous similar message [ 309.218767] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 309.221308] Lustre: Skipped 2 previous similar messages [ 316.384366] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 316.447126] Lustre: server umount lustre-OST0000 complete [ 319.457945] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 319.458891] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 319.471731] Lustre: Skipped 1 previous similar message [ 319.474690] Lustre: Skipped 2 previous similar messages [ 332.256127] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 332.331532] Lustre: server umount lustre-MDT0000 complete [ 333.781489] LustreError: 15067:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788903667 with bad export cookie 8843280874130425577 [ 333.788344] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 333.933178] Lustre: server umount lustre-MDT0001 complete [ 335.925548] Lustre: DEBUG MARKER: == conf-sanity test 76a: set permanent params with lctl across mounts ========================================================== 17:41:09 (1788903669) [ 338.635720] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 338.845638] LustreError: 19305:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 338.871339] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 340.609745] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 343.728128] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 345.185699] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 347.765436] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 349.753096] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 352.286985] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 354.558804] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 357.147655] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 369.968514] Lustre: Modifying parameter general.osc.*.max_dirty_mb=452 in log params [ 374.245240] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 374.246107] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 374.255739] Lustre: Skipped 2 previous similar messages [ 374.258485] Lustre: Skipped 6 previous similar messages [ 378.444389] Lustre: server umount lustre-MDT0000 complete [ 379.363404] LustreError: 21798:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 379.372192] LustreError: 21798:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 379.950286] LustreError: 19286:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788903713 with bad export cookie 8843280874130426459 [ 379.953881] LustreError: 19286:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 6 previous similar messages [ 379.955187] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 380.079990] Lustre: server umount lustre-MDT0001 complete [ 391.900421] Lustre: server umount lustre-OST0000 complete [ 399.658423] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 403.617061] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 403.773736] LustreError: 23703:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 403.788995] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 403.791379] Lustre: Skipped 2 previous similar messages [ 405.260777] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 408.393963] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 410.028569] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 411.022251] Lustre: Setting parameter general.debug_raw_pointers=Y in log params [ 413.266502] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 415.314225] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 418.270293] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 418.334546] Lustre: lustre-OST0001: new disk, initializing [ 418.337230] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 418.340568] Lustre: 26014:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 419.908201] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 419.912562] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 419.955138] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 420.597860] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 425.473498] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 428.444716] Lustre: Setting parameter general.obdfilter.*.client_cache_count=256 in log params [ 428.448039] Lustre: Skipped 1 previous similar message [ 430.562290] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 430.563331] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 430.565841] Lustre: Skipped 3 previous similar messages [ 430.569033] Lustre: Skipped 4 previous similar messages [ 436.277076] Lustre: server umount lustre-MDT0000 complete [ 437.808589] LustreError: 26780:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788903771 with bad export cookie 8843280874130427306 [ 437.810875] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 437.813091] LustreError: 26780:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 437.951844] Lustre: server umount lustre-MDT0001 complete [ 449.028830] Lustre: server umount lustre-OST0000 complete [ 460.761428] Lustre: server umount lustre-OST0001 complete [ 466.791444] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 470.657733] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 470.818307] LustreError: 28975:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 470.846061] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 470.848242] Lustre: Skipped 3 previous similar messages [ 472.264452] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 475.442097] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 477.283793] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 478.403540] Lustre: 30122:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 481.113914] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 483.595572] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 486.994863] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 489.570034] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 498.277524] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 499.559305] Lustre: 32002:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 501.216896] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 501.219389] LustreError: Skipped 1 previous similar message [ 501.220580] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 501.225285] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 501.226936] Lustre: Skipped 4 previous similar messages [ 507.289430] Lustre: server umount lustre-MDT0000 complete [ 508.556835] LustreError: 32004:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788903842 with bad export cookie 8843280874130428538 [ 508.559457] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 508.561417] LustreError: 32004:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 508.680409] Lustre: server umount lustre-MDT0001 complete [ 519.107566] Lustre: server umount lustre-OST0000 complete [ 530.649052] Lustre: server umount lustre-OST0001 complete [ 533.273312] Lustre: DEBUG MARKER: == conf-sanity test 76b: verify params log setup correctly ========================================================== 17:44:26 (1788903866) [ 542.126073] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 545.366429] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 545.486612] LustreError: 34797:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 545.492889] LustreError: 34797:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 546.702105] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 549.544418] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 551.122644] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 552.116788] Lustre: 35946:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 554.564964] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 556.853870] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 559.929969] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 561.854312] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 565.012607] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 566.216219] Lustre: 37822:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 570.341113] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 570.341128] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 570.347122] Lustre: Skipped 6 previous similar messages [ 573.593586] Lustre: server umount lustre-MDT0000 complete [ 574.812259] LustreError: 34780:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788903908 with bad export cookie 8843280874130429637 [ 574.816260] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 574.817154] LustreError: 34780:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 574.928159] Lustre: server umount lustre-MDT0001 complete [ 586.501333] Lustre: server umount lustre-OST0000 complete [ 597.083724] Lustre: server umount lustre-OST0001 complete [ 599.766273] Lustre: DEBUG MARKER: == conf-sanity test 76c: verify changelog_mask is applied with lctl set_param -P ========================================================== 17:45:33 (1788903933) [ 604.552016] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 607.642529] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 607.778980] LustreError: 39958:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 607.785805] LustreError: 39958:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [ 607.797522] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 607.799488] Lustre: Skipped 7 previous similar messages [ 608.958773] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 611.603304] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 612.986616] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 613.888837] Lustre: 41107:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 615.956924] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 617.960787] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 620.688678] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 622.600330] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 625.592320] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 626.977647] Lustre: Setting parameter general.mdd.*.changelog_mask=-CLOSE in log params [ 630.103638] Lustre: server umount lustre-MDT0000 complete [ 631.313292] LustreError: 40708:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788903965 with bad export cookie 8843280874130430722 [ 631.317755] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 631.318186] LustreError: 40708:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 632.290704] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 632.292970] Lustre: Skipped 10 previous similar messages [ 637.473917] Lustre: server umount lustre-MDT0001 complete [ 640.171639] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 641.248129] LustreError: 43840:0:(import.c:339:ptlrpc_invalidate_import()) MGS: timeout waiting for callback (1 != 0) [ 641.251116] LustreError: 43840:0:(import.c:363:ptlrpc_invalidate_import()) @@@ still on sending list req@ffff88d4c4a3ed80 x1875801171853952/t0(0) o250->MGC192.168.201.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788903975 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 [ 641.258468] LustreError: 43840:0:(import.c:373:ptlrpc_invalidate_import()) MGS: Unregistering RPCs found (0). Network is sluggish? Waiting for them to error out. [ 641.440638] LustreError: 3657:0:(client.c:1391:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff88d4c4a3ce00 x1875801171855616/t0(0) o250->MGC192.168.201.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 642.963590] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 645.878768] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 647.475642] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 649.886958] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 659.540619] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 9 sec [ 661.323503] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 661.479524] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 661.813269] Lustre: DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec [ 666.598822] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 666.599849] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 666.602343] Lustre: Skipped 6 previous similar messages [ 669.145460] Lustre: server umount lustre-MDT0000 complete [ 670.339686] LustreError: 40708:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788904004 with bad export cookie 8843280874130431814 [ 670.342500] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 670.343286] LustreError: 40708:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 670.463071] Lustre: server umount lustre-MDT0001 complete [ 681.925978] Lustre: server umount lustre-OST0000 complete [ 693.341353] Lustre: server umount lustre-OST0001 complete [ 696.194760] Lustre: DEBUG MARKER: == conf-sanity test 76d: verify llite.*.xattr_cache can be set by 'lctl set_param -P' correctly ========================================================== 17:47:09 (1788904029) [ 701.540758] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 704.985525] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 705.109324] LustreError: 47580:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 705.115865] LustreError: 47580:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 7 previous similar messages [ 706.424545] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 709.155837] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 710.695463] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 711.669331] Lustre: 48732:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 711.672532] Lustre: 48732:0:(mgs_llog.c:1450:mgs_modify_param()) Skipped 1 previous similar message [ 713.779871] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 715.846833] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 718.557620] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 720.564891] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 723.608597] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 725.053230] Lustre: Setting parameter general.llite.*.xattr_cache=0 in log params [ 730.083988] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 735.379779] Lustre: server umount lustre-MDT0000 complete [ 736.566258] LustreError: 47563:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788904070 with bad export cookie 8843280874130432640 [ 736.569279] LustreError: 47563:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 736.569586] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 736.678108] Lustre: server umount lustre-MDT0001 complete [ 747.524926] Lustre: server umount lustre-OST0000 complete [ 758.056383] Lustre: server umount lustre-OST0001 complete [ 761.310472] Lustre: DEBUG MARKER: == conf-sanity test 77: comma-separated MGS NIDs and failover node NIDs ========================================================== 17:48:14 (1788904094) [ 762.126181] Lustre: DEBUG MARKER: SKIP: conf-sanity test_77 mixed loopback and real device not working [ 762.685918] Lustre: DEBUG MARKER: == conf-sanity test 78: run resize2fs on MDT and OST filesystems ========================================================== 17:48:16 (1788904096) [ 766.070928] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_hostid [ 768.756051] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 776.062647] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 776.149570] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 776.185431] Lustre: lustre-MDT0000: new disk, initializing [ 776.208383] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 777.488980] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 781.146488] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 783.364081] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 783.473779] Lustre: 54792:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 785.027448] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 785.036644] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 785.401128] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 789.087227] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 789.783703] Lustre: DEBUG MARKER: create test files [ 800.737833] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 800.738128] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 800.743336] Lustre: Skipped 4 previous similar messages [ 805.266664] Lustre: server umount lustre-OST0000 complete [ 806.675766] Lustre: server umount lustre-MDT0000 complete [ 810.106317] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing unload_modules_local [ 811.053648] Key type lgssc unregistered [ 811.172668] LNet: 56398:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 811.174610] LNetError: 56398:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 811.183238] LNet: Removed LNI 192.168.201.130@tcp [ 811.509121] Key type .llcrypt unregistered [ 811.510640] Key type ._llcrypt unregistered [ 821.761568] Key type ._llcrypt registered [ 821.763069] Key type .llcrypt registered [ 821.809519] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 822.288748] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 822.301759] alg: No test for adler32 (adler32-zlib) [ 823.207595] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 823.354264] LNet: Added LNI 192.168.201.130@tcp [8/256/0/180] [ 824.952740] Key type lgssc registered [ 825.898518] Lustre: Echo OBD driver; http://www.lustre.org/ [ 832.064047] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 832.099375] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 833.662462] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 838.179842] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 847.101248] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 854.652953] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 855.286862] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 858.372323] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:102 to 0x240000400:129) [ 858.478498] Lustre: 59110:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 511 < left 544, rollback = 9 [ 858.487748] Lustre: 59110:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 32/128/4, destroy: 0/0/0 [ 858.505055] Lustre: 59110:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 858.515544] Lustre: 59110:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/18/1, punch: 0/0/0, quota 1/3/0 [ 858.525270] Lustre: 59110:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 858.542139] Lustre: 59110:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 862.139785] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 868.535710] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 875.341620] Lustre: DEBUG MARKER: check files after expanding the MDT and OST filesystems [ 880.480140] Lustre: DEBUG MARKER: create more files after expanding the MDT and OST filesystems [ 889.315937] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 889.343722] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 893.874187] Lustre: server umount lustre-OST0000 complete [ 902.961906] Lustre: server umount lustre-MDT0000 complete [ 924.097517] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing unload_modules_local [ 932.050907] Key type lgssc unregistered [ 932.564336] LNet: 60747:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 932.570881] LNetError: 60747:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 933.614072] LNet: Removed LNI 192.168.201.130@tcp [ 936.390989] Key type .llcrypt unregistered [ 936.399906] Key type ._llcrypt unregistered [ 978.764533] Key type ._llcrypt registered [ 978.769143] Key type .llcrypt registered [ 978.897291] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 979.942920] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 979.963962] alg: No test for adler32 (adler32-zlib) [ 980.947617] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 981.113397] LNet: Added LNI 192.168.201.130@tcp [8/256/0/180] [ 982.824199] Key type lgssc registered [ 984.154348] Lustre: Echo OBD driver; http://www.lustre.org/ [ 995.620701] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 995.631825] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 997.118037] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1002.657418] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 1012.095922] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1019.657167] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1020.095051] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1022.152387] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:140 to 0x240000400:161) [ 1022.281890] Lustre: 63588:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 509 < left 544, rollback = 9 [ 1022.291440] Lustre: 63588:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 32/128/6, destroy: 0/0/0 [ 1022.296124] Lustre: 63588:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 1022.306558] Lustre: 63588:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/18/1, punch: 0/0/0, quota 1/3/0 [ 1022.320528] Lustre: 63588:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 1022.348411] Lustre: 63588:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 1026.704305] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 1036.039261] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1042.746574] Lustre: DEBUG MARKER: check files after shrinking the MDT and OST filesystems [ 1053.153550] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1053.168139] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1053.214733] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1058.283623] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1058.621498] Lustre: server umount lustre-OST0000 complete [ 1063.460780] Lustre: server umount lustre-MDT0000 complete [ 1076.338832] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing unload_modules_local [ 1079.749794] Key type lgssc unregistered [ 1080.164364] LNet: 65147:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1080.178092] LNetError: 65147:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1080.199509] LNet: Removed LNI 192.168.201.130@tcp [ 1081.009302] Key type .llcrypt unregistered [ 1081.014077] Key type ._llcrypt unregistered [ 1100.888637] Key type ._llcrypt registered [ 1100.892527] Key type .llcrypt registered [ 1100.988364] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_hostid [ 1115.704788] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 1116.571545] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1116.589571] alg: No test for adler32 (adler32-zlib) [ 1117.967199] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 1118.129691] LNet: Added LNI 192.168.201.130@tcp [8/256/0/180] [ 1119.800988] Key type lgssc registered [ 1120.751431] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1160.721132] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1160.734329] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1162.045447] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1162.081563] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1162.192489] Lustre: lustre-MDT0000: new disk, initializing [ 1162.283514] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1162.304837] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1167.915242] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 1180.441946] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1180.631432] Lustre: 68316:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1180.737556] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 1180.741802] Lustre: Skipped 1 previous similar message [ 1180.911694] Lustre: lustre-MDT0001: new disk, initializing [ 1181.117433] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1181.199313] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 1181.220503] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1187.093215] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 1198.428795] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1205.156157] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 1214.195650] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1214.652668] Lustre: lustre-OST0000: new disk, initializing [ 1214.663215] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1214.669940] Lustre: 70283:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1214.827795] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1222.209705] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 1222.222477] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1222.228161] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 1222.404538] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1233.809308] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1239.356200] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1239.552743] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1244.784558] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1245.106786] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1248.233426] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1248.234055] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1248.247399] LustreError: Skipped 1 previous similar message [ 1248.286455] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1248.292328] Lustre: Skipped 1 previous similar message [ 1253.363507] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1253.370400] Lustre: Skipped 1 previous similar message [ 1253.672555] Lustre: server umount lustre-OST0000 complete [ 1258.472752] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1258.477818] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1258.486170] Lustre: Skipped 2 previous similar messages [ 1258.506433] Lustre: Skipped 1 previous similar message [ 1263.585399] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1263.599096] Lustre: Skipped 1 previous similar message [ 1264.368910] Lustre: server umount lustre-MDT0000 complete [ 1268.062762] LustreError: 68306:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788904602 with bad export cookie 14274984365970877550 [ 1268.077532] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1268.082859] LustreError: 68306:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 1268.478451] Lustre: server umount lustre-MDT0001 complete [ 1278.190907] Lustre: DEBUG MARKER: == conf-sanity test 79: format MDT/OST without mgs option (should return errors) ========================================================== 17:56:50 (1788904610) [ 1291.066051] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 1334.830392] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_hostid [ 1346.249893] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 1394.496620] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1394.808806] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1394.866197] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1394.917786] Lustre: lustre-MDT0000: new disk, initializing [ 1395.015111] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1395.029891] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1398.545560] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 1407.481686] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1407.543329] Lustre: 76307:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1407.570941] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 1407.572872] Lustre: Skipped 1 previous similar message [ 1407.627791] Lustre: lustre-MDT0001: new disk, initializing [ 1407.720287] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1407.745989] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 1407.750872] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1411.230199] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 1420.361627] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1424.455825] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 1430.408418] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1430.606252] Lustre: lustre-OST0000: new disk, initializing [ 1430.611350] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1430.614994] Lustre: 78279:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1430.671988] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1434.712264] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 1440.799043] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 1440.804263] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1440.886276] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1441.401022] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1444.389200] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1444.583064] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1447.601822] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1447.735201] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1450.980306] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1450.984699] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1450.987078] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1450.997919] Lustre: Skipped 1 previous similar message [ 1451.007722] Lustre: Skipped 1 previous similar message [ 1461.224423] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1461.227978] Lustre: Skipped 3 previous similar messages [ 1463.264535] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 1463.369228] Lustre: server umount lustre-OST0000 complete [ 1466.337826] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1466.345797] Lustre: Skipped 1 previous similar message [ 1471.874520] Lustre: server umount lustre-MDT0000 complete [ 1473.914905] LustreError: 76300:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788904807 with bad export cookie 14274984365970878439 [ 1473.915573] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1473.921434] LustreError: 76300:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 1474.083432] Lustre: server umount lustre-MDT0001 complete [ 1479.259723] Lustre: DEBUG MARKER: == conf-sanity test 80: mgc import reconnect race ======== 18:00:12 (1788904812) [ 1483.439645] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1483.734360] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1486.189811] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 1488.865466] LustreError: 80688:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1488.872288] LustreError: 80688:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 1491.089540] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1494.240186] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 1498.638941] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1501.801950] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 1506.007522] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1510.014362] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 1514.677825] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1516.839429] Lustre: 83357:0:(genops.c:1803:obd_export_evict_by_uuid()) MGS: evicting 00baede3-87d2-4cb2-9b74-39c25445b9c5 at adminstrative request [ 1521.639339] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1521.644049] Lustre: *** cfs_fail_loc=906, val=2147483648*** [ 1531.876858] Lustre: MGS: Client 00baede3-87d2-4cb2-9b74-39c25445b9c5 (at 0@lo) reconnecting [ 1531.886798] Lustre: Evicted from MGS (at 0@lo) after server handle changed from 0xc61aeea613f2f352 to 0xc61aeea613f2f5f9 [ 1531.900535] Lustre: MGC192.168.201.130@tcp: Connection restored to 0@lo (at 0@lo) [ 1551.329586] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1551.453166] Lustre: lustre-OST0001: new disk, initializing [ 1551.455321] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 1551.458237] Lustre: 83763:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1551.521571] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 1551.524859] Lustre: Skipped 2 previous similar messages [ 1555.241131] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 1561.605419] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1561.636362] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 1561.644922] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 1561.723687] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 1566.696686] LustreError: lustre-OST0001-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1566.701433] Lustre: lustre-OST0001-osc-MDT0001: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1566.707246] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 1566.711460] Lustre: Skipped 1 previous similar message [ 1566.717920] Lustre: Skipped 5 previous similar messages [ 1569.521495] Lustre: server umount lustre-OST0001 complete [ 1571.817453] LustreError: 82508:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1571.844687] LustreError: 82508:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 1572.834380] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1574.882886] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1574.893229] Lustre: Skipped 1 previous similar message [ 1576.943414] LustreError: 82507:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1576.952628] LustreError: 82507:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 1578.088729] Lustre: server umount lustre-OST0000 complete [ 1586.298629] Lustre: server umount lustre-MDT0000 complete [ 1587.169782] LustreError: 83393:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1587.177960] LustreError: 83393:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 1588.001147] LustreError: 80668:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788904922 with bad export cookie 14274984365970879993 [ 1588.003980] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1588.005660] LustreError: 80668:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 1588.189622] Lustre: server umount lustre-MDT0001 complete [ 1592.741192] Lustre: DEBUG MARKER: == conf-sanity test 81: sparse OST indexing ============== 18:02:06 (1788904926) [ 1593.740175] Lustre: DEBUG MARKER: SKIP: conf-sanity test_81 needs >= 3 OSTs [ 1594.652940] Lustre: DEBUG MARKER: == conf-sanity test 82a: specify OSTs for file (succeed) or directory (succeed) ========================================================== 18:02:07 (1788904927) [ 1595.489211] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82a needs >= 3 OSTs [ 1596.483902] Lustre: DEBUG MARKER: == conf-sanity test 82b: specify OSTs for file with --pool and --ost-list options ========================================================== 18:02:09 (1788904929) [ 1597.357271] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82b needs >= 4 OSTs [ 1598.311934] Lustre: DEBUG MARKER: == conf-sanity test 82c: specify sparse OSTs for setstripe (should not crash) ========================================================== 18:02:11 (1788904931) [ 1599.171877] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82c needs >= 4 OSTs [ 1600.185629] Lustre: DEBUG MARKER: == conf-sanity test 83: ENOSPACE on OST doesn't cause message VFS: Busy inodes after unmount ... ========================================================== 18:02:13 (1788904933) [ 1601.048929] Lustre: DEBUG MARKER: mount the OST /dev/mapper/ost1_flakey as a ldiskfs filesystem [ 1604.137125] loop: module loaded [ 1604.144803] loop0: detected capacity change from 0 to 4294967296 [ 1604.166880] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 1604.958066] Lustre: DEBUG MARKER: run llverfs in partial mode on the OST ldiskfs /mnt/lustre-ost1 [ 1606.579959] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing run_llverfs /mnt/lustre-ost1 -vpl no [ 1608.554899] Lustre: DEBUG MARKER: unmount the OST /dev/mapper/ost1_flakey [ 1621.321039] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1621.342851] LustreError: 87876:0:(obd_config.c:845:class_setup()) setup lustre-OST0000-osd failed (-28) [ 1621.347158] LustreError: 87876:0:(obd_mount.c:259:lustre_start_simple()) lustre-OST0000-osd setup error -28 [ 1621.351635] LustreError: 87876:0:(tgt_mount.c:2671:server_fill_super()) Unable to start osd on /dev/mapper/ost1_flakey: -28 [ 1621.354759] LustreError: 87876:0:(super25.c:178:lustre_fill_super()) llite: Unable to mount : rc = -28 [ 1630.681703] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_hostid [ 1635.670183] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 1652.639015] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1652.755401] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1652.773863] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1652.811677] Lustre: lustre-MDT0000: new disk, initializing [ 1652.839746] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1652.848375] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1654.438440] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 1658.940563] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1658.979407] Lustre: 90737:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1659.078764] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1660.611270] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 1664.700490] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1666.752832] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 1669.250660] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1669.354196] Lustre: 92705:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1671.482249] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 1675.524724] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1677.143273] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1678.340033] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1678.382601] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1679.270772] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 2 sec [ 1680.906970] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1680.985772] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1683.425662] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1683.427359] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1683.430179] LustreError: Skipped 2 previous similar messages [ 1683.434031] Lustre: Skipped 2 previous similar messages [ 1683.434606] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1683.441467] Lustre: Skipped 7 previous similar messages [ 1687.825363] Lustre: server umount lustre-OST0000 complete [ 1703.392120] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 1703.458851] Lustre: server umount lustre-MDT0000 complete [ 1703.905047] LustreError: 91537:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1703.911535] LustreError: 91537:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 1704.740373] LustreError: 90728:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788905038 with bad export cookie 14274984365970880609 [ 1704.743228] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1704.743982] LustreError: 90728:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 1704.862194] Lustre: server umount lustre-MDT0001 complete [ 1707.681326] Lustre: DEBUG MARKER: == conf-sanity test 84: check recovery_hard_time ========= 18:04:01 (1788905041) [ 1709.906192] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1711.461834] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 1714.445706] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1715.928285] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 1718.465968] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1720.394189] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 1722.766808] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1724.784481] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 1727.217875] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1728.727056] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1735.939429] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 7 sec [ 1737.286899] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1737.361139] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1739.703664] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1739.777203] Lustre: lustre-OST0001: new disk, initializing [ 1739.778758] Lustre: Skipped 2 previous similar messages [ 1739.780779] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 1739.783039] Lustre: Skipped 3 previous similar messages [ 1739.785671] Lustre: 98548:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1741.830343] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 1745.495892] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1746.444082] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 1746.446218] Lustre: Skipped 2 previous similar messages [ 1746.449567] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 1746.490975] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 1746.883676] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid 50 [ 1746.958216] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1748.406351] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [ 1748.482336] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1758.708129] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 1763.834988] Lustre: Failing over lustre-MDT0000 [ 1764.073828] Lustre: server umount lustre-MDT0000 complete [ 1765.527649] LustreError: 98556:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1765.533156] LustreError: 98556:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 1765.857462] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1765.860046] LustreError: Skipped 1 previous similar message [ 1765.861406] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1765.865673] Lustre: Skipped 3 previous similar messages [ 1779.005042] LDISKFS-fs (dm-0): 4 truncates cleaned up [ 1779.006902] LDISKFS-fs (dm-0): recovery complete [ 1779.010375] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1779.051875] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1779.184155] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 1780.663719] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 1780.879349] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 1780.880365] Lustre: 95127:0:(ldlm_lib.c:2084:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 1784.289945] Lustre: 95872:0:(ldlm_lib.c:2084:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 1784.293243] Lustre: 95872:0:(ldlm_lib.c:2084:extend_recovery_timer()) Skipped 1 previous similar message [ 1784.297992] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 1784.316564] LustreError: 101369:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1784.632086] LustreError: 101369:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1784.946317] LustreError: 101369:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1784.948992] LustreError: 101369:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 1 previous similar message [ 1785.264166] LustreError: 101369:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1785.267105] LustreError: 101369:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 1 previous similar message [ 1785.586405] Lustre: 101369:0:(ldlm_lib.c:2084:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 1785.590255] Lustre: 101369:0:(ldlm_lib.c:2084:extend_recovery_timer()) Skipped 8 previous similar messages [ 1786.218491] LustreError: 101369:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1786.223330] LustreError: 101369:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 3 previous similar messages [ 1786.544122] LustreError: 101369:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1786.547866] LustreError: 101369:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 3 previous similar messages [ 1787.800912] Lustre: 101369:0:(ldlm_lib.c:2084:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 1787.804232] Lustre: 101369:0:(ldlm_lib.c:2084:extend_recovery_timer()) Skipped 6 previous similar messages [ 1788.432917] LustreError: 101369:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1788.436040] LustreError: 101369:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 6 previous similar messages [ 1788.752107] LustreError: 101369:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1788.755125] LustreError: 101369:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 6 previous similar messages [ 1791.882088] Lustre: 101369:0:(ldlm_lib.c:2084:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 1791.885658] Lustre: 101369:0:(ldlm_lib.c:2084:extend_recovery_timer()) Skipped 12 previous similar messages [ 1792.514419] LustreError: 101369:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1792.518302] LustreError: 101369:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 12 previous similar messages [ 1792.832169] LustreError: 101369:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1792.834238] LustreError: 101369:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 12 previous similar messages [ 1800.019059] Lustre: 101369:0:(ldlm_lib.c:2084:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 1800.023256] Lustre: 101369:0:(ldlm_lib.c:2084:extend_recovery_timer()) Skipped 25 previous similar messages [ 1800.649919] LustreError: 101369:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1800.653412] LustreError: 101369:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 25 previous similar messages [ 1800.968123] LustreError: 101369:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1800.970764] LustreError: 101369:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 25 previous similar messages [ 1816.273653] Lustre: 101369:0:(ldlm_lib.c:2084:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 1816.277377] Lustre: 101369:0:(ldlm_lib.c:2084:extend_recovery_timer()) Skipped 51 previous similar messages [ 1816.906462] LustreError: 101369:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 1816.909747] LustreError: 101369:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 51 previous similar messages [ 1817.224116] LustreError: 101369:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 1817.226720] LustreError: 101369:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 51 previous similar messages [ 1840.008137] Lustre: 101369:0:(ldlm_lib.c:2393:target_recovery_overseer()) lustre-MDT0000 recovery is aborted by hard timeout [ 1840.010683] Lustre: 101369:0:(ldlm_lib.c:2403:target_recovery_overseer()) recovery is aborted, evict exports in recovery [ 1840.013316] Lustre: 101369:0:(genops.c:1630:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client 2e2df53b-6782-404e-9f98-0872cfe3c212@192.168.201.30@tcp [ 1840.016454] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 1840.018416] Lustre: 101369:0:(ldlm_lib.c:1913:abort_req_replay_queue()) @@@ aborted: req@00000000866dda96 x1875802260047232/t0(8589934775) o101->2e2df53b-6782-404e-9f98-0872cfe3c212@192.168.201.30@tcp:634/0 lens 592/0 e 0 to 0 dl 1788905184 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:0 [ 1840.027066] Lustre: lustre-MDT0000-osd: cancel update llog [0x200000400:0x1:0x0] [ 1840.030258] Lustre: lustre-MDT0000: Denying connection for new client 2e2df53b-6782-404e-9f98-0872cfe3c212 (at 192.168.201.30@tcp), waiting for 3 known clients (2 recovered, 0 in progress, and 1 evicted) to recover in 0:00 [ 1840.033931] Lustre: lustre-MDT0001-osp-MDT0000: cancel update llog [0x240000401:0x1:0x0] [ 1840.046377] Lustre: lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 1840.046516] Lustre: lustre-MDT0000: Recovery over after 1:00, of 3 clients 2 recovered and 1 was evicted. [ 1840.048720] Lustre: Skipped 2 previous similar messages [ 1840.063441] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:46 to 0x2c0000401:545) [ 1840.063467] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:79 to 0x280000401:577) [ 1845.732390] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1845.732889] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1845.736901] Lustre: Skipped 3 previous similar messages [ 1845.740451] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1845.743216] Lustre: Skipped 5 previous similar messages [ 1851.326892] Lustre: server umount lustre-OST0000 complete [ 1855.970471] LustreError: 99802:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1855.975459] LustreError: 99802:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 18 previous similar messages [ 1858.644747] Lustre: server umount lustre-OST0001 complete [ 1874.400091] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 1874.466908] Lustre: server umount lustre-MDT0000 complete [ 1875.719102] LustreError: 95113:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788905209 with bad export cookie 14274984365970931793 [ 1875.722345] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1875.723082] LustreError: 95113:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 1875.841886] Lustre: server umount lustre-MDT0001 complete [ 1878.566523] Lustre: DEBUG MARKER: == conf-sanity test 85: osd_ost init: fail ea_fid_set ==== 18:06:52 (1788905212) [ 1881.083569] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1881.085692] Lustre: *** cfs_fail_loc=197, val=0*** [ 1896.544379] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 1901.664435] LustreError: 103338:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.201.130@tcp: failed processing log, type 4: rc = -110 [ 1906.790615] Lustre: *** cfs_fail_loc=197, val=0*** [ 1906.792246] Lustre: Skipped 65 previous similar messages [ 1927.264380] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1927.266724] Lustre: Skipped 7 previous similar messages [ 1929.198726] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 1931.647285] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1932.407556] Lustre: server umount lustre-OST0000 complete [ 1935.272921] Lustre: DEBUG MARKER: == conf-sanity test 86: Replacing mkfs.lustre -G option == 18:07:48 (1788905268) [ 1949.038658] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1949.204646] LustreError: 104955:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1950.627460] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 1954.393886] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1956.430196] LustreError: 104987:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x200000009:0x1:0x0]: rc = -5 [ 1956.434856] LustreError: 104987:0:(lod_sub_object.c:917:lod_sub_prep_llog()) lustre-MDT0000-mdtlov: can't get id from catalogs: rc = -5 [ 1956.437610] LustreError: 104987:0:(lod_dev.c:511:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 7, retries 0, failed: rc = -5 [ 1956.553964] Lustre: server umount lustre-MDT0000 complete [ 1967.538454] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_hostid [ 1970.967313] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 1982.898537] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1982.974723] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1982.987197] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1983.022914] Lustre: lustre-MDT0000: new disk, initializing [ 1983.046310] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1984.568222] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 1988.912186] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1988.951881] Lustre: 109152:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1989.054306] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1990.446125] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 1994.248584] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1996.203813] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 1998.484647] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1998.591111] Lustre: 111118:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1999.134872] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2000.607238] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 2004.599768] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2006.151875] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2006.237643] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2007.773662] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2007.854167] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2009.573280] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2009.574891] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2009.576128] LustreError: Skipped 4 previous similar messages [ 2009.576680] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2009.582618] Lustre: Skipped 5 previous similar messages [ 2009.584187] Lustre: Skipped 12 previous similar messages [ 2014.668987] Lustre: server umount lustre-OST0000 complete [ 2021.977698] Lustre: server umount lustre-MDT0000 complete [ 2023.226345] LustreError: 109188:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788905357 with bad export cookie 14274984365970942419 [ 2023.227820] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2023.229654] LustreError: 109188:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2023.348777] Lustre: server umount lustre-MDT0001 complete [ 2026.252659] Lustre: DEBUG MARKER: == conf-sanity test 87: check if MDT inode can hold EAs with N stripes properly ========================================================== 18:09:19 (1788905359) [ 2029.227193] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing unload_modules_local [ 2030.288754] Key type lgssc unregistered [ 2030.421409] LNet: 113605:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2030.423973] LNetError: 113605:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2030.435373] LNet: Removed LNI 192.168.201.130@tcp [ 2030.763665] Key type .llcrypt unregistered [ 2030.765187] Key type ._llcrypt unregistered [ 2036.651336] Key type ._llcrypt registered [ 2036.652362] Key type .llcrypt registered [ 2036.684713] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_hostid [ 2042.669126] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 2043.113395] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2043.123624] alg: No test for adler32 (adler32-zlib) [ 2043.972333] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 2044.056017] LNet: Added LNI 192.168.201.130@tcp [8/256/0/180] [ 2045.632146] Key type lgssc registered [ 2045.968562] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2058.573054] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2058.578450] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2059.673463] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2059.684031] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2059.721299] Lustre: lustre-MDT0000: new disk, initializing [ 2059.741254] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2059.747107] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2061.023041] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 2064.977950] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2065.091504] Lustre: lustre-OST0000: new disk, initializing [ 2065.092985] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 2065.094568] Lustre: Skipped 1 previous similar message [ 2065.096461] Lustre: 117749:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2065.120955] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2067.097713] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 2069.504313] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 2069.507652] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 2069.516039] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 2071.195614] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2071.258525] Lustre: lustre-OST0001: new disk, initializing [ 2071.260889] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 2071.264547] Lustre: 118611:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2071.294546] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 2073.248022] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 2081.762343] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2081.763413] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2081.765613] Lustre: Skipped 1 previous similar message [ 2083.374228] Lustre: server umount lustre-MDT0000 complete [ 2085.443030] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null) [ 2086.893276] LustreError: 116935:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788905420 with bad export cookie 8001529777912022323 [ 2086.895325] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2086.897139] LustreError: 116935:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 2086.935822] Lustre: server umount lustre-OST0000 complete [ 2088.145653] Lustre: server umount lustre-OST0001 complete [ 2090.810161] Lustre: DEBUG MARKER: == conf-sanity test 88a: tunefs.lustre persists a --mountfsoptions-only change ========================================================== 18:10:24 (1788905424) [ 2098.023993] Lustre: DEBUG MARKER: == conf-sanity test 88b: check the default mount options can be overridden ========================================================== 18:10:31 (1788905431) [ 2100.923614] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 2108.154469] Lustre: DEBUG MARKER: == conf-sanity test 89: check tunefs --param and --erase-param{s} options ========================================================== 18:10:41 (1788905441) [ 2120.151379] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_hostid [ 2123.365918] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 2134.835811] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2134.918284] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2134.927241] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2134.963543] Lustre: lustre-MDT0000: new disk, initializing [ 2134.983973] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2134.989717] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2136.364810] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 2140.759443] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2140.805503] Lustre: 126342:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2140.828669] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 2140.831221] Lustre: Skipped 1 previous similar message [ 2140.865537] Lustre: lustre-MDT0001: new disk, initializing [ 2140.898837] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2140.912061] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 2140.915666] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2142.225123] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 2145.913719] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2147.811046] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2149.944090] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2150.042640] Lustre: lustre-OST0000: new disk, initializing [ 2150.044414] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 2150.047761] Lustre: 128309:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2150.076184] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2151.923596] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 2155.381334] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount (FULL|IDLE) failover.node=192.0.2.254@tcp0,osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2155.511046] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 2155.514461] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2155.542133] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2156.712916] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2156.777909] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2158.030617] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2158.095932] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2160.613805] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2160.614253] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2160.616324] LustreError: Skipped 1 previous similar message [ 2160.621706] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2160.624737] Lustre: Skipped 2 previous similar messages [ 2164.821890] Lustre: server umount lustre-OST0000 complete [ 2166.752811] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2166.755565] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2166.759724] Lustre: Skipped 1 previous similar message [ 2166.761919] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2170.849036] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2170.849502] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2172.181538] Lustre: server umount lustre-MDT0000 complete [ 2173.375037] LustreError: 126336:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788905507 with bad export cookie 8001529777912023457 [ 2173.377978] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2173.378125] LustreError: 126336:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2173.487217] Lustre: server umount lustre-MDT0001 complete [ 2176.222198] Lustre: DEBUG MARKER: == conf-sanity test 90a: check max_mod_rpcs_in_flight is enforced ========================================================== 18:11:49 (1788905509) [ 2178.434758] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2178.598990] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2179.962620] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 2182.802892] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2184.173550] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 2186.471742] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2188.272854] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2190.432864] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2192.330384] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 2194.627418] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2207.340850] Lustre: *** cfs_fail_loc=159, val=0*** [ 2223.773581] Lustre: lustre-MDT0000: Client 11ecbfac-015b-4dfb-97fd-09216f9d82dc (at 192.168.201.30@tcp) reconnecting [ 2224.297488] Lustre: *** cfs_fail_loc=159, val=0*** [ 2224.299293] Lustre: Skipped 5 previous similar messages [ 2240.684668] Lustre: lustre-MDT0000: Client 11ecbfac-015b-4dfb-97fd-09216f9d82dc (at 192.168.201.30@tcp) reconnecting [ 2244.065625] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2244.068901] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2244.074970] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2244.078137] Lustre: Skipped 1 previous similar message [ 2249.410970] Lustre: server umount lustre-OST0000 complete [ 2254.819108] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2254.823585] LustreError: Skipped 1 previous similar message [ 2254.826613] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2254.834422] Lustre: Skipped 1 previous similar message [ 2254.838539] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2254.842335] Lustre: Skipped 2 previous similar messages [ 2257.831374] Lustre: server umount lustre-MDT0000 complete [ 2259.930234] LustreError: 130695:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788905593 with bad export cookie 8001529777912024339 [ 2259.931795] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2259.934262] LustreError: 130695:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2260.207407] Lustre: server umount lustre-MDT0001 complete [ 2266.194118] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing unload_modules_local [ 2267.496475] Key type lgssc unregistered [ 2267.650478] LNet: 134505:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2267.654697] LNetError: 134505:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2267.663196] LNet: Removed LNI 192.168.201.130@tcp [ 2268.049700] Key type .llcrypt unregistered [ 2268.051753] Key type ._llcrypt unregistered [ 2279.969670] Key type ._llcrypt registered [ 2279.970884] Key type .llcrypt registered [ 2280.019067] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 2280.514572] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2280.522262] alg: No test for adler32 (adler32-zlib) [ 2281.505290] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 2281.685617] LNet: Added LNI 192.168.201.130@tcp [8/256/0/180] [ 2283.296140] Key type lgssc registered [ 2283.946072] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2288.071632] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2288.093528] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2289.373434] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2291.840762] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 2297.906665] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2298.132834] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2300.970539] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 2305.327776] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2308.690915] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2312.228514] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2312.434997] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2314.477703] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:42 to 0x280000401:65) [ 2315.575920] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 2319.069560] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2328.998403] Lustre: *** cfs_fail_loc=159, val=0*** [ 2345.636697] Lustre: lustre-MDT0000: Client a1a24ecf-a4bd-4f32-9ede-5572a2aefeb4 (at 192.168.201.30@tcp) reconnecting [ 2346.703761] Lustre: *** cfs_fail_loc=159, val=0*** [ 2362.020241] Lustre: lustre-MDT0001: Client a1a24ecf-a4bd-4f32-9ede-5572a2aefeb4 (at 192.168.201.30@tcp) reconnecting [ 2362.686525] Lustre: *** cfs_fail_loc=159, val=0*** [ 2362.688486] Lustre: Skipped 3 previous similar messages [ 2378.913650] Lustre: lustre-MDT0001: Client a1a24ecf-a4bd-4f32-9ede-5572a2aefeb4 (at 192.168.201.30@tcp) reconnecting [ 2380.515613] Lustre: 138935:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 2381.781671] Lustre: *** cfs_fail_loc=159, val=0*** [ 2381.783292] Lustre: Skipped 3 previous similar messages [ 2397.329511] Lustre: lustre-MDT0000: Client b1e68b93-d1f2-4434-aee6-e4b675c43f55 (at 192.168.201.30@tcp) reconnecting [ 2398.021824] Lustre: *** cfs_fail_loc=159, val=0*** [ 2398.024029] Lustre: Skipped 14 previous similar messages [ 2414.238339] Lustre: lustre-MDT0000: Client b1e68b93-d1f2-4434-aee6-e4b675c43f55 (at 192.168.201.30@tcp) reconnecting [ 2414.884898] Lustre: 139228:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 2432.481299] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2432.484559] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2432.491482] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2436.580477] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2436.580576] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2436.585966] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2438.112170] Lustre: server umount lustre-OST0000 complete [ 2441.699422] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2441.699794] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2441.700744] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2441.700748] Lustre: Skipped 1 previous similar message [ 2441.712635] Lustre: Skipped 1 previous similar message [ 2445.857748] Lustre: server umount lustre-MDT0000 complete [ 2446.817076] LustreError: 135898:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2446.822888] LustreError: 135898:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [ 2447.328323] LustreError: 139057:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788905781 with bad export cookie 18138566363421131399 [ 2447.331973] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2447.333422] LustreError: 139057:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2447.470964] Lustre: server umount lustre-MDT0001 complete [ 2451.629509] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing unload_modules_local [ 2452.901140] Key type lgssc unregistered [ 2453.060391] LNet: 140304:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2453.063508] LNetError: 140304:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2453.075664] LNet: Removed LNI 192.168.201.130@tcp [ 2453.516803] Key type .llcrypt unregistered [ 2453.518714] Key type ._llcrypt unregistered [ 2464.231511] Key type ._llcrypt registered [ 2464.233550] Key type .llcrypt registered [ 2464.293686] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 2464.631830] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2464.639193] alg: No test for adler32 (adler32-zlib) [ 2465.518604] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 2465.626512] LNet: Added LNI 192.168.201.130@tcp [8/256/0/180] [ 2467.232203] Key type lgssc registered [ 2467.723342] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2470.988268] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2470.996355] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2472.176363] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2473.705636] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 2477.210188] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2477.364566] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2479.096683] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 2482.080150] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2484.362847] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2487.304580] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2487.446869] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2488.490439] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:97) [ 2489.866462] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 2493.165411] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2497.705274] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:129) [ 2502.230354] Lustre: 144270:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 2503.100468] Lustre: 144318:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 2503.780474] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 in log params [ 2505.169692] Lustre: 144465:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre/mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 (mode = 0) failed: rc = -17 [ 2505.564976] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=7 in log params [ 2505.568951] Lustre: Skipped 1 previous similar message [ 2506.014096] Lustre: 144564:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 2508.262962] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2508.263397] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2508.269124] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2508.278562] Lustre: Skipped 1 previous similar message [ 2513.412571] Lustre: server umount lustre-OST0000 complete [ 2518.497618] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2518.497816] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2518.498530] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2518.498535] Lustre: Skipped 1 previous similar message [ 2518.504200] Lustre: Skipped 1 previous similar message [ 2521.337822] Lustre: server umount lustre-MDT0000 complete [ 2523.082712] LustreError: 141676:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788905857 with bad export cookie 8130397382958676414 [ 2523.083196] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2523.091547] LustreError: 141676:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 2523.246361] Lustre: server umount lustre-MDT0001 complete [ 2527.790115] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing unload_modules_local [ 2529.057806] Key type lgssc unregistered [ 2529.208609] LNet: 145621:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2529.212739] LNetError: 145621:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2529.219463] LNet: Removed LNI 192.168.201.130@tcp [ 2529.604687] Key type .llcrypt unregistered [ 2529.605965] Key type ._llcrypt unregistered [ 2549.581807] Key type ._llcrypt registered [ 2549.584421] Key type .llcrypt registered [ 2549.722708] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 2550.874534] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2551.009344] alg: No test for adler32 (adler32-zlib) [ 2552.273129] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 2552.565109] LNet: Added LNI 192.168.201.130@tcp [8/256/0/180] [ 2554.256244] Key type lgssc registered [ 2555.443921] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2562.461816] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2562.481648] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2563.815213] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2568.588740] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 2573.289981] LustreError: 147039:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2573.319254] LustreError: 147039:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 2576.366117] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2576.639957] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2582.473664] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 2600.994724] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2614.729977] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2625.159915] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2626.206436] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2633.340734] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:161) [ 2638.952732] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 2646.657218] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:129) [ 2648.323958] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2654.806730] Lustre: *** cfs_fail_loc=159, val=0*** [ 2670.282914] Lustre: lustre-MDT0000: Client 8cb54bcb-b64a-43c6-8c97-8edff2d3baa2 (at 192.168.201.30@tcp) reconnecting [ 2676.197757] LustreError: lustre-OST0000-osc-MDT0000: operation ost_destroy to node 0@lo failed: rc = -107 [ 2676.199436] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2676.216756] LustreError: Skipped 1 previous similar message [ 2676.254788] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2677.329759] Lustre: server umount lustre-OST0000 complete [ 2682.852837] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2682.862381] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2687.613458] Lustre: server umount lustre-MDT0000 complete [ 2687.970868] LustreError: 147040:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2688.004149] LustreError: 147040:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 2691.376257] LustreError: 147018:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788906025 with bad export cookie 8187083079396590806 [ 2691.383034] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2691.388594] LustreError: 147018:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 2701.961896] Lustre: server umount lustre-MDT0001 complete [ 2713.434412] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing unload_modules_local [ 2715.930877] Key type lgssc unregistered [ 2716.174647] LNet: 150707:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2716.181545] LNetError: 150707:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2716.193389] LNet: Removed LNI 192.168.201.130@tcp [ 2716.990492] Key type .llcrypt unregistered [ 2716.992639] Key type ._llcrypt unregistered [ 2742.164962] Key type ._llcrypt registered [ 2742.170035] Key type .llcrypt registered [ 2742.343700] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 2743.606809] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2743.731745] alg: No test for adler32 (adler32-zlib) [ 2744.972710] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 2745.218992] LNet: Added LNI 192.168.201.130@tcp [8/256/0/180] [ 2746.892384] Key type lgssc registered [ 2748.178542] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2756.700770] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 2756.717466] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2758.209579] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2762.354427] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 2768.366886] LustreError: 152124:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2768.388152] LustreError: 152124:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 2771.296655] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2771.697897] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 2776.848951] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 2784.358924] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2790.017625] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2796.792986] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2797.189755] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2803.329760] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:170 to 0x280000401:193) [ 2804.003378] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 2811.684186] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2816.635458] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:161) [ 2835.909920] Lustre: lustre-OST0000: evicting eeaaacbd-8c77-462f-90fa-81e6d541b31b (at 192.168.201.30@tcp) by administrative request [ 2835.924811] Lustre: Skipped 1 previous similar message [ 2865.124458] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2865.137553] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2865.168526] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2868.199833] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2868.209832] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2868.215788] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2868.236571] Lustre: Skipped 1 previous similar message [ 2870.830756] Lustre: server umount lustre-OST0000 complete [ 2874.339065] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2874.347612] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2874.372190] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2878.433953] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2878.437073] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2878.452075] Lustre: Skipped 1 previous similar message [ 2880.676621] Lustre: server umount lustre-MDT0000 complete [ 2883.555846] LustreError: 152125:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2883.569187] LustreError: 152125:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 2885.122265] LustreError: 152866:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788906219 with bad export cookie 15911617943235692213 [ 2885.128120] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2885.131824] LustreError: 152866:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 2885.424735] Lustre: server umount lustre-MDT0001 complete [ 2899.051170] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing unload_modules_local [ 2902.224810] Key type lgssc unregistered [ 2902.528760] LNet: 156197:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2902.535246] LNetError: 156197:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2903.592882] LNet: Removed LNI 192.168.201.130@tcp [ 2904.602542] Key type .llcrypt unregistered [ 2904.604208] Key type ._llcrypt unregistered [ 2987.001743] Key type ._llcrypt registered [ 2987.005328] Key type .llcrypt registered [ 2987.198936] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 2988.751383] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2988.830894] alg: No test for adler32 (adler32-zlib) [ 2989.987841] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 2990.322391] LNet: Added LNI 192.168.201.130@tcp [8/256/0/180] [ 2992.113168] Key type lgssc registered [ 2993.480324] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3002.930319] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3002.986128] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3004.664913] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3008.970614] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 3014.117746] LustreError: 158687:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3014.143332] LustreError: 158687:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 3017.693119] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3018.213631] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3023.157848] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 3031.260541] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3038.274591] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3046.051526] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3046.607727] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3049.649272] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:195 to 0x280000401:225) [ 3053.152754] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 3061.664399] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3063.991533] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:193) [ 3075.049625] LustreError: lustre-OST0000-osc-MDT0000: operation ost_destroy to node 0@lo failed: rc = -107 [ 3075.053183] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3075.065745] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3079.670778] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3079.674635] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3079.699983] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3081.270639] Lustre: server umount lustre-OST0000 complete [ 3089.895330] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3089.901034] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3089.912258] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3089.934735] Lustre: Skipped 1 previous similar message [ 3089.959497] Lustre: Skipped 2 previous similar messages [ 3091.389665] Lustre: server umount lustre-MDT0000 complete [ 3095.013840] LustreError: 158681:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3095.071031] LustreError: 158681:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 3098.233201] LustreError: 159426:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788906432 with bad export cookie 1064073392256068010 [ 3098.234533] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3098.241996] LustreError: 159426:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 3098.861979] Lustre: server umount lustre-MDT0001 complete [ 3120.926843] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing unload_modules_local [ 3124.391751] Key type lgssc unregistered [ 3124.892642] LNet: 162278:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3124.906506] LNetError: 162278:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3124.956369] LNet: Removed LNI 192.168.201.130@tcp [ 3126.011202] Key type .llcrypt unregistered [ 3126.020526] Key type ._llcrypt unregistered [ 3155.816943] Key type ._llcrypt registered [ 3155.820991] Key type .llcrypt registered [ 3155.994097] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 3157.368148] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3157.402712] alg: No test for adler32 (adler32-zlib) [ 3158.767501] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 3159.002593] LNet: Added LNI 192.168.201.130@tcp [8/256/0/180] [ 3160.680208] Key type lgssc registered [ 3162.323253] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3179.334639] Lustre: DEBUG MARKER: == conf-sanity test 100: check lshowmount lists MGS, MDT, OST and 0@lo ========================================================== 18:28:31 (1788906511) [ 3198.996643] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_hostid [ 3213.626913] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 3257.439886] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3257.495923] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3258.815959] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3258.851860] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3258.926460] Lustre: lustre-MDT0000: new disk, initializing [ 3259.033111] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3259.064763] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3264.567717] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 3276.537941] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3276.676879] Lustre: 166579:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 3276.741950] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 3276.745806] Lustre: Skipped 1 previous similar message [ 3276.859622] Lustre: lustre-MDT0001: new disk, initializing [ 3277.009472] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3277.068452] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 3277.096885] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 3282.469530] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 3293.206317] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3300.308677] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3307.560473] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3307.893913] Lustre: lustre-OST0000: new disk, initializing [ 3307.897685] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3307.902463] Lustre: 168547:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3308.006860] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3313.236354] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 3313.243485] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 3313.417091] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 3315.662106] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 3327.171748] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3339.235870] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3339.243374] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3339.264596] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3339.277143] Lustre: Skipped 1 previous similar message [ 3341.168285] Lustre: server umount lustre-OST0000 complete [ 3348.964541] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3348.980935] LustreError: Skipped 1 previous similar message [ 3348.986939] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3348.995583] Lustre: Skipped 1 previous similar message [ 3348.999897] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3351.661549] Lustre: server umount lustre-MDT0000 complete [ 3356.135633] LustreError: 166569:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788906690 with bad export cookie 3993288354208564561 [ 3356.141063] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3356.148102] LustreError: 166569:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 3356.593352] Lustre: server umount lustre-MDT0001 complete [ 3369.219894] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing unload_modules_local [ 3372.379183] Key type lgssc unregistered [ 3372.653914] LNet: 170450:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3372.663726] LNetError: 170450:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3372.691720] LNet: Removed LNI 192.168.201.130@tcp [ 3373.611567] Key type .llcrypt unregistered [ 3373.614880] Key type ._llcrypt unregistered [ 3402.299389] Key type ._llcrypt registered [ 3402.301885] Key type .llcrypt registered [ 3402.427734] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 3404.091806] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3404.147789] alg: No test for adler32 (adler32-zlib) [ 3405.405249] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 3405.697691] LNet: Added LNI 192.168.201.130@tcp [8/256/0/180] [ 3407.392184] Key type lgssc registered [ 3408.832211] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3417.844365] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3417.859882] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3419.224265] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3424.177485] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 3429.347984] LustreError: 171871:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3429.377706] LustreError: 171871:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 3433.801585] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3434.335365] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3439.063504] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 3447.562884] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3455.012343] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3463.166197] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3463.647557] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3464.696296] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:33) [ 3470.604832] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 3479.609899] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3487.021398] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3487.044481] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3487.056716] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3487.063802] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3487.097598] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3487.933273] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3487.950234] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3487.984392] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3488.004932] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3488.023077] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3489.115625] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3489.134051] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3489.143116] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3489.146715] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3489.156765] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3490.178975] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3491.118858] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3492.063811] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3492.079855] Lustre: Skipped 2 previous similar messages [ 3492.094334] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3492.104531] Lustre: Skipped 2 previous similar messages [ 3492.115819] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3492.121077] Lustre: Skipped 2 previous similar messages [ 3492.127610] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3492.146574] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3492.157900] Lustre: Skipped 2 previous similar messages [ 3493.043578] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3494.050220] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3494.920161] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3496.026550] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3497.136041] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3497.141606] Lustre: Skipped 4 previous similar messages [ 3497.154853] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3497.161891] Lustre: Skipped 4 previous similar messages [ 3497.164969] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3497.168123] Lustre: Skipped 4 previous similar messages [ 3497.171768] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3497.181553] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3497.187376] Lustre: Skipped 4 previous similar messages [ 3498.048376] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3499.059145] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3499.881327] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3501.085223] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3502.125218] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3503.231351] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3504.249620] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3505.189502] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3505.193409] Lustre: Skipped 7 previous similar messages [ 3505.203369] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3505.210826] Lustre: Skipped 7 previous similar messages [ 3505.214680] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3505.218573] Lustre: Skipped 7 previous similar messages [ 3505.220551] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3505.228099] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3505.234547] Lustre: Skipped 7 previous similar messages [ 3506.111365] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3507.037949] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3507.964713] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3508.939719] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3509.855207] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3510.806770] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3511.600547] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3512.583484] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3513.682548] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3514.550690] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3515.635506] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3516.555992] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3517.667897] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3518.455417] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3519.471077] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3520.502443] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3521.200991] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3521.209484] Lustre: Skipped 16 previous similar messages [ 3521.230143] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3521.242683] Lustre: Skipped 16 previous similar messages [ 3521.247050] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3521.252977] Lustre: Skipped 16 previous similar messages [ 3521.258082] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3521.267743] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3521.272416] Lustre: Skipped 16 previous similar messages [ 3522.036828] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3522.906528] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3523.809712] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3524.737361] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3525.777469] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3526.901931] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3527.644449] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3528.604230] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3529.318228] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3530.219111] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3530.984992] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3531.682430] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3532.706503] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3533.757404] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3534.751910] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3535.835073] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3536.588527] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3537.655740] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3538.399961] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3539.242096] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3540.263651] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3541.106913] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3541.870675] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3542.884160] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3543.814816] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3544.812725] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3545.633638] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3546.667251] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3547.410746] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3548.201842] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3549.009710] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3549.841238] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3550.586949] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3551.476331] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3552.396155] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3553.246875] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3553.251556] Lustre: Skipped 35 previous similar messages [ 3553.270347] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3553.278599] Lustre: Skipped 35 previous similar messages [ 3553.282678] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3553.286962] Lustre: Skipped 35 previous similar messages [ 3553.290798] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3553.305604] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3553.313215] Lustre: Skipped 35 previous similar messages [ 3554.211941] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3555.315610] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3556.380410] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3557.464964] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3558.276227] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3559.172783] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3560.020527] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3560.890973] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3561.806360] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3562.564700] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3563.702597] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3564.703668] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3565.643266] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3566.713758] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3567.626956] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3568.548476] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3569.435076] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3570.372568] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3571.431582] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3572.404544] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3573.467317] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3574.488050] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3575.293499] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3576.256923] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3577.236502] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3578.134915] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3578.971142] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3579.772841] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3580.478446] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3581.239046] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3582.013181] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3582.893884] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3583.788506] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3584.512915] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3585.208685] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3586.074554] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3586.685998] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3587.526377] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3588.407654] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3589.299826] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3590.055510] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3590.974626] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3591.799557] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3592.610197] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3593.307752] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3594.094427] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3594.880489] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3595.734282] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3596.723718] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3597.643938] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3598.503620] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3599.254433] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3599.981508] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3600.811375] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3601.660577] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3602.461409] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3603.143856] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3603.801541] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3604.490739] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3605.338118] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3606.047965] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3606.913345] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3607.606810] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3608.381444] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3609.216285] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3610.331417] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3611.149518] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3612.081089] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3613.091991] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3613.977483] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3614.646713] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3615.402009] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3616.095971] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3616.787515] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3617.381220] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3617.384510] Lustre: Skipped 74 previous similar messages [ 3617.395552] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3617.402257] Lustre: Skipped 74 previous similar messages [ 3617.404799] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3617.411787] Lustre: Skipped 74 previous similar messages [ 3617.414391] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3617.421783] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3617.424509] Lustre: Skipped 74 previous similar messages [ 3618.046618] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3618.656494] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3619.353718] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3619.984638] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3620.770638] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3621.395480] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3622.191189] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3622.803157] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3623.565584] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3624.285402] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3625.102359] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3625.883328] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3626.658740] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3627.558751] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3628.285203] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3628.881355] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3629.642606] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3630.299089] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3630.948198] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3631.722543] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3632.407850] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3633.125889] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3633.812900] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3634.502247] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3635.221818] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3636.014611] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3636.601166] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3637.261681] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3637.950481] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3638.755466] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3639.438787] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3640.270520] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3640.965373] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3641.742233] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3642.582491] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3643.206753] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3643.960819] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3644.777789] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3645.593806] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3646.318530] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3647.326469] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3648.271815] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3649.062176] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3650.196989] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3651.153712] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3652.108795] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3652.858244] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3653.678811] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3654.609636] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3655.623030] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3656.455976] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3657.319498] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3658.210373] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3659.109133] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3659.791994] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3660.814843] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3661.714049] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3662.477475] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3663.367518] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3664.139515] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3664.868300] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3665.629690] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3666.344518] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3667.254878] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3667.948226] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3668.758519] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3669.561080] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3670.347628] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3671.090927] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3672.000627] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3672.785263] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3673.789753] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3674.580785] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3675.632401] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3676.495302] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3677.390165] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3678.415954] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3679.211197] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3680.056101] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3681.022791] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3681.968124] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3682.809409] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3683.699797] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3684.547721] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3685.367408] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3686.227521] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3687.130614] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3687.987379] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3688.742324] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3689.547053] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3690.266515] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3690.996291] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3691.625446] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3692.329359] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3693.008598] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3693.721514] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3694.458529] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3695.282419] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3696.057773] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3696.879158] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3697.680240] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3698.506290] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3699.306376] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3700.287750] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3701.082781] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3701.992054] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3702.727563] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3703.650714] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3704.372713] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3705.258674] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3706.021801] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3706.821389] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3707.564765] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3708.428896] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3709.167223] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3709.964864] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3710.680565] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3711.360851] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3712.109634] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3712.925251] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3713.641268] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3714.414318] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3715.062905] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3715.706573] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3716.458352] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3717.194291] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3717.851652] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3718.661831] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3719.534727] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3720.306441] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3721.019344] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3721.661755] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3722.396470] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3723.151320] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3723.828448] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3724.643662] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3725.691299] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3726.501578] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3727.346479] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3728.171868] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3728.985409] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3729.786489] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3730.601262] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3731.441519] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3732.210727] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3733.088647] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3734.024363] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3734.891216] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3735.620485] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3736.437170] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3737.254620] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3738.056546] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3738.852954] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3739.751699] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3740.695630] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3741.598627] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3742.510510] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3743.492974] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3744.357693] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3745.355618] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3746.319784] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3746.324941] Lustre: Skipped 160 previous similar messages [ 3746.365539] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3746.378911] Lustre: Skipped 160 previous similar messages [ 3746.384711] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 3746.387404] Lustre: Skipped 160 previous similar messages [ 3746.393591] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3746.401630] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 3746.408684] Lustre: Skipped 160 previous similar messages [ 3747.331344] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3748.210023] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3749.238526] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3750.176114] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3751.125874] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3752.124771] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3752.969449] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3753.930995] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3754.947418] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3755.806343] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3756.697883] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3757.481261] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3758.318295] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3758.976179] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3759.811939] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3760.722934] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3761.530644] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3762.277357] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3763.096578] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3763.847755] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3764.658148] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3765.569888] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3766.403568] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3767.173461] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3767.975079] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3768.721096] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3769.676569] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3770.573865] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3771.339800] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3772.284802] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3773.085991] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3773.877725] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3774.783596] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3775.636919] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3776.434534] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3777.416593] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3778.202961] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3778.908496] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3779.615941] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3780.229655] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3781.141699] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3781.815418] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3782.679379] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3783.414178] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3784.192894] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3785.001308] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3785.788916] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3786.446753] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3787.233140] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3787.890509] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3788.577720] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3789.229630] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3789.917326] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3790.733425] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3791.626752] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3792.477392] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3793.439563] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3794.335863] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3795.253252] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3796.140213] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3796.943672] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3797.759202] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3798.800035] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3799.804692] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3800.721959] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3801.705135] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3802.603917] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3803.391835] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3804.401144] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3805.259574] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3806.208160] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3806.994297] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3807.849756] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3808.603939] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3809.285513] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3810.073222] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3810.927225] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3811.675986] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3812.513852] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3813.331928] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3814.279796] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3815.221370] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3816.259922] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3817.172882] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3818.081262] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3818.773476] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3819.642474] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3820.339399] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3821.194276] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3821.934549] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3822.798496] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3823.618980] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3824.510025] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3825.203353] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3825.932689] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3826.616927] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3827.524040] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3828.359453] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3829.206543] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3830.032795] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3830.908786] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3831.830060] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3832.778531] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3833.923876] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3834.671887] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3835.628770] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3836.598412] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3837.535198] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3838.463883] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3839.436802] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3840.249426] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3841.214201] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3842.062374] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3842.887616] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3843.813137] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3844.808410] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3845.539516] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3846.509494] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3847.421486] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3848.559662] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3849.688718] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3850.664013] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3851.693233] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3852.772736] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3853.749551] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3854.578178] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3855.492336] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3856.270949] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3857.130817] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3858.014913] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3859.005682] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3859.767461] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3860.684341] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3861.425508] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3862.357066] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3863.244807] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3864.128731] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3864.872414] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3865.619373] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3866.530201] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3867.374495] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3868.261420] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3869.176220] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3869.918124] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3870.924756] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3871.973977] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3872.817901] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3873.697081] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3874.612526] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3875.454870] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3876.364553] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3877.127169] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3878.087360] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3878.869480] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3879.750397] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3880.626600] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3881.620857] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3882.386233] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3883.311009] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3884.094043] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3884.857264] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3885.714349] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3886.702529] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3887.606342] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3888.632617] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3889.353498] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3890.209980] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3891.041961] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3891.957993] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3892.727544] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3893.657047] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3894.727663] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3895.734282] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3896.767236] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3897.659763] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3898.618136] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3899.646757] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3900.679539] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3901.460343] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3902.329958] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3903.269379] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3904.378699] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3905.329426] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3906.216034] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3907.050091] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3907.949248] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3908.694301] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3909.705953] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3910.563423] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3911.331976] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3912.108632] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3912.952486] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3913.923914] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3914.747491] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3915.503845] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3916.374255] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3917.109581] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3917.994440] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3918.754058] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3919.715775] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3920.591120] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3921.497150] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3922.310719] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3923.278533] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3924.176896] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3925.076668] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3925.923679] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3926.952879] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3927.954917] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3928.922916] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3929.623219] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3930.407791] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3931.182245] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3932.145588] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3933.016533] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3934.320685] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3936.045859] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3936.886775] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3937.844288] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3938.654729] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3940.105440] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3941.402287] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3942.467495] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3943.581841] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3944.769071] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3946.656588] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3949.748719] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3951.670292] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3954.086852] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3955.831960] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3957.545392] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3959.709714] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3961.676576] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3963.417553] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3965.310611] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3966.975841] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3969.052198] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3970.147119] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3971.102872] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3972.258211] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3973.173439] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3974.181553] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3975.398714] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3976.663476] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3977.797887] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3978.904789] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3979.986779] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3981.125808] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3982.222064] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3983.322676] LustreError: 171891:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 3983.338623] LustreError: 171891:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 3983.355451] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3984.278817] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3985.372048] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3986.529711] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3987.472509] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3988.640495] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3989.787030] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3990.851130] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3991.832855] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3992.942780] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3994.217158] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3995.282821] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3996.311449] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3997.390727] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3998.441631] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3999.503932] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4000.680787] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4001.965454] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4003.046721] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4003.058803] Lustre: Skipped 267 previous similar messages [ 4003.075470] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4003.087110] Lustre: Skipped 267 previous similar messages [ 4003.099491] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4003.106423] Lustre: Skipped 267 previous similar messages [ 4003.110060] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4003.119354] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4003.124665] Lustre: Skipped 267 previous similar messages [ 4004.432845] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4005.614678] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4006.467635] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4007.503045] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4008.350950] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4009.348748] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4010.215985] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4011.143743] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4011.994631] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4012.944236] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4013.739356] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4014.597985] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4015.471047] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4016.327870] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4017.240425] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4018.300473] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4019.215760] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4020.304901] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4021.488093] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4022.629457] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4023.698460] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4024.773299] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4025.793085] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4026.763992] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4027.733082] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4028.774224] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4029.856611] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4030.643547] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4031.602214] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4032.605132] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4033.773824] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4034.808394] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4035.723684] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4036.855833] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4038.013655] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4038.991341] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4039.923639] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4040.944777] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4041.928826] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4042.840907] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4043.978188] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4045.103641] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4046.157207] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4047.180638] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4048.162753] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4048.944120] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4049.809207] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4050.850939] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4051.774261] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4052.815643] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4053.807849] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4055.099868] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4056.229378] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4057.292901] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4058.221639] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4059.403546] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4060.229439] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4061.017383] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4061.909506] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4062.846505] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4063.844826] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4064.933534] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4065.541174] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4066.600860] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4067.529744] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4068.458854] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4069.339328] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4070.268979] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4071.198539] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4072.181208] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4073.230370] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4074.273643] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4075.279832] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4076.138652] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4077.224278] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4078.468594] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4079.432931] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4080.727089] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4081.966800] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4082.908761] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4083.865174] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4084.765461] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4085.948270] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4086.937762] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4088.076218] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4089.142634] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4089.970270] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4091.035245] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4092.101890] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4093.069987] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4094.121571] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4095.224874] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4096.147966] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4097.386795] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4098.561591] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4099.764267] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4100.741500] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4101.740152] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4102.550468] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4103.549282] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4104.380934] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4105.235290] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4106.287215] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4107.337516] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4108.332268] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4109.322603] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4110.312954] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4111.228705] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4112.232075] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4113.450235] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4114.472150] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4115.211595] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4116.013706] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4116.908638] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4117.688565] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4118.677064] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4119.653991] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4120.512818] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4121.446236] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4122.370783] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4123.576332] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4124.529082] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4125.615215] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4126.483808] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4127.499784] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4128.596085] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4129.847485] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4131.066028] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4132.613362] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4133.956101] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4134.813335] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4136.018278] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4137.273820] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4138.340943] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4139.377755] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4140.497623] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4141.600289] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4142.859295] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4143.831945] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4144.964981] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4146.020890] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4147.075051] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4148.098980] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4149.035695] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4149.995419] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4150.836329] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4151.850334] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4152.818405] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4153.856322] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4154.887229] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4155.897792] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4156.810717] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4157.710361] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4158.661370] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4159.943681] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4161.023676] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4161.953518] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4162.952932] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4163.862827] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4165.200135] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4165.977653] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4166.778407] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4167.639875] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4168.361391] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4169.190963] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4170.002311] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4170.752932] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4171.799415] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4172.722430] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4173.796895] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4174.914720] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4176.156386] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4176.997643] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4178.072439] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4179.159567] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4180.212321] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4181.366431] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4182.521263] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4183.577361] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4184.494876] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4185.538706] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4186.560827] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4187.534558] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4188.887760] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4190.215098] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4191.164895] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4192.284373] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4193.221375] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4194.294297] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4195.348939] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4196.369832] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4197.295341] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4198.249969] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4199.359178] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4200.657383] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4201.959106] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4203.142846] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4204.101975] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4205.200610] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4206.268770] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4207.098677] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4207.996967] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4209.057792] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4210.031633] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4211.161779] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4212.051684] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4213.020085] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4213.849480] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4214.843544] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4215.720846] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4216.709048] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4217.528201] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4218.429281] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4219.424331] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4220.433530] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4221.527945] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4222.471473] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4223.522560] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4224.462750] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4225.526424] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4226.624828] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4227.577577] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4228.546579] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4229.356287] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4230.274659] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4231.214253] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4232.220085] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4233.112400] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4234.088985] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4234.989570] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4235.978818] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4237.002521] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4238.107583] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4239.217431] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4240.364385] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4241.353472] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4242.526608] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4243.684742] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4244.681443] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4245.696466] LustreError: 171891:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 4245.711541] LustreError: 171891:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 4245.734888] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4246.761669] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4247.770957] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4248.667404] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4249.623377] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4250.679423] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4251.741636] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4252.669048] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4253.707457] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4254.700742] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4255.668872] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4256.646517] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4257.502539] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4258.785212] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4259.871148] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4260.621610] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4261.516073] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4262.381940] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4263.373879] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4264.238599] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4265.243970] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4266.132120] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4267.130708] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4268.085234] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4269.073634] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4270.208681] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4271.168417] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4272.208877] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4273.093336] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4274.024949] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4274.925898] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4276.041895] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4276.875652] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4277.834057] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4278.790118] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4280.032121] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4281.049218] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4281.938712] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4283.025629] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4284.184658] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4285.415365] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4286.250901] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4287.309495] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4288.207870] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4289.183899] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4290.011719] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4291.057675] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4291.987664] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4292.977632] LustreError: 171891:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 4292.989529] LustreError: 171891:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 4293.006209] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4293.932632] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4295.065597] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4296.270676] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4297.256425] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4298.356457] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4299.380380] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4300.607913] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4301.768790] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4302.936189] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4303.949175] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4304.850533] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4305.761849] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4306.868147] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4308.003791] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4309.211704] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4310.191639] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4311.144804] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4312.095828] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4313.260372] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4314.023213] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4314.971962] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4315.965231] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4316.938273] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4317.931445] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4318.841664] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4320.082830] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4321.416609] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4322.331087] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4323.410378] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4324.470384] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4325.443980] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4326.709474] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4327.635610] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4328.719656] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4329.555688] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4330.471692] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4331.433462] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4332.516442] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4333.563088] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4334.431383] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4335.334577] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4336.308882] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4337.304159] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4338.184112] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4339.164368] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4340.111805] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4341.283299] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4342.228632] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4343.341451] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4344.322534] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4345.435279] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4346.427838] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4347.428362] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4348.443402] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4349.239566] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4349.939720] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4350.936945] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4351.696280] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4352.509154] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4353.313604] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4354.118326] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4354.948592] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4355.844971] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4356.652191] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4357.616640] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4358.485103] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4359.597207] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4360.670541] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4361.585430] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4362.642290] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4363.663419] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4364.624933] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4365.503813] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4366.279857] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4367.336086] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4368.167046] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4369.477656] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4370.521180] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4371.347440] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4372.215564] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4373.143588] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4373.951647] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4374.822919] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4375.726077] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4376.653149] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4377.476083] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4378.623695] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4379.454102] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4380.334943] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4381.208426] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4382.068476] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4382.910777] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4383.683737] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4384.547757] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4385.437790] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4386.326991] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4387.227651] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4388.017323] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4388.768147] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4389.551407] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4390.345418] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4391.128820] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4391.834710] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4392.690340] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4393.509247] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4394.350384] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4395.180719] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4396.158581] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4397.058582] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4398.059074] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4398.844673] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4399.762055] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4400.498362] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4401.377634] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4402.149363] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4402.986799] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4403.847041] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4404.666719] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4405.633417] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4406.602849] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4407.365706] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4408.115126] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4408.749411] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4409.486225] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4410.340242] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4411.123893] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4411.891075] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4412.622812] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4413.405678] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4414.221137] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4414.990049] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4415.740301] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4416.573520] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4417.367063] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4418.334438] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4419.078246] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4766.091521] LustreError: 173692:0:(ofd_dev.c:1780:ofd_create_hdl()) lustre-OST0000: unable to precreate: rc = -28 [ 4766.113827] LustreError: 171891:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -28 [ 5143.028676] LustreError: lustre-OST0000-osc-MDT0000: operation ost_destroy to node 0@lo failed: rc = -107 [ 5143.030604] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5143.037437] Lustre: Skipped 424 previous similar messages [ 5143.040974] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5145.164259] Lustre: server umount lustre-OST0000 complete [ 5150.183655] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5150.190687] LustreError: Skipped 2 previous similar messages [ 5150.193966] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5150.197744] Lustre: Skipped 1 previous similar message [ 5151.714604] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5151.722838] Lustre: Skipped 1 previous similar message [ 5154.392954] Lustre: server umount lustre-MDT0000 complete [ 5156.833875] LustreError: 171871:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5156.855252] LustreError: 171871:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 5156.927942] LustreError: 211030:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788908490 with bad export cookie 16046428633391206425 [ 5156.932474] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5156.935811] LustreError: 211030:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 5157.141665] Lustre: server umount lustre-MDT0001 complete [ 5164.372966] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing unload_modules_local [ 5166.026854] Key type lgssc unregistered [ 5166.188615] LNet: 227101:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5166.195870] LNetError: 227101:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5166.211848] LNet: Removed LNI 192.168.201.130@tcp [ 5166.774647] Key type .llcrypt unregistered [ 5166.776127] Key type ._llcrypt unregistered [ 5182.936426] Key type ._llcrypt registered [ 5182.937649] Key type .llcrypt registered [ 5182.987605] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 5183.403680] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5183.453515] alg: No test for adler32 (adler32-zlib) [ 5184.369149] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 5184.503683] LNet: Added LNI 192.168.201.130@tcp [8/256/0/180] [ 5186.112167] Key type lgssc registered [ 5186.699614] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5190.092624] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5190.101485] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5191.318416] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5193.471558] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 5198.087681] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5198.292580] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5200.626467] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 5205.273083] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 5208.905314] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 5213.059143] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5213.283432] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5216.362268] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49665 to 0x280000401:49696) [ 5216.928485] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 5221.291396] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 5229.183377] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5230.859996] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5230.867060] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5230.873336] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5230.881266] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5230.881401] LustreError: 228513:0:(osp_precreate.c:1268:osp_precreate_thread()) cfs_fail_timeout id 2107 sleeping for 20000ms [ 5232.843054] Lustre: lustre-OST0000: Not available for connect from 192.168.201.30@tcp (stopping) [ 5234.149760] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5234.151262] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5234.158862] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 5234.165765] Lustre: Skipped 1 previous similar message [ 5237.917541] Lustre: lustre-OST0000: Not available for connect from 192.168.201.30@tcp (stopping) [ 5237.920031] Lustre: Skipped 1 previous similar message [ 5239.282744] Lustre: server umount lustre-OST0000 complete [ 5250.896255] LustreError: 228513:0:(osp_precreate.c:1268:osp_precreate_thread()) cfs_fail_timeout id 2107 awake [ 5277.426900] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5278.240973] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5286.711944] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 5296.911538] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 5299.415900] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec [ 5299.755193] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5299.773224] LustreError: lustre-OST0000-osc-MDT0001: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5299.775333] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5306.260205] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff89f105c51800.ost_server_uuid 50 [ 5307.682532] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff89f105c51800.ost_server_uuid in FULL state after 0 sec [ 5314.697270] Lustre: server umount lustre-OST0000 complete [ 5320.162407] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5320.163812] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5320.177877] Lustre: Skipped 1 previous similar message [ 5320.186153] Lustre: Skipped 1 previous similar message [ 5325.284461] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5325.293424] Lustre: Skipped 1 previous similar message [ 5328.352961] LustreError: 228513:0:(client.c:1381:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@0000000073710c52 x1875806538344448/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 0 ref 2 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 5328.650840] Lustre: server umount lustre-MDT0000 complete [ 5330.404813] LustreError: 228486:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5330.429456] LustreError: 228486:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [ 5331.424158] Lustre: 227807:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788908649/real 1788908649] req@00000000743425c9 x1875806538340864/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 1 dl 1788908665 ref 1 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 5331.438059] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5331.448985] LustreError: 228493:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5331.458440] LustreError: 228493:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 5332.776805] LustreError: 230335:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788908666 with bad export cookie 14587951504580580011 [ 5332.778197] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5332.794659] LustreError: 230335:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 5333.260987] Lustre: server umount lustre-MDT0001 complete [ 5343.741820] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing unload_modules_local [ 5346.373391] Key type lgssc unregistered [ 5346.598676] LNet: 233705:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5346.601638] LNetError: 233705:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 5346.617009] LNet: Removed LNI 192.168.201.130@tcp [ 5347.525284] Key type .llcrypt unregistered [ 5347.526903] Key type ._llcrypt unregistered [ 5374.532333] Key type ._llcrypt registered [ 5374.534222] Key type .llcrypt registered [ 5374.644667] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 5375.575201] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5375.590719] alg: No test for adler32 (adler32-zlib) [ 5376.658375] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 5376.854432] LNet: Added LNI 192.168.201.130@tcp [8/256/0/180] [ 5378.520417] Key type lgssc registered [ 5379.388570] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5388.145476] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 5388.156920] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5389.481879] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5393.237830] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 5399.014695] LustreError: 235412:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5399.023814] LustreError: 235412:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 5401.044204] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5401.297934] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5405.915526] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 5408.721499] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 5415.007036] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5415.348725] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 5420.587820] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 5428.342030] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5428.466364] Lustre: lustre-OST0001: new disk, initializing [ 5428.469522] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 5428.474094] Lustre: 237719:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 5428.559851] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 5434.219448] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 5434.750217] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49728) [ 5438.601078] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 5438.613859] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 5438.719726] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 5444.994995] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 5450.342904] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 5463.010790] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5463.020639] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5463.039058] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5464.558827] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5464.569341] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5464.590414] Lustre: Skipped 1 previous similar message [ 5468.719653] Lustre: server umount lustre-MDT0000 complete [ 5469.678792] LustreError: 235412:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5469.706139] LustreError: 235412:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [ 5472.230855] LustreError: 235393:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788908806 with bad export cookie 12603451167160659650 [ 5472.238470] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5472.594843] Lustre: server umount lustre-MDT0001 complete [ 5486.409511] Lustre: server umount lustre-OST0000 complete [ 5499.774374] Lustre: server umount lustre-OST0001 complete [ 5518.568922] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 5527.206832] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5527.577506] LustreError: 240832:0:(ldlm_lib.c:1192:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5527.677629] Lustre: mylustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5530.685574] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 5533.163330] LustreError: 240833:0:(ldlm_lib.c:1192:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5537.251188] LustreError: 240832:0:(ldlm_lib.c:1192:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5539.442905] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5539.710633] Lustre: mylustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 5543.579455] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 5546.052827] Lustre: 241972:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 5551.703531] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5553.067012] LustreError: 242324:0:(ldlm_lib.c:1192:target_handle_connect()) mylustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5553.090592] Lustre: mylustre-OST0000: new connection from mylustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49730 to 0x280000401:49760) [ 5558.072751] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 5566.102261] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5566.352195] Lustre: mylustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 5566.359740] Lustre: Skipped 1 previous similar message [ 5571.574069] Lustre: mylustre-OST0001: new connection from mylustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:33) [ 5571.956437] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 5578.745427] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 5581.873231] Lustre: 243843:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 5591.009895] LustreError: mylustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5591.016284] Lustre: mylustre-MDT0000-osp-MDT0001: Connection to mylustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5591.028023] Lustre: Skipped 1 previous similar message [ 5591.035217] Lustre: mylustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5591.040469] Lustre: Skipped 3 previous similar messages [ 5597.162678] Lustre: mylustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5597.176567] Lustre: Skipped 7 previous similar messages [ 5602.275851] Lustre: mylustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5602.286827] Lustre: Skipped 3 previous similar messages [ 5605.345797] Lustre: mylustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 5605.473425] Lustre: server umount mylustre-MDT0000 complete [ 5607.399489] LustreError: 240832:0:(ldlm_lib.c:1192:target_handle_connect()) mylustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5607.412429] LustreError: 240832:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 5 previous similar messages [ 5608.139531] LustreError: 240808:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788908942 with bad export cookie 12603451167160662457 [ 5608.144189] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5608.148476] LustreError: 240808:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 5608.427657] Lustre: server umount mylustre-MDT0001 complete [ 5621.850494] Lustre: server umount mylustre-OST0000 complete [ 5635.615676] Lustre: server umount mylustre-OST0001 complete [ 5651.538518] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 5659.543845] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5659.801838] LustreError: 246154:0:(ldlm_lib.c:1192:target_handle_connect()) tfs-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5659.812833] LustreError: 246154:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 5659.872565] Lustre: tfs-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5663.227818] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 5669.427878] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5672.572388] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 5674.710855] Lustre: 247294:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 5680.225243] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5684.666351] Lustre: tfs-OST0000: new connection from tfs-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49730 to 0x280000401:49792) [ 5686.273145] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 5693.640159] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5694.931034] Lustre: tfs-OST0001: new connection from tfs-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) [ 5699.034305] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 5705.213864] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 5707.726502] Lustre: 249164:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 5715.430415] Lustre: tfs-MDT0000-osp-MDT0001: Connection to tfs-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5715.438676] Lustre: tfs-MDT0000: Not available for connect from 0@lo (stopping) [ 5715.440317] Lustre: Skipped 5 previous similar messages [ 5715.462567] Lustre: Skipped 3 previous similar messages [ 5718.311667] Lustre: server umount tfs-MDT0000 complete [ 5720.699552] LustreError: 246129:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788909054 with bad export cookie 12603451167160664347 [ 5720.701500] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5720.709672] LustreError: 246129:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 5720.894443] Lustre: server umount tfs-MDT0001 complete [ 5733.966066] Lustre: server umount tfs-OST0000 complete [ 5746.419899] Lustre: server umount tfs-OST0001 complete [ 5759.386868] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 5766.210613] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5766.553486] LustreError: 251414:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5766.565572] LustreError: 251414:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 8 previous similar messages [ 5766.600472] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5766.604710] Lustre: Skipped 3 previous similar messages [ 5769.716412] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 5776.129766] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 5778.791141] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 5780.991242] Lustre: 252556:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 5785.359023] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5789.435170] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 5792.754360] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49730 to 0x280000401:49824) [ 5795.304844] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5800.160594] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 5800.970246] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:97) [ 5806.123623] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 5808.691866] Lustre: 254424:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 5813.776141] Lustre: DEBUG MARKER: == conf-sanity test 104a: Make sure user defined options are reflected in mount ========================================================== 19:12:26 (1788909146) [ 5827.556442] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 5827.559702] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5827.565859] Lustre: Skipped 1 previous similar message [ 5827.571181] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 5833.726908] Lustre: server umount lustre-MDT0000 complete [ 5836.249316] LustreError: 254426:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788909170 with bad export cookie 12603451167160666013 [ 5836.255602] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5836.265899] LustreError: 254426:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 5836.774723] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5836.801172] Lustre: Skipped 4 previous similar messages [ 5842.483836] Lustre: server umount lustre-MDT0001 complete [ 5851.434902] Lustre: server umount lustre-OST0000 complete [ 5859.952600] Lustre: server umount lustre-OST0001 complete [ 5864.145978] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_hostid [ 5870.100758] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 5894.389120] LDISKFS-fs (dm-0): Mount option "noacl" will be removed by 3.5 [ 5894.389120] Contact linux-ldiskfs@vger.kernel.org if you think we should keep it. [ 5894.389120] [ 5894.403731] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: acl,user_xattr,errors=remount-ro,noacl,no_mbcache,nodelalloc [ 5894.546988] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 5894.565517] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 5894.625241] Lustre: lustre-MDT0000: new disk, initializing [ 5894.680100] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 5894.686113] Lustre: Skipped 3 previous similar messages [ 5894.697090] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 5898.272721] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 5906.662551] LDISKFS-fs (dm-1): Mount option "noacl" will be removed by 3.5 [ 5906.662551] Contact linux-ldiskfs@vger.kernel.org if you think we should keep it. [ 5906.662551] [ 5906.683698] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: acl,user_xattr,errors=remount-ro,noacl,no_mbcache,nodelalloc [ 5906.756728] Lustre: 257602:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 5906.805766] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 5906.809583] Lustre: Skipped 1 previous similar message [ 5906.868745] Lustre: lustre-MDT0001: new disk, initializing [ 5906.990793] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 5906.999629] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 5910.176834] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 5918.518131] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5918.694685] Lustre: lustre-OST0000: new disk, initializing [ 5918.696643] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 5918.699594] Lustre: 259188:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 5920.052233] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 5920.065586] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 5920.174544] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 5922.972287] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 5929.695056] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 5929.831851] Lustre: lustre-OST0001: new disk, initializing [ 5929.836653] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 5929.842731] Lustre: 260058:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 5931.258142] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 5931.268476] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 5931.382131] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 5934.311064] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 5942.301732] Lustre: DEBUG MARKER: == conf-sanity test 104b: Mount uses last flock argument ========================================================== 19:14:35 (1788909275) [ 5950.666226] Lustre: DEBUG MARKER: == conf-sanity test 105: check file creation for ro and rw bind mnt pt ========================================================== 19:14:43 (1788909283) [ 5966.305985] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 5966.314308] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5966.315705] LustreError: Skipped 1 previous similar message [ 5966.323853] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 5966.329929] Lustre: Skipped 1 previous similar message [ 5966.346598] Lustre: Skipped 9 previous similar messages [ 5969.401446] Lustre: server umount lustre-OST0000 complete [ 5972.454607] LustreError: 259324:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 5972.466484] LustreError: 259324:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 9 previous similar messages [ 5977.891684] Lustre: server umount lustre-MDT0000 complete [ 5980.188266] LustreError: 257595:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788909314 with bad export cookie 12603451167160667560 [ 5980.194966] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 5980.197946] LustreError: 257595:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 5986.399200] Lustre: server umount lustre-MDT0001 complete [ 5992.998569] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing unload_modules_local [ 6006.103036] Lustre: server umount lustre-OST0001 complete [ 6009.949136] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_hostid [ 6020.177773] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 6044.549728] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6044.695524] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 6044.717516] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 6044.768645] Lustre: lustre-MDT0000: new disk, initializing [ 6044.828703] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 6047.055771] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 6054.638623] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6054.715814] Lustre: 264585:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 6054.984732] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 6057.743776] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 6064.441788] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 6068.373102] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 6072.951271] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6073.251064] Lustre: lustre-OST0000: new disk, initializing [ 6073.255533] Lustre: Skipped 1 previous similar message [ 6073.260198] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 6073.264523] Lustre: Skipped 2 previous similar messages [ 6073.272242] Lustre: 266553:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 6075.191819] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 6075.198675] Lustre: Skipped 1 previous similar message [ 6075.204343] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 6075.313808] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 6077.392413] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 6084.429835] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 6090.729574] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6090.736494] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 6090.739132] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6090.739141] Lustre: Skipped 10 previous similar messages [ 6090.740403] Lustre: Skipped 5 previous similar messages [ 6090.753102] LustreError: Skipped 1 previous similar message [ 6094.582885] Lustre: server umount lustre-OST0000 complete [ 6103.639884] Lustre: server umount lustre-MDT0000 complete [ 6106.374802] LustreError: 264578:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788909440 with bad export cookie 12603451167160669037 [ 6106.377775] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6106.380870] LustreError: 264578:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 6106.617344] Lustre: server umount lustre-MDT0001 complete [ 6113.987142] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing unload_modules_local [ 6115.833687] Key type lgssc unregistered [ 6116.045557] LNet: 268313:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6116.049492] LNetError: 268313:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6116.062162] LNet: Removed LNI 192.168.201.130@tcp [ 6116.638252] Key type .llcrypt unregistered [ 6116.641116] Key type ._llcrypt unregistered [ 6133.948872] Key type ._llcrypt registered [ 6133.950660] Key type .llcrypt registered [ 6134.038234] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 6134.613367] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6134.704776] alg: No test for adler32 (adler32-zlib) [ 6135.624828] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 6135.770723] LNet: Added LNI 192.168.201.130@tcp [8/256/0/180] [ 6137.376173] Key type lgssc registered [ 6138.094341] Lustre: Echo OBD driver; http://www.lustre.org/ [ 6142.883325] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 6142.892731] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6144.096670] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6145.987502] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 6151.545718] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6151.763793] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6154.085487] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 6158.043778] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 6161.091432] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 6164.451024] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6164.669356] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6167.740763] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 6169.833354] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:33) [ 6172.525068] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 6173.229949] Lustre: Setting parameter lustre-OST0000.ost.unknown_param=50 in log lustre-OST0000 [ 6175.205242] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 6175.208876] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6175.227578] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6176.294889] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6176.301086] Lustre: Skipped 1 previous similar message [ 6176.581965] Lustre: server umount lustre-OST0000 complete [ 6181.346036] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6181.353493] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6181.356358] Lustre: Skipped 1 previous similar message [ 6185.178686] Lustre: server umount lustre-MDT0000 complete [ 6186.465381] LustreError: 270490:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6186.478060] LustreError: 270490:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [ 6187.299267] LustreError: 269779:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788909521 with bad export cookie 5492457554263401381 [ 6187.301143] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6187.313292] LustreError: 269779:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 6187.504131] Lustre: server umount lustre-MDT0001 complete [ 6193.750662] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing unload_modules_local [ 6195.496502] Key type lgssc unregistered [ 6195.750630] LNet: 273334:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6195.756594] LNetError: 273334:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6195.766729] LNet: Removed LNI 192.168.201.130@tcp [ 6196.317237] Key type .llcrypt unregistered [ 6196.319099] Key type ._llcrypt unregistered [ 6208.146757] Key type ._llcrypt registered [ 6208.148105] Key type .llcrypt registered [ 6208.243781] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 6208.866393] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6208.899495] alg: No test for adler32 (adler32-zlib) [ 6209.839143] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 6210.017531] LNet: Added LNI 192.168.201.130@tcp [8/256/0/180] [ 6211.656148] Key type lgssc registered [ 6212.264053] Lustre: Echo OBD driver; http://www.lustre.org/ [ 6217.769542] Lustre: lustre-OST0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 6217.784694] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6233.249266] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 6238.368935] LustreError: 274505:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.201.130@tcp: failed processing log, type 4: rc = -110 [ 6264.992236] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6268.372410] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 6272.527633] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 6273.932532] Lustre: server umount lustre-OST0000 complete [ 6283.960523] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing unload_modules_local [ 6285.766229] Key type lgssc unregistered [ 6285.967520] LNet: 276135:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6285.972396] LNetError: 276135:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6285.981644] LNet: Removed LNI 192.168.201.130@tcp [ 6286.394164] Key type .llcrypt unregistered [ 6286.396599] Key type ._llcrypt unregistered [ 6311.383931] Key type ._llcrypt registered [ 6311.388849] Key type .llcrypt registered [ 6311.496645] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 6312.348116] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6312.360925] alg: No test for adler32 (adler32-zlib) [ 6313.326499] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 6313.492855] LNet: Added LNI 192.168.201.130@tcp [8/256/0/180] [ 6315.120165] Key type lgssc registered [ 6315.826674] Lustre: Echo OBD driver; http://www.lustre.org/ [ 6323.659278] loop0: detected capacity change from 0 to 204800000 [ 6323.793219] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 6323.799931] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 6323.957921] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 6324.551656] loop0: detected capacity change from 0 to 204800000 [ 6324.703392] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 6324.710383] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 6324.880611] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 6325.569650] loop0: detected capacity change from 0 to 204800000 [ 6325.650502] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 6325.656428] blk_update_request: operation not supported error, dev loop0, sector 8224 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 6325.714846] blk_update_request: operation not supported error, dev loop0, sector 58264 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 6326.346128] loop0: detected capacity change from 0 to 204800000 [ 6326.437148] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 6327.163121] loop0: detected capacity change from 0 to 204800000 [ 6327.189428] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 6329.541628] loop0: detected capacity change from 0 to 204800000 [ 6329.573459] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 6332.016844] loop0: detected capacity change from 0 to 204800000 [ 6332.038196] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 6334.264832] loop0: detected capacity change from 0 to 204800000 [ 6334.284494] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 6336.569694] loop0: detected capacity change from 0 to 204800000 [ 6336.609565] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 6336.628279] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6336.668963] Lustre: 279523:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 6336.673773] Lustre: 279523:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000-MDT0000' with [0x200000005:0x2:0x0]: rc = 0 [ 6336.679794] Lustre: 279523:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000003:0xc:0x0]: rc = 0 [ 6336.683512] Lustre: 279523:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000003:0xa:0x0]: rc = 0 [ 6336.688281] Lustre: 279523:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000-MDT0000' with [0x200000005:0x3:0x0]: rc = 0 [ 6336.693934] Lustre: 279523:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000003:0xb:0x0]: rc = 0 [ 6336.700651] Lustre: 279523:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000-MDT0000' with [0x200000005:0x1:0x0]: rc = 0 [ 6336.710705] Lustre: 279523:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index 'nodemap' with [0x200000003:0x3:0x0]: rc = 0 [ 6336.716953] Lustre: 279523:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000006:0x2010000:0x0]: rc = 0 [ 6336.722452] Lustre: 279523:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000006:0x10000:0x0]: rc = 0 [ 6336.727950] Lustre: 279523:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000006:0x1010000:0x0]: rc = 0 [ 6336.732516] Lustre: 279523:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1020000' with [0x200000006:0x1020000:0x0]: rc = 0 [ 6336.737718] Lustre: 279523:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2020000' with [0x200000006:0x2020000:0x0]: rc = 0 [ 6336.741724] Lustre: 279523:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x20000' with [0x200000006:0x20000:0x0]: rc = 0 [ 6340.163486] Lustre: server umount MGS complete [ 6340.603084] loop0: detected capacity change from 0 to 204800000 [ 6340.670796] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6340.871896] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6340.893302] Lustre: lustre-MDT0000: Aborting client recovery [ 6341.399867] loop1: detected capacity change from 0 to 204800000 [ 6341.470038] LDISKFS-fs (loop1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6341.541890] Lustre: 279954:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 6341.548468] Lustre: 279954:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x10000-MDT0001' with [0x200000005:0x1:0x0]: rc = 0 [ 6341.554324] Lustre: 279954:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x1010000-MDT0001' with [0x200000005:0x2:0x0]: rc = 0 [ 6341.560161] Lustre: 279954:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x10000' with [0x200000003:0x4:0x0]: rc = 0 [ 6341.564849] Lustre: 279954:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x1010000' with [0x200000003:0x5:0x0]: rc = 0 [ 6341.571477] Lustre: 279954:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x2010000' with [0x200000003:0x6:0x0]: rc = 0 [ 6341.576981] Lustre: 279954:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x2010000-MDT0001' with [0x200000005:0x3:0x0]: rc = 0 [ 6341.586801] Lustre: Found index 1 for lustre-MDT0001, updating log [ 6341.683032] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6341.709467] Lustre: lustre-MDT0001: Aborting client recovery [ 6342.161478] loop2: detected capacity change from 0 to 204800000 [ 6342.231311] LDISKFS-fs (loop2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6342.291084] Lustre: 280035:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 6342.298679] Lustre: 280035:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 6342.306062] Lustre: 280035:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x20000-OST0000' with [0x200000005:0x1:0x0]: rc = 0 [ 6342.317180] Lustre: 280035:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x1020000-OST0000' with [0x200000005:0x2:0x0]: rc = 0 [ 6342.325436] Lustre: 280035:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 6342.333672] Lustre: 280035:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 6342.340485] Lustre: 280035:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x2020000-OST0000' with [0x200000005:0x3:0x0]: rc = 0 [ 6342.407279] Lustre: Found index 0 for lustre-OST0000, updating log [ 6342.423681] Lustre: 280053:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 6342.463284] Lustre: lustre-OST0000: Aborting recovery [ 6342.918199] loop3: detected capacity change from 0 to 204800000 [ 6342.970540] LDISKFS-fs (loop3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6343.007726] Lustre: 280118:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 6343.016459] Lustre: 280118:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x20000-OST0001' with [0x200000005:0x1:0x0]: rc = 0 [ 6343.026939] Lustre: 280118:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 6343.031812] Lustre: 280118:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x1020000-OST0001' with [0x200000005:0x2:0x0]: rc = 0 [ 6343.036534] Lustre: 280118:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 6343.042845] Lustre: 280118:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x2020000-OST0001' with [0x200000005:0x3:0x0]: rc = 0 [ 6343.048568] Lustre: 280118:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 6343.072748] Lustre: 280123:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 6343.097430] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 6343.100158] Lustre: Skipped 1 previous similar message [ 6343.109106] Lustre: lustre-OST0001: Aborting recovery [ 6348.278126] LustreError: 279898:0:(lod_dev.c:511:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 8, retries 0, failed: rc = -108 [ 6350.310601] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 6350.318620] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 6350.351638] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000bd0 [ 6350.366511] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000bd0 [ 6351.334154] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:5 to 0x280000400:33) [ 6351.334154] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:5 to 0x2c0000400:33) [ 6354.570499] LustreError: 279865:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0000: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0000 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0000/identity_upcall, time 290us: rc = -2 [ 6355.077610] LustreError: 279864:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0000: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0000 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0000/identity_upcall, time 385us: rc = -2 [ 6355.086510] LustreError: 279864:0:(mdt_identity.c:115:mdt_identity_do_upcall()) Skipped 31 previous similar messages [ 6366.690154] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6366.690568] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6366.697850] Lustre: Skipped 3 previous similar messages [ 6371.809020] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6371.812559] Lustre: Skipped 6 previous similar messages [ 6372.659393] Lustre: server umount lustre-MDT0000 complete [ 6373.084687] LustreError: 279848:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788909707 with bad export cookie 8907907037537964425 [ 6373.088816] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6373.090100] LustreError: 279848:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 6376.928595] LustreError: 279863:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6376.928989] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6376.934540] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 6376.935434] LustreError: 279863:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [ 6376.953027] Lustre: Skipped 1 previous similar message [ 6378.976874] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 6378.976882] LustreError: 279862:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6378.982327] Lustre: Skipped 2 previous similar messages [ 6378.993567] LustreError: 279862:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 6379.429425] Lustre: server umount lustre-MDT0001 complete [ 6394.336104] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 6394.394598] Lustre: server umount lustre-OST0000 complete [ 6409.184164] Lustre: lustre-OST0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 6409.290196] Lustre: server umount lustre-OST0001 complete [ 6414.049047] Lustre: DEBUG MARKER: == conf-sanity test 109a: test lctl clear_conf fsname ==== 19:22:27 (1788909747) [ 6429.077631] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_hostid [ 6434.373409] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 6453.686080] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6453.789446] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 6453.807928] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 6453.851807] Lustre: lustre-MDT0000: new disk, initializing [ 6453.886584] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6453.899950] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 6455.884458] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 6462.037891] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6462.093531] Lustre: 284185:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 6462.128735] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 6462.130593] Lustre: Skipped 1 previous similar message [ 6462.167902] Lustre: lustre-MDT0001: new disk, initializing [ 6462.219416] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6462.242867] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 6462.250833] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 6464.192368] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 6470.015175] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 6472.867606] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 6476.333095] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6476.527721] Lustre: lustre-OST0000: new disk, initializing [ 6476.535748] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 6476.541569] Lustre: 286152:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 6476.606326] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6479.812859] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 6481.934684] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 6481.943707] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 6481.996813] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 6484.924950] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 6488.110758] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 6492.632367] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 6502.362611] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 6509.251903] Lustre: Modifying parameter lustre-client.llite.max_read_ahead_mb=64 in log lustre-client [ 6553.569628] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 6553.570751] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6553.572981] LustreError: Skipped 1 previous similar message [ 6553.574145] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6553.578485] Lustre: Skipped 1 previous similar message [ 6555.550053] Lustre: server umount lustre-OST0000 complete [ 6558.690164] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6563.376673] Lustre: server umount lustre-MDT0000 complete [ 6563.810040] LustreError: 284196:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6563.817875] LustreError: 284196:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 6565.045490] LustreError: 284980:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788909899 with bad export cookie 8907907037537967141 [ 6565.049655] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6565.049918] LustreError: 284980:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 6565.185448] Lustre: server umount lustre-MDT0001 complete [ 6568.856716] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6570.537737] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 6572.824848] Lustre: server umount MGS complete [ 6578.137876] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6578.397411] LustreError: 290110:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6578.413478] LustreError: 290123:0:(qmt_pool.c:1645:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 6578.448436] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6580.179993] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 6583.777720] LustreError: 290111:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6583.920659] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6585.919535] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 6588.956805] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 6591.252168] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 6594.640751] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6597.390853] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 6600.925787] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 6628.833698] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 6628.841261] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6628.851959] Lustre: Skipped 1 previous similar message [ 6628.855610] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6628.858333] Lustre: Skipped 3 previous similar messages [ 6629.863481] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 6632.415662] Lustre: server umount lustre-OST0000 complete [ 6640.310593] Lustre: server umount lustre-MDT0000 complete [ 6642.163761] LustreError: 290090:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788909976 with bad export cookie 8907907037537968940 [ 6642.167112] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6642.172151] LustreError: 290090:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 6642.371160] Lustre: server umount lustre-MDT0001 complete [ 6648.659707] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing unload_modules_local [ 6650.243502] Key type lgssc unregistered [ 6650.415074] LNet: 294051:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6650.419677] LNetError: 294051:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6650.429662] LNet: Removed LNI 192.168.201.130@tcp [ 6650.892185] Key type .llcrypt unregistered [ 6650.894153] Key type ._llcrypt unregistered [ 6669.208544] Key type ._llcrypt registered [ 6669.209646] Key type .llcrypt registered [ 6669.261232] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_hostid [ 6677.556668] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 6678.169309] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6678.180704] alg: No test for adler32 (adler32-zlib) [ 6679.119178] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 6679.275893] LNet: Added LNI 192.168.201.130@tcp [8/256/0/180] [ 6680.904529] Key type lgssc registered [ 6681.439216] Lustre: Echo OBD driver; http://www.lustre.org/ [ 6697.648209] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 6697.655820] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6698.758890] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 6698.779997] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 6698.823606] Lustre: lustre-MDT0000: new disk, initializing [ 6698.868866] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6698.879323] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 6700.967694] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 6707.069582] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6707.135081] Lustre: 297979:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 6707.170333] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 6707.176416] Lustre: Skipped 1 previous similar message [ 6707.224044] Lustre: lustre-MDT0001: new disk, initializing [ 6707.277688] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6707.301911] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 6707.314492] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 6709.332728] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 6714.726659] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 6717.399250] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 6720.667030] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6720.789950] Lustre: lustre-OST0000: new disk, initializing [ 6720.792407] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 6720.796373] Lustre: 299949:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 6720.844846] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6723.556648] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 6723.727708] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 6723.733725] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 6723.803114] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 6729.263786] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 6733.774755] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 6741.405619] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 6749.451137] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 6790.626622] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6790.626896] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 6790.627840] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6790.631451] Lustre: Skipped 1 previous similar message [ 6790.638974] LustreError: Skipped 1 previous similar message [ 6795.752502] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6795.756300] Lustre: Skipped 2 previous similar messages [ 6796.278741] Lustre: server umount lustre-OST0000 complete [ 6799.328854] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 6799.331412] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6799.336383] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6800.866724] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6804.222396] Lustre: server umount lustre-MDT0000 complete [ 6805.959576] LustreError: 301752:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788910139 with bad export cookie 6258353742566466926 [ 6805.960907] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6805.969193] LustreError: 301752:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 6806.105381] Lustre: server umount lustre-MDT0001 complete [ 6810.086670] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6811.931425] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 6814.113622] Lustre: server umount MGS complete [ 6819.047423] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6819.251277] LustreError: 303968:0:(qmt_pool.c:1645:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 6819.282972] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6820.949123] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 6824.418467] LustreError: 303956:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6824.428817] LustreError: 303956:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 6824.734803] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6824.906356] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6826.617782] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 6830.262385] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 6832.917623] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 6836.056070] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6836.188813] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6838.766557] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 6841.975724] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 6869.987725] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6869.990044] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 6869.993390] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6870.001389] Lustre: Skipped 2 previous similar messages [ 6874.279770] Lustre: server umount lustre-OST0000 complete [ 6876.128848] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 6876.133916] LustreError: Skipped 1 previous similar message [ 6876.136894] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6876.142625] Lustre: Skipped 1 previous similar message [ 6876.144786] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6876.147563] Lustre: Skipped 1 previous similar message [ 6882.150531] Lustre: server umount lustre-MDT0000 complete [ 6883.667310] LustreError: 306791:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788910217 with bad export cookie 6258353742566468767 [ 6883.670079] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6883.676266] LustreError: 306791:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 6883.822962] Lustre: server umount lustre-MDT0001 complete [ 6888.418189] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing unload_modules_local [ 6889.707418] Key type lgssc unregistered [ 6889.863655] LNet: 307896:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6889.867700] LNetError: 307896:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6889.875751] LNet: Removed LNI 192.168.201.130@tcp [ 6890.273239] Key type .llcrypt unregistered [ 6890.274751] Key type ._llcrypt unregistered [ 6898.260822] Key type ._llcrypt registered [ 6898.261825] Key type .llcrypt registered [ 6898.312242] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_hostid [ 6905.131668] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 6905.500970] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6905.557084] alg: No test for adler32 (adler32-zlib) [ 6906.444829] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 6906.575431] LNet: Added LNI 192.168.201.130@tcp [8/256/0/180] [ 6908.176132] Key type lgssc registered [ 6908.661922] Lustre: Echo OBD driver; http://www.lustre.org/ [ 6919.170872] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 6925.315606] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 6925.334798] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6926.438218] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 6926.450650] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 6926.489640] Lustre: lustre-MDT0000: new disk, initializing [ 6926.523399] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6926.533953] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 6928.111946] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 6932.725851] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6932.844571] Lustre: lustre-OST0000: new disk, initializing [ 6932.846866] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 6932.848912] Lustre: Skipped 1 previous similar message [ 6932.851848] Lustre: 311932:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 6932.878959] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6934.689284] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 6934.694629] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 6934.710918] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 6935.221946] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 7230.211588] Lustre: server umount lustre-MDT0000 complete [ 7231.757421] LustreError: 311119:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788910565 with bad export cookie 10278229493269930069 [ 7231.762830] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7241.276636] Lustre: server umount lustre-OST0000 complete [ 7252.381962] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_hostid [ 7257.127488] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 7271.607392] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7271.697874] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 7271.707864] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 7271.744110] Lustre: lustre-MDT0000: new disk, initializing [ 7271.773336] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7271.781546] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 7273.276398] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 7278.180707] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7278.237926] Lustre: 316173:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 7278.272471] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 7278.275259] Lustre: Skipped 1 previous similar message [ 7278.320430] Lustre: lustre-MDT0001: new disk, initializing [ 7278.365507] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7278.382071] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 7278.391445] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 7280.109768] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 7284.331288] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 7286.338837] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 7289.120114] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7289.244566] Lustre: lustre-OST0000: new disk, initializing [ 7289.246429] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 7289.249880] Lustre: 318138:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 7289.288954] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7291.838713] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 7296.394206] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 7297.536097] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 7297.539879] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 7297.582329] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 7298.168452] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 7298.260590] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 7299.826145] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 7299.900779] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 7302.631116] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 7302.631256] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7302.631847] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7302.633726] LustreError: Skipped 1 previous similar message [ 7302.637975] Lustre: Skipped 1 previous similar message [ 7306.705752] Lustre: server umount lustre-OST0000 complete [ 7309.280776] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7309.283212] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7309.287333] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7309.289357] Lustre: Skipped 1 previous similar message [ 7312.865060] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7312.865626] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7314.065947] Lustre: server umount lustre-MDT0000 complete [ 7315.300352] LustreError: 316165:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788910649 with bad export cookie 10278229493272870846 [ 7315.303372] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7315.305340] LustreError: 316165:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 7315.414771] Lustre: server umount lustre-MDT0001 complete [ 7316.536376] Lustre: DEBUG MARKER: SKIP: conf-sanity test_111 skipping SLOW test 111 [ 7317.135469] Lustre: DEBUG MARKER: == conf-sanity test 112a: mount OST with no_create option ========================================================== 19:37:30 (1788910650) [ 7319.382735] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7319.551309] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7320.952571] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 7323.904334] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7325.490104] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 7328.015254] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 7329.847420] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 7332.194158] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7334.613250] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 7337.476064] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 7340.110876] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7340.176925] Lustre: lustre-OST0001: new disk, initializing [ 7340.179505] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 7340.182762] Lustre: 323282:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 7340.216122] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 7340.218522] Lustre: Skipped 2 previous similar messages [ 7342.172528] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 7346.134488] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 7346.178122] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 7346.181210] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 7346.195288] LustreError: 324094:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 7346.226308] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 7347.235286] LustreError: 324103:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [ 7347.238591] LustreError: 324103:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 2 previous similar messages [ 7348.069723] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff89f103fcf800.ost_server_uuid 50 [ 7348.260511] LustreError: 324094:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 7348.264628] LustreError: 324094:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 1 previous similar message [ 7348.720186] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff89f103fcf800.ost_server_uuid in FULL state after 0 sec [ 7350.307541] LustreError: 324094:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [ 7350.310782] LustreError: 324094:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 3 previous similar messages [ 7350.717496] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff89f103fcf800.ost_server_uuid 50 [ 7351.270824] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-ffff89f103fcf800.ost_server_uuid in FULL state after 0 sec [ 7352.360443] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 7365.271226] Lustre: lustre-OST0001: Not available for connect from 192.168.201.30@tcp (stopping) [ 7365.273618] Lustre: Skipped 1 previous similar message [ 7366.628027] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7370.385219] Lustre: lustre-OST0001: Not available for connect from 192.168.201.30@tcp (stopping) [ 7370.391969] Lustre: Skipped 2 previous similar messages [ 7377.376129] Lustre: lustre-OST0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 7377.415389] Lustre: server umount lustre-OST0001 complete [ 7380.449900] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 7380.450098] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7380.451750] LustreError: Skipped 1 previous similar message [ 7380.452277] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7380.452281] Lustre: Skipped 5 previous similar messages [ 7380.462803] Lustre: Skipped 2 previous similar messages [ 7381.988290] LustreError: 322576:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7381.994976] LustreError: 322576:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [ 7385.180147] Lustre: server umount lustre-OST0000 complete [ 7392.755610] Lustre: server umount lustre-MDT0000 complete [ 7395.182252] LustreError: 323281:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788910729 with bad export cookie 10278229493272871714 [ 7395.187483] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7395.194411] LustreError: 323281:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 7395.427712] Lustre: server umount lustre-MDT0001 complete [ 7403.359921] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing unload_modules_local [ 7405.733992] Key type lgssc unregistered [ 7405.946336] LNet: 325965:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7405.951530] LNetError: 325965:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7405.962892] LNet: Removed LNI 192.168.201.130@tcp [ 7406.824286] Key type .llcrypt unregistered [ 7406.825894] Key type ._llcrypt unregistered [ 7431.825980] Key type ._llcrypt registered [ 7431.828149] Key type .llcrypt registered [ 7431.938909] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 7433.299937] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7433.327238] alg: No test for adler32 (adler32-zlib) [ 7434.387978] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 7434.717209] LNet: Added LNI 192.168.201.130@tcp [8/256/0/180] [ 7436.456273] Key type lgssc registered [ 7437.399697] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7443.255729] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7443.264925] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7444.696657] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7447.695890] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 7452.163408] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 7454.181651] LustreError: 327385:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7454.201119] LustreError: 327385:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 7457.178199] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7457.445054] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7461.099945] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 7467.275744] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7467.698414] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7469.738190] LustreError: 329063:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7469.749154] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:65) [ 7471.670886] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 7475.172947] LustreError: 329063:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7476.167675] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 7479.904150] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7480.050806] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 7482.104489] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:33) [ 7483.178126] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 7487.325366] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 7492.232306] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing wait_import_state (FULL|IDLE) os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [ 7492.393681] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 7584.744421] LustreError: lustre-OST0001-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 7584.746165] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7584.750608] LustreError: Skipped 1 previous similar message [ 7584.756599] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 7584.763943] Lustre: Skipped 1 previous similar message [ 7589.319568] Lustre: server umount lustre-OST0001 complete [ 7589.862795] LustreError: 330278:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7589.876691] LustreError: 330278:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 7592.930895] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 7592.939997] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7592.951501] Lustre: Skipped 1 previous similar message [ 7592.963342] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7594.979564] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7594.979832] LustreError: 330278:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7594.982955] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7594.991870] Lustre: Skipped 1 previous similar message [ 7594.994264] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 7595.001527] LustreError: 330278:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 7598.209302] Lustre: server umount lustre-OST0000 complete [ 7601.121507] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7601.129744] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7601.135899] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7605.217812] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7605.219616] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7606.577718] Lustre: server umount lustre-MDT0000 complete [ 7608.770941] LustreError: 327363:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788910942 with bad export cookie 18336452437705045321 [ 7608.773652] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7608.782229] LustreError: 327363:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 7608.928207] Lustre: server umount lustre-MDT0001 complete [ 7615.066646] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing unload_modules_local [ 7616.634861] Key type lgssc unregistered [ 7616.768642] LNet: 332324:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7616.772264] LNetError: 332324:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7616.781756] LNet: Removed LNI 192.168.201.130@tcp [ 7617.185834] Key type .llcrypt unregistered [ 7617.186852] Key type ._llcrypt unregistered [ 7640.422362] Key type ._llcrypt registered [ 7640.423472] Key type .llcrypt registered [ 7640.466211] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 7640.924275] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7640.940927] alg: No test for adler32 (adler32-zlib) [ 7641.814347] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 7641.919367] LNet: Added LNI 192.168.201.130@tcp [8/256/0/180] [ 7643.504167] Key type lgssc registered [ 7643.960566] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7647.966570] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7647.983942] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7649.238390] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7651.139734] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 7655.359516] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7655.586960] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7657.459527] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 7658.969276] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 7662.164048] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7662.349508] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7664.920277] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 7665.446280] LustreError: 336076:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7665.454109] LustreError: 336076:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 7668.593623] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7668.759657] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 7671.733500] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 7674.867244] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:65) [ 7674.869269] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:97) [ 7682.481309] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 7688.711437] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 7695.213503] Lustre: server umount lustre-MDT0000 complete [ 7695.332642] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7695.333854] LustreError: 334583:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7695.337311] Lustre: Skipped 2 previous similar messages [ 7695.341935] LustreError: 334583:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 7696.627211] LustreError: 334568:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788911030 with bad export cookie 7520577304268043577 [ 7696.631511] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7696.631601] LustreError: 334568:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 7698.821628] Lustre: server umount lustre-MDT0001 complete [ 7710.737955] Lustre: server umount lustre-OST0000 complete [ 7722.548455] Lustre: server umount lustre-OST0001 complete [ 7728.990936] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 7732.997528] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7733.139850] LustreError: 339846:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7733.165802] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7734.859472] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 7738.337342] LustreError: 339847:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7738.511795] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7740.286657] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 7741.363539] Lustre: 340985:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 7743.955214] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7744.137539] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7744.140675] Lustre: Skipped 1 previous similar message [ 7746.377978] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 7748.261440] LustreError: 341955:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7749.614301] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7752.076639] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 7758.314503] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:129) [ 7758.314896] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:97) [ 7761.025923] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 7762.275137] Lustre: 342857:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 7763.427608] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7763.430125] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7763.431553] Lustre: Skipped 2 previous similar messages [ 7763.435217] Lustre: Skipped 3 previous similar messages [ 7768.545668] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7768.549086] Lustre: Skipped 3 previous similar messages [ 7769.435052] Lustre: server umount lustre-MDT0000 complete [ 7770.824295] LustreError: 340987:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788911104 with bad export cookie 7520577304268045278 [ 7770.827124] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7770.829361] LustreError: 340987:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 7770.945932] Lustre: server umount lustre-MDT0001 complete [ 7782.918546] Lustre: server umount lustre-OST0000 complete [ 7794.614366] Lustre: server umount lustre-OST0001 complete [ 7796.172984] Lustre: DEBUG MARKER: SKIP: conf-sanity test_114 skipping SLOW test 114 [ 7796.824413] Lustre: DEBUG MARKER: SKIP: conf-sanity test_115 skipping excluded test 115 [ 7797.560655] Lustre: DEBUG MARKER: == conf-sanity test 116: big size MDT support ============ 19:45:30 (1788911130) [ 7806.752193] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 7810.173781] loop0: detected capacity change from 0 to 1099511627776 [ 7810.347051] SGI XFS with ACLs, security attributes, quota, no debug enabled [ 7810.353450] *** VALIDATE xfs *** [ 7810.357991] XFS (loop0): Mounting V5 Filesystem [ 7810.368885] XFS (loop0): Ending clean mount [ 7810.834670] loop1: detected capacity change from 0 to 18691697672192 [ 7834.386515] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_hostid [ 7838.014484] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 7851.004875] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7851.109888] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 7851.121716] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 7851.162683] Lustre: lustre-MDT0000: new disk, initializing [ 7851.189721] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7851.191949] Lustre: Skipped 1 previous similar message [ 7851.198273] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 7852.694728] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 7857.215319] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7857.267819] Lustre: 347964:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 7857.292333] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 7857.294078] Lustre: Skipped 1 previous similar message [ 7857.330167] Lustre: lustre-MDT0001: new disk, initializing [ 7857.382738] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 7857.386361] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 7858.944833] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 7862.833245] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 7864.787849] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 7867.075725] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7867.185113] Lustre: lustre-OST0000: new disk, initializing [ 7867.187181] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 7867.190699] Lustre: 349934:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 7868.985576] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 7868.989343] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 7869.032155] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 7869.171067] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 7873.003254] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 7874.398989] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 7874.471988] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 7875.886878] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 7875.967294] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 7879.141466] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 7879.141888] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7879.143446] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7879.143887] LustreError: Skipped 1 previous similar message [ 7879.147329] Lustre: Skipped 3 previous similar messages [ 7882.767976] Lustre: server umount lustre-OST0000 complete [ 7884.257412] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7884.258198] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7884.261370] Lustre: Skipped 1 previous similar message [ 7884.265612] Lustre: Skipped 2 previous similar messages [ 7889.376972] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7889.379017] Lustre: Skipped 1 previous similar message [ 7890.137162] Lustre: server umount lustre-MDT0000 complete [ 7891.403489] LustreError: 347959:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788911225 with bad export cookie 7520577304268046811 [ 7891.406255] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7891.407194] LustreError: 347959:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 7891.528292] Lustre: server umount lustre-MDT0001 complete [ 7894.347519] XFS (loop0): Unmounting Filesystem [ 7896.064792] Lustre: DEBUG MARKER: == conf-sanity test 117: lctl get_param return errors properly ========================================================== 19:47:09 (1788911229) [ 7898.390737] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7898.555285] LustreError: 352490:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7898.585619] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7898.588160] Lustre: Skipped 2 previous similar messages [ 7899.990297] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 7903.018115] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7904.460495] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 7906.928556] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 7908.840081] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 7911.131755] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7913.189016] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 7915.682875] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 7933.923159] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 7933.923831] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7933.925727] LustreError: Skipped 1 previous similar message [ 7933.930421] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7933.932534] Lustre: Skipped 1 previous similar message [ 7935.840778] Lustre: server umount lustre-OST0000 complete [ 7939.043057] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7943.445281] Lustre: server umount lustre-MDT0000 complete [ 7944.160937] LustreError: 352490:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7944.165234] LustreError: 352490:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 7944.755194] LustreError: 352470:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788911278 with bad export cookie 7520577304268047693 [ 7944.758524] LustreError: 352470:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 7944.758651] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7944.899588] Lustre: server umount lustre-MDT0001 complete [ 7948.964796] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing unload_modules_local [ 7950.093460] Key type lgssc unregistered [ 7950.234353] LNet: 356137:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7950.237192] LNetError: 356137:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7950.248345] LNet: Removed LNI 192.168.201.130@tcp [ 7950.592174] Key type .llcrypt unregistered [ 7950.594053] Key type ._llcrypt unregistered [ 7960.972270] Key type ._llcrypt registered [ 7960.973383] Key type .llcrypt registered [ 7961.011825] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 7961.463871] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7961.470914] alg: No test for adler32 (adler32-zlib) [ 7962.329371] Lustre: Lustre: Build Version: 2.17.55_26_gfb964ff [ 7962.427631] LNet: Added LNI 192.168.201.130@tcp [8/256/0/180] [ 7964.008131] Key type lgssc registered [ 7964.347901] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7966.953661] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7966.959428] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7968.096411] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7969.382868] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 7972.285329] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7972.418902] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7973.758158] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 7976.242252] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 7978.177190] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 7980.497926] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7980.614169] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7982.772594] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 7985.354030] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 8002.198941] Lustre: lustre-MDT0001: Not available for connect from 192.168.201.30@tcp (stopping) [ 8003.040822] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [ 8003.043519] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8003.049505] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 8004.577991] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 8004.579138] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8005.776989] Lustre: server umount lustre-MDT0001 complete [ 8007.310932] LustreError: 357676:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.201.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8007.315869] LustreError: 357676:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 8009.280625] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8009.318906] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [ 8009.320921] Lustre: Found index 1 for lustre-MDT0001, updating log [ 8009.333080] Lustre: 357669:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8009.440608] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8010.854727] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 8014.822321] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 8019.429194] LustreError: 361560:0:(obd_mount.c:234:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [ 8019.431535] LustreError: 361560:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [ 8019.434264] LustreError: 357673:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [ 8019.457342] LustreError: 361563:0:(obd_config.c:2103:class_config_llog_handler()) MGC192.168.201.130@tcp: cfg command failed: rc = -17 [ 8019.460929] Lustre: cmd=cf001 0:lustre-MDT0001-osp-MDT0000 1:osp 2:lustre-MDT0000-mdtlov_UUID [ 8019.460929] [ 8314.517160] Lustre: lustre-MDT0001: Not available for connect from 192.168.201.30@tcp (stopping) [ 8314.519496] Lustre: Skipped 1 previous similar message [ 8316.899775] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [ 8316.899787] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8316.906918] Lustre: Skipped 1 previous similar message [ 8319.630920] Lustre: lustre-MDT0001: Not available for connect from 192.168.201.30@tcp (stopping) [ 8319.634034] Lustre: Skipped 2 previous similar messages [ 8328.160075] Lustre: lustre-MDT0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 8328.214752] Lustre: server umount lustre-MDT0001 complete [ 8329.870804] LustreError: 357705:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.201.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8331.694252] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8331.726309] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [ 8331.728717] Lustre: Found index 1 for lustre-MDT0001, updating log [ 8331.743357] Lustre: 357668:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8331.850979] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8333.270024] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 8336.871865] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 8338.408042] LustreError: 373938:0:(obd_mount.c:234:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [ 8338.411115] LustreError: 373938:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [ 8338.414435] LustreError: 357673:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [ 8338.416869] LustreError: 357673:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [ 8338.435513] LustreError: 373943:0:(obd_config.c:761:class_setup()) osp: device 8 already setup: rc = -17 [ 8338.438089] LustreError: 373943:0:(obd_config.c:866:class_detach()) OBD device 8 still set up [ 8338.439957] LustreError: 373943:0:(obd_config.c:2103:class_config_llog_handler()) MGC192.168.201.130@tcp: cfg command failed: rc = -17 [ 8338.443285] Lustre: cmd=cf003 0:lustre-MDT0001-osp-MDT0000 1:lustre-MDT0001_UUID 2:192.168.201.130@tcp [ 8338.443285] [ 8637.079349] Lustre: lustre-MDT0001: Not available for connect from 192.168.201.30@tcp (stopping) [ 8637.082632] Lustre: Skipped 5 previous similar messages [ 8638.946872] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [ 8638.947330] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8638.954038] Lustre: Skipped 1 previous similar message [ 8642.516199] Lustre: server umount lustre-MDT0001 complete [ 8644.069074] LustreError: 368997:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8644.074190] LustreError: 368997:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 8645.940268] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8645.973206] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [ 8645.975708] Lustre: Found index 1 for lustre-MDT0001, updating log [ 8645.987424] Lustre: 357671:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8646.096800] Lustre: lustre-MDT0001: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [ 8647.468595] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 8651.239317] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 8654.309801] LustreError: 386756:0:(obd_mount.c:234:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [ 8654.312615] LustreError: 386756:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [ 8654.315318] LustreError: 357673:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [ 8654.316991] LustreError: 357673:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [ 8654.333098] LustreError: 386759:0:(lod_lov.c:210:lod_add_device()) lustre-MDT0001-osp-MDT0000: cannot connect to next dev lustre-MDT0001_UUID (-114) [ 8654.338330] LustreError: 386759:0:(obd_config.c:2103:class_config_llog_handler()) MGC192.168.201.130@tcp: cfg command failed: rc = -114 [ 8654.341028] Lustre: cmd=cf014 0:lustre-MDT0000-mdtlov 1:lustre-MDT0001_UUID 2:1 3:1 [ 8654.341028] [ 8963.554426] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8963.555697] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8963.564461] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8963.566373] Lustre: Skipped 5 previous similar messages [ 8967.511320] Lustre: server umount lustre-MDT0000 complete [ 8968.673813] LustreError: 357676:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8968.682036] LustreError: 357676:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 8968.737180] LustreError: 358414:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788912302 with bad export cookie 16368028055562600269 [ 8968.740481] LustreError: 358414:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 8968.741337] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8973.792774] LustreError: 357675:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8973.793108] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8973.801026] Lustre: Skipped 2 previous similar messages [ 8983.008081] Lustre: lustre-MDT0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 8983.103458] Lustre: server umount lustre-MDT0001 complete [ 8984.489042] Lustre: server umount lustre-OST0000 complete [ 8987.546825] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_hostid [ 8991.041589] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 9003.540861] Lustre: DEBUG MARKER: == conf-sanity test 120: cross-target rename should not create bad symlinks ========================================================== 20:05:37 (1788912337) [ 9005.857787] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9005.950452] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 9005.961278] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 9006.003741] Lustre: lustre-MDT0000: new disk, initializing [ 9006.029477] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9006.037142] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 9007.518546] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 9011.794235] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9011.835051] Lustre: 401380:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 9011.856272] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 9011.857954] Lustre: Skipped 1 previous similar message [ 9011.896539] Lustre: lustre-MDT0001: new disk, initializing [ 9011.929927] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9011.942542] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 9011.946630] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 9013.391276] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 9017.157042] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 9019.062695] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 9021.331427] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9021.445644] Lustre: lustre-OST0000: new disk, initializing [ 9021.448204] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 9021.451957] Lustre: 403348:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 9021.483661] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9023.278722] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug -1 all [ 9026.908724] Lustre: DEBUG MARKER: oleg130-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 9027.063907] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 9027.066817] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 9027.097675] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 9037.284260] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9037.285376] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9037.287922] Lustre: Skipped 2 previous similar messages [ 9037.290973] Lustre: Skipped 3 previous similar messages [ 9040.930211] Lustre: server umount lustre-MDT0000 complete [ 9042.270421] LustreError: 402175:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788912376 with bad export cookie 16368028055562602208 [ 9042.272886] LustreError: 402188:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0000-osp-MDT0001: osp_attr_get update error [0x200000401:0x2:0x0]: rc = -5 [ 9042.274411] LustreError: MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9042.276073] LustreError: 402175:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 9042.405690] Lustre: server umount lustre-MDT0001 complete [ 9053.991621] Lustre: server umount lustre-OST0000 complete [ 9062.989509] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing set_hostid [ 9066.149759] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local [ 9075.683416] Lustre: DEBUG MARKER: == conf-sanity test complete, duration 8866 sec ========== 20:06:49 (1788912409) [ 9076.240101] Lustre: DEBUG MARKER: === conf-sanity: start cleanup 20:06:49 (1788912409) === [ 9077.383318] Lustre: DEBUG MARKER: === conf-sanity: finish cleanup 20:06:50 (1788912410) === [ 9090.037634] Lustre: DEBUG MARKER: oleg130-server.virtnet: executing unload_modules_local [ 9091.067700] Key type lgssc unregistered [ 9091.202423] LNet: 409702:0:(lib-ptl.c:977:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 9091.204543] LNetError: 409702:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 9091.211207] LNet: Removed LNI 192.168.201.130@tcp [ 9091.508098] Key type .llcrypt unregistered [ 9091.509048] Key type ._llcrypt unregistered